Data Engineer - Python

Description :

Key Responsibilities :

Observability & Monitoring :

- Design, architect, and implement scalable, reliable, and efficient observability solutions.

- Gain insights from metrics, events, logs, and traces using industry-standard observability platforms.

- Lead the migration and consolidation of dashboards across observability tools, ensuring validation and accuracy of new implementations.

- Utilize Prometheus and similar tools for monitoring, logging, and performance visibility.

- Demonstrate expert-level understanding of log monitoring and the overall observability landscape.

Scripting & Automation :

- Develop robust Python and Unix scripts to automate log retrieval, system monitoring, and other operational tasks.

- Build automation frameworks that improve system reliability and reduce manual intervention.

Database (MongoDB) Engineering :

- Apply strong knowledge of MongoDB architecture, aggregation framework, and schema design.

- Optimize database performance through indexing strategies, query optimization, and schema enhancements.

- Monitor and manage database storage, capacity planning, and scaling requirements.

- Support MongoDB deployments on cloud platforms, including Microsoft Azure.

Required Skills & Qualifications :

- 3- 5 years of experience in observability engineering or a related role.

- Strong proficiency in Python scripting and automation frameworks.

- Hands-on experience with Prometheus or similar observability/monitoring tools.

- Solid understanding of metrics, logs, events, and traces.

- Expertise in MongoDB design and performance optimization.

- Experience working in cloud environments, preferably Microsoft Azure.

- Strong analytical, problem-solving, and troubleshooting abilities.