Posted on: 16/11/2026
About the Role:
We are specifically looking for Data Engineers who go beyond traditional data pipeline development and have hands-on experience in production troubleshooting, AI application support, Azure log analysis, and Python-driven incident investigation.
Key Responsibilities:
- Monitor, troubleshoot, and support production data pipelines, AI/ML workflows, and backend services.
- Analyze Azure logs, application telemetry, and system-level logs to identify errors, anomalies, and performance bottlenecks.
- Use Python scripting to investigate production issues, analyze logs, automate troubleshooting, and identify patterns in recurring incidents.
- Perform incident investigation, root cause analysis (RCA), and resolution tracking.
- Work closely with AI/ML engineers, data engineering teams, and application support teams to troubleshoot operational issues.
- Investigate failures in AI-powered applications, LLM-based workflows, API integrations, and data processing systems.
- Support production operations by identifying recurring issues and implementing preventive measures.
- Develop Python-based utilities and scripts to automate log analysis, monitoring, and incident investigation.
- Collaborate with cross-functional teams to improve system reliability, observability, and operational efficiency.
- Maintain technical documentation, incident reports, and RCA findings.
Required Skills & Experience:
- Strong hands-on experience in Python programming and scripting.
- Experience in data engineering, production support, application troubleshooting, or operational support.
- Practical exposure to Azure monitoring and log analysis, including Azure Monitor, Log Analytics, Application Insights, or similar tools.
- Experience analyzing application logs, identifying errors, investigating incidents, and performing root cause analysis.
- Understanding of data pipelines, backend services, APIs, and distributed systems.
- Experience with SQL and database troubleshooting.
- Ability to investigate complex technical issues independently and drive them toward resolution.
- Strong debugging, analytical, and problem-solving skills.
Good to Have:
- Exposure to AI/ML application troubleshooting and operational support.
- Experience supporting LLM-based applications, RAG pipelines, AI agents, or model-serving workflows.
- Familiarity with Azure AI services and cloud-based data engineering platforms.
- Exposure to Azure Data Factory, Databricks, or related data engineering technologies.
- Knowledge of monitoring and observability tools such as Grafana, Prometheus, Splunk, or ELK.
- Experience with incident management processes, production monitoring, and SLA-driven support.
- Familiarity with CI/CD, Git, and cloud-native application environments.
Did you find something suspicious?
Posted by
Posted in
Data Engineering
Functional Area
Data Engineering
Job Code
1683828