Job Summary:

We are looking for an experienced Data Platform Engineer to enhance the UDAP data platform, focusing on scalability, performance, reliability, and AI-driven automation.

Key Responsibilities:

- Design and optimize scalable data pipelines and batch/streaming workflows.

- Develop automation solutions to improve operational efficiency.

- Implement monitoring, alerting, and anomaly detection.

- Apply AI/ML techniques to improve platform operations and reduce incidents.

- Troubleshoot distributed systems and optimize AWS infrastructure.

- Collaborate with data engineering, SRE, and platform teams.

- Follow engineering best practices and contribute to technical documentation.

Tech Stack:

- Programming: Python, Java, or Scala

- Data Engineering: Apache Spark, Kafka/NiFi, Apache Airflow

- Infrastructure: AWS, Linux/Unix scripting, Terraform/CloudFormation

- Monitoring/AI: Splunk, Prometheus, Grafana, AIOps, AI/ML automation

Requirements:

- 6+ years of experience in software engineering, data platforms, or distributed systems.

- Strong troubleshooting, performance tuning, and automation skills.