Sigmoid Analytics - Technical Lead - Data Engineering

Description :

We are hiring a highly skilled Data Engineer / Technical Lead to drive large-scale Big Data & Cloud initiatives for enterprise customers. The ideal candidate should have strong expertise in Data Engineering, DevOps automation, production support, and cloud technologies along with excellent stakeholder management skills.

Key Responsibilities :

- Lead and support large-scale production data pipelines and distributed systems

- Design scalable and fault-tolerant Big Data solutions

- Drive DevOps automation, CI/CD, monitoring, and deployment practices

- Perform root cause analysis and resolve production issues

- Collaborate with Data Engineers, Data Scientists, and Product teams

- Interact with client stakeholders to understand business requirements

- Mentor team members and drive engineering best practices

- Participate in technical hiring and capability building initiatives

Required Skills :

- Strong experience in Big Data technologies such as Spark, Hadoop, Kafka, Hive, HDFS, Databricks, and PySpark

- Hands-on experience with AWS or Azure cloud platforms

- Strong expertise in Python, PySpark, Java, or Shell scripting

- Experience with Linux systems and CI/CD tools such as Jenkins

- Knowledge of Docker and Kubernetes

- Experience in production support, monitoring, and automation

- Strong debugging and problem-solving skills

- Excellent communication and stakeholder management abilities

Preferred Qualifications :

- Experience handling TB-scale data pipelines

- Strong understanding of distributed systems architecture

- Exposure to DataOps and DevOps best practices

- Experience in client-facing roles and technical leadership