Senior Data Engineer - ETL/Apache Spark

Role : Data Engineer

Experience : 7-10 Years

Location : Bangalore

Mode : Hybrid

Job Description :

- Design, develop, and maintain scalable and reliable ETL pipelines using Apache Spark and Databricks.

- Write high-performance, production-grade code in Scala for data processing and transformation.

- Set up and manage observability, monitoring, and alerting for big data systems to ensure system health and data integrity.

- Develop and maintain CI/CD pipelines for data applications and infrastructure using tools like GitHub Actions, or Azure DevOps.

Must Have Skills :

- 7+ years of experience in Data Engineering and DevOps roles.

- Strong expertise in Apache Spark and Databricks.

- Proficient in Scala with a solid understanding of functional programming principles.

- Experience with CI/CD tools and practices.

Good To Have Skills :

- Experience with data Lakehouse architectures.

- Knowledge of data governance and security best practices.

- Exposure to GenAI is a plus.