Description :

- Job Title : Senior Data Engineer

- Experience : 4+ Years

- Location : Bengaluru

- Work Mode : Hybrid (4 Days WFO + 1 Day Remote)

- Notice Period : Immediate Joiners Only

Job Description :

We are looking for a highly skilled Senior Data Engineer with strong experience in building and optimizing large-scale data processing systems. The ideal candidate should have hands-on expertise in cloud platforms, Spark ecosystem, and modern data engineering tools.

Key Responsibilities :

- Design, develop, and optimize scalable data pipelines and ETL/ELT workflows

- Work extensively with Spark architecture, internals, and performance tuning

- Build and maintain data solutions using Databricks

- Develop data processing applications using Python, SQL, and PySpark (or Scala)

- Orchestrate workflows using Apache Airflow

- Integrate and process real-time/streaming data using Kafka, NiFi, or Amazon Kinesis

- Work with modern Data Warehousing technologies such as Snowflake, Hive, Presto, and SQL databases

- Collaborate with cross-functional teams on solution design and technical architecture

- Implement software engineering best practices including CI/CD pipelines and API development

Required Skills :

- Strong experience with Cloud platforms (AWS / Azure preferred)

- Deep knowledge of Apache Spark (internals & optimization)

- Hands-on experience with Databricks

- Proficiency in Python, SQL, PySpark / Spark with Scala

- Experience with Airflow for workflow scheduling

- Knowledge of messaging/streaming frameworks: Kafka, NiFi, Kinesis

- Experience with Data Warehousing tools: Snowflake, Hive, Presto, SQL DBs

- Solid understanding of data architecture, solution design, and problem-solving skills

- Exposure to CI/CD pipelines, API development, and software engineering practices