Job Title : Senior Data Engineer

Experience : 6+ Years

Location : Chennai, India

Work Mode : Hybrid (2-3 days/week onsite)

About the Role :

We are looking for a highly skilled Senior Data Engineer with a strong background in Python, Java, PySpark, and Google Cloud Platform (GCP) to join our growing data team in Chennai. The ideal candidate should have a deep understanding of distributed data processing, cloud-based data solutions, and the ability to write clean, scalable, and efficient code.

You will be responsible for building and maintaining robust data pipelines and platforms that power real-time and batch data solutions across various business domains.

Key Responsibilities :

- Design, build, and maintain scalable, reliable, and high-performance data pipelines using PySpark, Python, and Java.

- Develop and deploy data integration solutions on Google Cloud Platform (GCP) services such as BigQuery, Dataflow, Pub/Sub, Cloud Storage, and Composer.

- Optimize data pipelines for performance and cost-efficiency in cloud environments.

- Collaborate closely with data scientists, analysts, and other engineers to support data initiatives.

- Perform root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvement.

- Ensure data quality, consistency, and governance through the implementation of best practices and automated checks.

- Monitor and troubleshoot production data pipelines, ensuring data availability and integrity.

Mandatory Skills :

- Python - Strong proficiency in scripting and data engineering using Python.

- Java - Solid experience in building and maintaining high-performance backend/data applications.

- PySpark - Hands-on experience with distributed data processing using PySpark on large datasets.

- Google Cloud Platform (GCP) - Expertise with GCP services including but not limited to :

1. BigQuery

2. Dataflow

3. Cloud Storage

4. Pub/Sub

5. Composer (Airflow on GCP)

Required Qualifications :

- Bachelor's or Masters degree in Computer Science, Engineering, or a related field.

- 6+ years of proven experience in data engineering roles.

- Strong understanding of data structures, algorithms, and performance tuning.

- Excellent problem-solving and communication skills.

- Ability to work independently and in a hybrid team environment.