Key Responsibilities:

- Design, develop, and maintain scalable data pipelines using Google Cloud Platform services.

- Build and optimize data solutions using BigQuery, Dataflow, DataProc, Dataform, and Pub/Sub.

- Develop ETL/ELT workflows using Python, SQL, and PySpark.

- Orchestrate and schedule data workflows using Apache Airflow.

- Implement CI/CD pipelines and maintain source code using Git.

- Optimize data processing performance, reliability, and scalability.

- Work closely with business stakeholders to understand requirements and deliver effective data solutions.

- Participate in architecture discussions and provide technical leadership to the engineering team.

- Follow Agile methodologies and SDLC best practices throughout the development lifecycle.

- Prepare daily status reports and communicate project updates with customers and stakeholders.

- Troubleshoot production issues and ensure timely resolution.

Required Skills :

- Strong experience with Google Cloud Platform (GCP).

- Expertise in BigQuery, Dataflow, DataProc, Dataform, and Pub/Sub.

- Strong proficiency in SQL and Python.

- Hands-on experience with PySpark.

- Experience with Apache Airflow for workflow orchestration.

- Knowledge of Cloud SQL and Dataplex.

- Experience with Git and CI/CD pipelines.

- Strong understanding of Software Development Life Cycle (SDLC).

- Familiarity with Agile development methodologies.

Preferred Skills :

- Experience designing enterprise-scale cloud data platforms.

- Exposure to data governance and cloud security best practices.

- Strong debugging, analytical, and problem-solving abilities.

- Experience mentoring junior engineers and leading technical discussions.

Qualifications :

- Bachelor's or Master's degree in Computer Science, Information Technology, Engineering, or a related field.

Experience :

- 8 - 12 years of experience in Data Engineering.

- Proven experience building scalable cloud-based data platforms using Google Cloud Platform.

- Strong expertise in Python, SQL, PySpark, Airflow, and GCP data services.

- Experience leading technical initiatives and collaborating with cross-functional teams in Agile environments.