Sr GCP Data Engineer / Lead GCP DE

8+ Yrs along with Team Leading Exps is must.

Job Summary :

We are looking for an experienced Senior Data Engineer with deep expertise in the Google Cloud Platform ecosystem to design, build, and maintain scalable data processing systems. The ideal candidate should have strong hands-on experience with BigQuery, Dataflow, Airflow, and advanced SQL, alongside programming capabilities in Python or Java.

Key Responsibilities :

- Design and develop scalable GCP data pipelines using BigQuery, Dataflow, Dataform, Airflow, and Datastream.

- Build and optimize batch and real-time data processing and ingestion workflows.

- Develop data transformation and orchestration workflows using Dataform and Airflow/Cloud Composer.

- Write production-ready Python code and optimize BigQuery queries for performance and cost.

- Implement data quality, monitoring, and error handling across pipelines.

- Troubleshoot production issues and ensure data reliability and governance.

- Collaborate with cross-functional teams to deliver scalable data solutions.

Mandatory Skills :

- Strong hands-on experience with Google Cloud Platform (GCP).

- Strong expertise in BigQuery and Advanced SQL.

- Hands-on experience with Dataflow for batch and streaming data processing.

- Hands-on experience with Dataform for data transformation and modeling.

- Strong experience with Airflow / Cloud Composer for workflow orchestration.

- Experience with Datastream for real-time change data capture (CDC) and data replication.

- Strong coding skills in Python.