- Design, build, and manage end-to-end data pipelines using GCP services including Dataflow, BigQuery, Pub/Sub, Dataproc, and Composer.

- Handle real-time and batch data processing using Apache Beam and Airflow.

- Develop and maintain data warehouse solutions on BigQuery with optimized storage and access.

- Provision GCP infrastructure using Infrastructure as Code (IaC) practices with Terraform.

- Collaborate with cross-functional teams to ensure data quality, scalability, and security.

- Monitor, debug, and resolve issues in data workflows.

- Document all data processes, workflows, and infrastructure for internal use.

Requirements :

- Strong experience in data engineering with proven expertise in GCP.

- Hands-on experience with Apache Beam, Dataflow, and BigQuery.

- Proficiency in Python, SQL, and PySpark.

- Experience working with Cloud Composer (Airflow) for orchestration.

- Solid understanding of data warehousing, ETL pipelines, and real-time data streaming.