About the Role :

We are looking for a Data Engineer with 3 - 7 years of experience to design and build scalable, production-grade data solutions on GCP. The ideal candidate should have strong expertise in BigQuery, SQL, Dataform/dbt, Cloud Composer/Airflow, Dataflow/Apache Beam, and Spark, along with experience in modern data architecture, data quality, and cloud optimization.

Key Responsibilities :

- Design and implement scalable batch, incremental, and streaming data pipelines on GCP.

- Develop and optimize complex data transformations using BigQuery, SQL, and Dataform/dbt.

- Build reusable, metadata-driven, and configuration-driven data engineering frameworks.

- Design orchestration workflows using Cloud Composer/Apache Airflow, including dependencies, retries, scheduling, and recovery mechanisms.

- Develop distributed and streaming data processing solutions using Dataflow/Apache Beam and Dataproc/Spark.

- Define and implement standards for data modelling, schema design, schema evolution, and data contracts.

- Work with modern analytical storage technologies, including Apache Iceberg.

- Establish frameworks for data quality, reconciliation, metadata, lineage, and observability.

- Optimize large-scale data workloads for performance, scalability, latency, and GCP cost efficiency.

- Define and implement engineering standards for testing, version control, CI/CD, and production readiness.

- Conduct technical design and code reviews and provide guidance on complex implementation decisions.

- Identify technical debt and drive improvements to shared data platform capabilities.

- Collaborate with Data Engineering, Platform Engineering, DevOps, Architecture, Governance, and Product teams.

- Own solutions from technical design through production deployment and operational stability.

Required Skills :

- 3 - 7 years of experience in Data Engineering or related roles.

- Strong hands-on experience with GCP data services.

- Strong expertise in BigQuery and advanced SQL.

- Experience with Dataform or dbt.

- Hands-on experience with Cloud Composer/Apache Airflow.

- Experience with Dataflow/Apache Beam and/or Dataproc/Spark.

- Strong understanding of data modelling, schema evolution, data quality, and data pipelines.

- Experience with batch and streaming data processing.

- Understanding of CI/CD, testing, version control, monitoring, and production support.

- Exposure to Apache Iceberg and modern data lakehouse architectures is preferred.

- Strong problem-solving, technical design, and communication skills.