Data Engineer - GCP/BigQuery

Role : Data Engineer

Experience : 6+ Years

Work mode : Remote

Main Skills : GCP, Python, SQL, Spark, Pyspark, Apache Beam, GenAI/AgenticAI

Generic Skills (Must Have) :

- Python and advanced SQL.

- Data quality checks, reconciliation, alerting, retries, and backfills.

- Production pipeline monitoring and troubleshooting.

GCP Skills (Must Have) :

- BigQuery : datasets, tables, views, partitioning, clustering, SQL optimisation, cost awareness.

- Dataflow / Apache Beam or equivalent streaming / batch framework.

- Dataproc / PySpark or strong Spark experience.

- Pub/Sub or equivalent event streaming.

- Cloud Composer / Airflow DAG development.

Nice to have (Trainable) :

- Dataform, dbt, CI/CD for data.

- BigQuery ML.

- Dataflow templates.

- Looker / LookML basics.

- Terraform for data infrastructure.