GCP Data Engineer

Generic Skills (Must Have) :

- Python and advanced SQL.

- Data quality checks, reconciliation, alerting, retries, and backfills.

- Production pipeline monitoring and troubleshooting.

GCP Skills (Must Have) :

- Mandatory : BigQuery : datasets, tables, views, partitioning, clustering, SQL optimisation, cost awareness.

- Option 1 : Dataflow / Apache Beam or equivalent streaming/batch framework.

- Option 2 : Dataproc / PySpark or strong Spark experience.

- Pub/Sub or equivalent event streaming.

- Cloud Composer / Airflow DAG development.

Nice to have (Trainable) :

- Dataform, dbt, CI/CD for data.

- BigQuery ML.

- Dataflow templates.

- Looker / LookML basics.

- Terraform for data infrastructure.