Reveille Technologies - Data Engineer - Google Cloud Platform

Description :

We are looking for an experienced Data Engineer (GCP) with strong hands-on expertise in Google Cloud Platform, large-scale data processing, and building robust ETL/ELT pipelines.

The ideal candidate should be highly skilled in Python, BigQuery, SQL, and Airflow, with a strong understanding of data warehousing and cloud-native analytics solutions.

Key Responsibilities :

- Design, build, and optimize scalable data pipelines on GCP using Python, BigQuery, and Airflow.

- Develop and maintain ETL/ELT workflows for batch and real-time data ingestion.

- Build data models, transformations, and structured datasets to support analytics, reporting, and ML use cases.

Work extensively with Google Cloud Platform services, including :

- BigQuery

- Cloud Composer (Airflow)

- Dataflow (preferred)

- Pub/Sub

- Cloud Storage

- Ensure best practices in cloud architecture, data security, and cost-optimized infrastructure.

- Handle large-scale datasets and ensure high performance, reliability, and data quality across systems.

- Optimize SQL queries, BigQuery scripts, and pipeline performance.

- Implement monitoring, logging, and alerts for data workflows.

- Work closely with data scientists, analysts, product teams, and other engineering groups to understand data needs.

- Participate in design discussions, code reviews, and contribute to overall data engineering best practices.

- Ensure timely delivery of projects with high accuracy and efficiency.

Required Skills & Experience :

- 59 years of experience as a Data Engineer with strong GCP expertise (mandatory).

- Python

- BigQuery

- Airflow

- Advanced SQL

- Hands-on experience with ETL/ELT pipeline development and data warehousing concepts.

- Experience working with large datasets and performance optimization techniques.

- Dataflow (Python/Java)

- Pub/Sub

- Cloud Storage

- Strong problem-solving, debugging, and analytical skills.

- Excellent communication and collaboration abilities.