GCP Data Engineer

About the Role :

We are looking for a skilled GCP Data Engineer with strong expertise in Google Cloud Platform, data warehousing, and large-scale data processing. The ideal candidate should have hands-on experience building end-to-end data pipelines on GCP, along with solid knowledge of Teradata for data warehousing, migration, and SQL optimization.

This role requires strong technical expertise in cloud-based data engineering, ETL/ELT pipelines, big data processing, and analytics solutions.

Key Responsibilities :

- Design, develop, and maintain scalable ETL/ELT pipelines for ingesting, transforming, and loading large datasets.

- Build end-to-end data workflows supporting analytics, reporting, and business intelligence use cases.

- Develop batch and distributed data processing pipelines using PySpark.

- GCP Data Platform Development

- Work extensively with Google Cloud Platform (GCP) services including :

1. BigQuery

2. DataProc

3. Cloud Storage

4. Cloud Composer / Airflow

5. Pub/Sub (preferred)

- Optimize BigQuery datasets, queries, partitioning, and clustering for performance and cost efficiency.

- Develop scalable cloud-native data solutions.

- Work on Teradata data warehousing solutions including :

1. SQL query optimization

2. Data modeling

3. Performance tuning

4. Data migration

- Support migration of data pipelines and workloads between Teradata and GCP/cloud platforms.

- Programming & Data Transformation :

1. SQL

2. Python

3. PySpark

- Build transformation logic for large-scale structured and semi-structured datasets.

- Perform data cleansing, enrichment, and validation.

- Support downstream reporting and analytics use cases.

- Collaborate with BI teams and reporting developers.

- Exposure to SSRS is a plus.

- Project Delivery & Collaboration

- Participate in full lifecycle data engineering projects including :

1. Work closely with cross-functional teams including analysts, architects, business teams, and cloud engineers.

2. Monitor pipeline performance and troubleshoot production issues.

- Implement data quality checks and logging/monitoring mechanisms.

- Ensure best practices for scalability, reliability, and governance.

Required Skills & Qualifications :

- Minimum 5+ years of Data Engineering experience.

- Strong hands-on experience with :

1. GCP (BigQuery, DataProc)

2. Teradata (minimum 3 years mandatory)

3. SQL

4. Python

5. PySpark

- Experience in building full-lifecycle data engineering solutions on GCP.