Senior Data Engineer - Google Cloud Platform

Description :

We are seeking a highly skilled Senior Data Engineer with strong expertise in Google Cloud Platform (GCP), specifically BigQuery and Dataform, to design, develop, and optimize scalable data solutions. The ideal candidate should have hands-on experience in building end-to-end ETL/ELT pipelines, implementing dimensional data models, and enabling efficient analytics and reporting across enterprise data platforms.

The role requires strong knowledge of modern data architecture, transformation frameworks, workflow orchestration, and cloud-based data warehouse solutions.

Key Responsibilities :

- Design, build, and maintain end-to-end ETL/ELT data pipelines for ingesting, transforming, and loading large-scale structured and semi-structured datasets.

- Develop scalable and efficient data workflows for batch and near real-time data processing.

- Implement robust data validation, monitoring, and error-handling mechanisms.

- Build and optimize data transformation workflows using Dataform.

- Develop and maintain SQL-based transformation models in BigQuery.

- Optimize BigQuery queries, partitioning, clustering, and storage design for cost and performance efficiency.

- Manage datasets, tables, views, stored procedures, and scheduled queries.

- Design and implement dimensional data models including :

1. Star Schema

2. Snowflake Schema

- Implement Slowly Changing Dimensions (SCD Type 1 & Type 2) in data warehouse environments.

- Build reusable semantic layers for reporting and analytics.

- Develop and manage workflow orchestration pipelines using tools such as :

1. Cloud Composer / Apache Airflow

2. Cloud Scheduler

- Automate data ingestion, transformation, deployment, and monitoring processes.

- Participate in data migration projects from legacy/on-prem or other cloud platforms to GCP.

- Support migration of existing ETL frameworks into modern ELT architecture.

- Contribute to implementation of data mesh architecture concepts including domain-based data ownership and decentralized pipelines.

- Work closely with business analysts, data scientists, BI teams, and product stakeholders to understand data requirements.

- Translate business requirements into scalable technical solutions.

- Collaborate with DevOps and cloud engineering teams for CI/CD and infrastructure setup.

- Monitor pipeline performance and troubleshoot data quality/performance issues.

- Implement data governance, metadata management, and security best practices.

- Ensure compliance with data standards and best practices.

Required Skills & Qualifications :

- 5+ years of experience in Data Engineering / Data Warehousing.

- Strong hands-on experience with :

1. Google BigQuery

2. Dataform

3. SQL (Advanced)

- Experience in ETL/ELT pipeline design and implementation.

- Strong knowledge of dimensional modeling and data warehouse concepts.

- Hands-on experience implementing SCD Type 1 & Type 2.

- Experience with workflow orchestration tools (Airflow/Composer preferred).