Data Engineering Lead - Google Cloud Platform

Description :

Job Title : GCP Data Engineer Lead

Experience : 7-15 Years

Location : Pune

Job Type : Contract with Client

Job Description :

We are looking for an experienced GCP Data Engineer Lead to architect, design, and deliver scalable cloud-based data engineering solutions on Google Cloud Platform (GCP).

The ideal candidate will have deep expertise in building data pipelines, designing data architectures, and implementing robust ETL workflows.

This role requires hands-on technical proficiency, strong leadership capabilities, and the ability to mentor junior engineers while collaborating with cross-functional teams.

Roles & Responsibilities :

Data Engineering & Architecture :

- Design, develop, and maintain scalable, reliable, and high-performance data pipelines using GCP services such as :

1. Dataflow

2. Pub/Sub

3. Cloud Functions

4. Cloud Storage

4. Cloud Composer

- Build, optimize, and maintain ETL/ELT processes for ingesting large datasets into BigQuery and other GCP-based data stores.

- Design and implement enterprise data architectures, ensuring scalability, resilience, and performance.

- Develop and enforce data governance, quality rules, and logging frameworks.

Cloud Platform Expertise :

- Utilize deep experience with Google Cloud Platform (GCP) to create secure and cost-efficient data solutions.

- Optimize BigQuery data models, partitioning, clustering, and query performance.

- Lead migrations of on-premise data pipelines to GCP cloud-native solutions.

Programming & Data Modeling :

- Write efficient, high-quality code in Python, Java, or relevant programming languages.

- Design robust data models, data warehouses, and data lakes.

- Work with large-scale data processing frameworks and orchestration tools.

- Collaborate with analytics teams and enable business insights through curated datasets.

Collaboration & Leadership :

- Collaborate closely with cross-functional teams including product, analytics, DevOps, and application engineering.

- Provide technical guidance, mentoring, and oversight to junior data engineers.

- Lead design discussions, architecture reviews, and code reviews.

- Communicate technical solutions effectively to both technical and non-technical stakeholders.

Required Technical Skills :

- 5+ years of hands-on experience in data engineering.

- Expertise in GCP data services, including :

1. BigQuery

2. Dataflow

3. Pub/Sub

4. Cloud Storage

5. Cloud Composer

- Strong proficiency in SQL, including query optimization and database design.

- Solid programming experience in Python, Java, or similar languages.

- Strong understanding of ETL/ELT processes, frameworks, and cloud data transformations.

- Knowledge of data modeling, warehousing, and big data processing.

- Experience with data visualization tools (e.g., Looker, Data Studio) is a plus.

- Familiarity with machine learning pipelines is an added advantage.

Soft Skills :

- Strong analytical thinking and problem-solving abilities.

- Excellent verbal and written communication skills.

- Ability to work in a fast-paced environment and manage multiple priorities.

- Demonstrated leadership skills and experience mentoring and guiding teams.

Additional Information :

Notice Period : Immediate to 15 Days (Preferred)

Job Category : GCP Data Engineer Lead

Work Location : Pune (Hybrid/As per client requirement)