Lead Data Engineer - Google Cloud Platform

About the Role :

We are looking for a Lead GCP Data Engineer with strong expertise in Google Cloud Platform, PySpark, and SQL to design, build, and manage scalable, efficient data pipelines and architectures. The ideal candidate will have hands-on experience in GCP cloud data engineering and solutioning for complex enterprise data problems.

Key Responsibilities :

- Design, develop, and maintain end-to-end data pipelines using GCP technologies.

- Lead and mentor a team of data engineers to deliver high-quality data solutions.

- Develop scalable ETL/ELT frameworks on GCP leveraging services like BigQuery, Dataflow, Dataproc, Cloud Storage, and Pub/Sub.

- Collaborate with data scientists, analysts, and business stakeholders to understand data requirements and deliver robust data infrastructure.

- Implement data governance policies to ensure data quality, security, and compliance.

- Optimize workflows and performance of data systems to support large-scale data processing.

- Troubleshoot and resolve data-related issues and bottlenecks.

- Participate in solutioning and technical architecture discussions to align data strategies with business goals.

Skills & Requirements :

- 7 to 10 years of experience in data engineering with a focus on GCP cloud platforms.

- Proficiency in PySpark and SQL for data manipulation and pipeline development.

- Strong experience with data warehousing concepts, data lakes, and big data technologies.

- Experience in designing and implementing scalable data solutions.

- Ability to lead technical teams and deliver projects on time.

- Familiarity with infrastructure as code (Terraform or Google Deployment Manager) is a plus.

- Strong problem-solving skills and solutioning mindset.

Interview Process :

- 3 Virtual Technical Rounds

- 1 HR Discussion + Background Verification (within 5 days)

Additional Information :

- Candidates must be able to join immediately or within 10 days.

- Former Capco employees within 1 year of exit are eligible to rejoin with the same salary as at exit.