Infinite Computer Solutions - Senior Data Engineer - Google Cloud Platform

Job Description :

We are looking for an experienced Senior GCP Data Engineer to design, develop, and optimize scalable data engineering solutions on Google Cloud Platform.

The ideal candidate should have strong hands-on experience in building data pipelines, processing large datasets, and implementing efficient data integration solutions using GCP services.

Key Responsibilities :

- Design, develop, and maintain scalable data pipelines using GCP services.

- Build and optimize data processing workflows using BigQuery, Dataflow, and Dataproc.

- Develop data ingestion and streaming solutions using Google Cloud Pub/Sub.

- Write optimized SQL queries for data transformation, analysis, and reporting.

- Develop Python-based scripts and applications for data processing and automation.

- Implement ETL/ELT pipelines for batch and real-time data processing.

- Optimize BigQuery performance, query execution, and data storage costs.

- Ensure data quality, consistency, security, and reliability across data pipelines.

- Troubleshoot pipeline failures and improve overall system performance.

- Collaborate with architects, analysts, and business stakeholders to deliver data solutions.

Required Skills :

- 6-7 years of experience in data engineering or a related technical role.

- Strong hands-on experience with Google Cloud Platform (GCP).

- Proficiency in BigQuery, Dataflow, and/or Dataproc.

- Strong programming skills in Python.

- Excellent SQL skills, including complex queries and data transformations.

- Experience with Pub/Sub and event-driven or streaming data pipelines.

- Good understanding of data warehousing, ETL/ELT, and data modeling concepts.

- Knowledge of data pipeline monitoring, performance tuning, and troubleshooting