GCP Data Engineer

Location : Chennai, India

Experience : 5-10 Years

Employment Type : Full-time

Job Overview :

We are seeking an experienced GCP Data Engineer to design, build, and maintain scalable data pipelines and solutions on Google Cloud Platform. You will be instrumental in leveraging GCP's robust data services to support our analytics and machine learning initiatives. If you have a strong background in data engineering, extensive hands-on experience with GCP data tools, and a passion for building efficient data ecosystems, we encourage you to apply.

Key Responsibilities :

- Design, develop, and maintain robust and scalable data pipelines on Google Cloud Platform (GCP).

- Utilize a wide range of GCP data services, including BigQuery, Dataflow (Apache Beam), Dataproc (Spark/Hadoop), Pub/Sub, Cloud Storage, and Composer (Airflow).

- Implement data ingestion, transformation, and loading (ETL/ELT) processes from various data sources into GCP.

- Optimize data solutions for performance, cost-efficiency, and scalability.

- Collaborate with data scientists, analysts, and other engineering teams to understand data requirements and deliver effective solutions.

- Ensure data quality, integrity, and security across all data pipelines and storage solutions.

- Troubleshoot and resolve complex data-related issues within the GCP environment.

- Implement data governance and compliance best practices.

- Participate in code reviews and contribute to the continuous improvement of data engineering standards and processes.

Requirements :

- 5-10 years of experience as a Data Engineer.

- Strong hands-on experience with Google Cloud Platform (GCP) data services.

- Proven experience with BigQuery, Dataflow (Apache Beam), and Cloud Storage.

- Experience with Python or Java for data engineering.

- Solid understanding of data warehousing concepts, ETL/ELT processes, and data modeling.

- Proficiency in SQL for data manipulation and querying.

- Experience with version control systems, preferably Git.

- Strong problem-solving and analytical skills.

- Excellent communication and collaboration abilities.

Preferred Qualifications :

- Experience with Dataproc (Spark/Hadoop) and Composer (Airflow).

- Familiarity with Pub/Sub or other messaging queues.

- Knowledge of other GCP services (e.g., Cloud Functions, Cloud Run, GKE).

- Experience with real-time data processing.

- GCP Data Engineer certification.