Data Engineer - Google Cloud Platform

Description :

Key Responsibilities :

- Build and maintain robust data pipelines using GCP services such as BigQuery, Pub/Sub, Dataflow, and Cloud Storage

- Develop and optimize ETL/ELT workflows for analytics and AI-driven applications

- Collaborate with Data Scientists and AI Engineers to ensure data quality, governance, and availability

- Automate workflows and support CI/CD processes for data infrastructure

- Monitor, troubleshoot, and optimize data systems and pipeline performance

- Design scalable and efficient cloud-based data architectures

- Support real-time and batch data processing solutions

- Ensure data security, governance, and compliance standards

- Contribute to infrastructure automation and deployment best practices

Required Skills & Experience :

- Strong experience in cloud-based data engineering and real-time data processing

- Proficiency in SQL and Python

- Hands-on experience with Apache Beam or Spark

- Strong experience with GCP services including :

1. BigQuery

2. Pub/Sub

3. Dataflow

4. Cloud Storage

5. IAM

- Good understanding of ETL/ELT workflows and data modeling

- Knowledge of data governance and data quality best practices

- Experience with CI/CD pipelines and infrastructure automation tools

- Strong analytical and troubleshooting skills

Nice to Have :

- Experience with AI/ML or Agentic AI integrations

- Knowledge of Docker, Kubernetes, Airflow, or Cloud Composer

- Exposure to shipping, logistics, or financial market domains

- GCP Certifications

Qualifications :

- Degree in Computer Science, Engineering, IT, or related field

- Relevant GCP certifications are an added advantage

Preferred Candidate Profile :

- Strong problem-solving and communication skills

- Ability to work collaboratively in Agile environments

- Experience working on scalable enterprise data platforms

- Self-driven with strong ownership and delivery mindset