Location : Chennai - Hybrid

Experience : 4+ Years (Min. 2 years hands-on with GCP Data Platforms)

Job Summary :

We are seeking a high-caliber GCP Data Engineer to design, build, and deploy scalable cloud-based data platforms. This role is focused on architecting sophisticated data pipelines that power our AI and analytics initiatives. You will be responsible for the end-to-end lifecycle of data, from ingestion via microservices to high-performance warehousing in BigQuery.

The ideal candidate is a Python expert who understands the financial and technical nuances of cloud computing-specifically how to optimize compute resources and cost within the Google Cloud ecosystem.

Key Responsibilities :

- Pipeline Architecture : Design and deploy complex, automated data pipelines using GCP Services (BigQuery, Dataflow, DataProc) and orchestrate them using Apache Airflow.

- Infrastructure & Automation : Build and maintain repeatable environments using Infrastructure as Code (Terraform) and CI/CD frameworks (Tekton).

- Cloud Optimization : Actively monitor and optimize cost and compute resources for high-intensity processes (Cloud Run, Dataflow, BigQuery) to ensure platform efficiency.

- Data Governance & Security : Implement robust data encryption, masking techniques, and governance frameworks to ensure secure and compliant data flows in a cloud environment.

- Microservices Integration : Collaborate on Service-Oriented Architecture (SOA) and microservices to ensure seamless data flow between application layers and the data platform.

- Database Management : Manage diverse data storage solutions, including Relational (PostgreSQL/MySQL), NoSQL, and Columnar (BigQuery) databases.

Skills & Qualifications :

Required Technical Skills :

- Primary Languages : Advanced Python, SQL, and Java.

- GCP Core : Deep expertise in BigQuery, Dataflow, DataProc, and Cloud Run.

- Orchestration : Hands-on experience with Apache Airflow.

- DevOps/IaC : Proficiency in Terraform, Tekton, and CI/CD pipelines.

Professional Experience :

- Tenure : 4+ years in Data or Software Engineering.

- Cloud Focus : At least 2 years specifically building and deploying cloud-native data platforms (GCP preferred).

- Problem Solving : Proven ability to troubleshoot complex microservices and data platform issues.