About the Role :

We are seeking a highly skilled Senior Data Engineer with strong hands-on experience in Google Cloud Platform (GCP), cloud infrastructure, data ingestion, and Python. The ideal candidate will have a proven track record of designing and implementing scalable data platforms, organizing GCP environments to meet data sovereignty requirements, and building secure and reliable data ingestion and transfer solutions.

Key Responsibilities :

GCP Architecture & Infrastructure :

- Design, develop, and maintain scalable GCP infrastructure for enterprise data workloads.

- Architect and organize GCP environments to support data sovereignty and data residency requirements.

- Design appropriate GCP projects, environments, networking, storage, IAM, and security configurations for data platforms.

- Establish scalable and reliable cloud infrastructure patterns for data processing and storage.

Data Ingestion & Pipeline Engineering:

- Design and implement robust data ingestion pipelines for structured and unstructured data sources.

- Build production-grade ingestion frameworks to reliably process and move data into GCP or similar storage.

- Develop scalable and fault-tolerant data pipelines with appropriate validation, monitoring, and error handling.

- Optimize data ingestion workflows for performance, reliability, and cost.

- Ensure data pipelines maintain data quality, integrity, and traceability throughout the ingestion process.

Python Development & Automation :

- Develop production-grade data engineering applications and automation using Python.

- Build reusable libraries, services, and utilities to support data ingestion and processing workflows.

- Automate infrastructure and data engineering processes to improve operational efficiency.

- Implement appropriate logging, monitoring, error handling, and testing for Python-based services and pipelines.

Collaboration & Ownership :

- Work closely with Data Engineers, Software Engineers, Cloud/Infrastructure Engineers, Security teams, and business stakeholders.

- Take ownership of technical initiatives from architecture and design through production deployment and ongoing support.

Requirements :

- 5+ years of experience in Data Engineering, Cloud Engineering, or a related field.

- Strong hands-on experience with Google Cloud Platform (GCP).

- Proven experience designing and implementing GCP architecture and infrastructure for data workloads.

- Good understanding of GCP services such as Google Cloud Storage (GCS), BigQuery, Pub/Sub, Dataflow, Cloud Run/GKE, VPC, IAM, and Cloud Monitoring.

- Experience with cloud networking, security, authentication, authorization, and access control.

- Experience with infrastructure automation and Infrastructure as Code (IaC), preferably Terraform.

- Strong understanding of data quality, monitoring, observability, and production operational best practices.

- Experience organizing GCP environments to meet data sovereignty and data residency requirements.

- Strong experience building data ingestion pipelines and data processing workflows.

- Hands-on experience designing and implementing secure data transfer and proxy solutions.

- Strong proficiency in Python and experience building production-grade applications and data pipelines.

- Excellent communication skills and ability to work independently with minimal supervision.

Location : Ahmedabad or Pune