Senior Data Engineer

Experience : 3-5 Years

Location : Gurgaon

Department : Data Engineering

Employment Type : Full-Time

About the Role :

We are seeking a highly skilled and motivated Senior Data Engineer to join our growing Data Engineering team. The ideal candidate will have hands-on experience building and managing large-scale data platforms on both AWS and Google Cloud Platform (GCP).

You will be responsible for designing, developing, and optimizing scalable data pipelines, data warehouses, and real-time processing systems that power analytics, business intelligence, and machine learning initiatives. This role requires strong technical expertise, ownership mindset, and the ability to work across multiple stakeholders.

Key Responsibilities :

Data Pipeline Development :

- Design, develop, and maintain scalable ETL/ELT pipelines across AWS and GCP environments.

- Build robust data ingestion frameworks for structured, semi-structured, and unstructured data sources.

- Develop and maintain batch and real-time data processing pipelines.

- Implement Change Data Capture (CDC) solutions for near real-time data synchronization.

Data Platform & Architecture :

- Design and maintain enterprise-scale Data Lakes and Data Warehouses.

- Build reliable and scalable data models to support reporting, analytics, and machine learning workloads.

- Ensure data quality, governance, security, and observability across the platform.

- Optimize storage, compute utilization, and overall cloud infrastructure costs.

Cloud & Infrastructure :

- Develop cloud-native solutions leveraging AWS and GCP services.

- Automate infrastructure provisioning and deployments using Infrastructure-as-Code practices.

- Implement monitoring, alerting, logging, and troubleshooting frameworks for production data systems.

- Support cloud migration and modernization initiatives.

Collaboration & Leadership :

- Work closely with Product, Engineering, Analytics, and Business teams to understand data requirements.

- Participate in architectural discussions and technical decision-making.

- Mentor junior engineers and establish engineering best practices.

- Drive improvements in scalability, reliability, and operational excellence.

Required Qualifications Experience :

- 3-5 years of hands-on experience in Data Engineering.

- Experience building and maintaining production-grade data platforms.

- Experience working with large-scale datasets and distributed processing systems.

Cloud Expertise :

AWS :

- Amazon S3

- Amazon Redshift

- AWS Glue

- AWS Lambda

- Amazon Kinesis

- Amazon Athena

- CloudWatch

GCP :

- BigQuery

- Dataflow

- Dataproc

- Pub/Sub

- Cloud Storage

- Cloud Composer (Airflow)

- Cloud Monitoring

Technical Skills :

Programming Languages :

- Strong proficiency in Python

- Advanced SQL skills

Good to Have :

- Java

Data Engineering & Big Data :

- ETL/ELT Design and Development

- Apache Spark

- Apache Kafka

- Apache Airflow

- Data Warehousing Concepts

- Data Modeling

- CDC Technologies (Debezium, AWS DMS, etc.)

Databases :

- MySQL

- DynamoDB

- MongoDB

- Amazon Redshift

- Google BigQuery

DevOps & Infrastructure :

- Docker

- Kubernetes

- Terraform

- CI/CD Pipelines

- Git

Preferred Qualifications :

- Experience migrating data platforms between AWS and GCP.

- Experience with Redshift to BigQuery migration projects.

- Experience building event-driven and streaming architectures.

- Knowledge of modern Lakehouse architectures.

- Exposure to Machine Learning data pipelines and feature engineering workflows.

- Experience in high-scale internet, e-commerce, fintech, or ed-tech organizations.

What We Are Looking For :

- Strong analytical and problem-solving abilities.

- Excellent communication and stakeholder management skills.

- Ability to take end-to-end ownership of projects.

- Passion for building scalable, reliable, and cost-efficient data systems.

- Strong focus on quality, performance, and operational excellence.

- Continuous learning mindset and eagerness to work with modern cloud technologies.