Senior Data Engineer

Experience : At least 7 Years

Location : Hybrid / Onsite Bangalore (Client Office)

Shift Timing : 1:30 PM to 11:00 PM

Role Summary :

We are seeking a highly skilled Senior Data Engineer with 7 years of experience in designing, developing, and maintaining scalable data platforms and analytics solutions.

The ideal candidate will have strong expertise in Data Engineering, ETL/ELT development, Apache Spark, Databricks, SQL, Python, Data Warehousing, Data Modeling, Streaming Data, and Azure Data Services.

The role requires building reliable, high-performance data pipelines that enable business intelligence, advanced analytics, and AI/ML initiatives.

Key Responsibilities :

- Design, develop, and optimize ETL/ELT data pipelines for large-scale data processing.

- Build and maintain data solutions using Apache Spark, Databricks, SQL, and Python.

- Develop robust batch and real-time data ingestion frameworks.

- Design and implement enterprise data warehouses, data marts, and lakehouse architectures.

- Create and maintain logical and physical data models to support business requirements.

- Ensure data quality, governance, security, and compliance across data platforms.

- Develop streaming data solutions using event-driven architectures and real-time processing frameworks.

- Utilize Azure Data Factory, Azure Synapse Analytics, and related Azure data services for orchestration and transformation.

- Collaborate with data scientists, analysts, and business stakeholders to deliver data-driven solutions.

- Monitor, troubleshoot, and optimize data platform performance and reliability.

Required Skills :

- Data Engineering / Data Architecture

- ETL/ELT Pipeline Development

- Apache Spark / Databricks

- SQL / Python

- Data Warehousing / Data Modeling

- Data Quality / Governance

- Streaming Data Processing

- Azure Data Factory (ADF)

- Azure Synapse Analytics

- Azure Data Lake Storage (ADLS)

- Performance Tuning / Optimization

Preferred Qualifications :

- Bachelor's or Master's degree in Computer Science, Engineering, Data Science, or related field.

- Experience with CI/CD, DevOps, and cloud-based data platforms.

- Azure Data Engineer Associate certification preferred.

- Strong analytical, problem-solving, and stakeholder management skills.