Job Description:

Value Momentum is looking for an experienced Senior Data Engineer / Senior Databricks Engineer to design and develop scalable data pipelines and ETL solutions using Azure Databricks, Azure Data Factory, ADLS, Synapse, SQL, Python, and PySpark. The ideal candidate should have strong hands-on experience in data ingestion, transformation, big-data processing, analytical pipelines, and Azure data engineering services.

Key Responsibilities:

- Design and develop scalable ETL/ELT pipelines using Azure Data Factory.

- Build data ingestion and transformation pipelines using Azure Databricks.

- Develop efficient data processing solutions using Python and PySpark.

- Write and optimize complex SQL queries for large-scale data processing.

- Work with ADLS, Azure Databricks, Azure Data Factory, Synapse, and Azure SQL DB.

- Build and maintain data lakes, analytical pipelines, and data processing frameworks.

- Work with Delta Lake / Delta Live Tables for reliable data processing.

- Develop solutions for both big data and relational database environments.

- Collaborate with technical and business teams to understand data requirements.

- Implement data quality, performance, and scalability best practices.

- Support DevOps and CI/CD deployments for data engineering solutions.

- Troubleshoot pipeline failures and optimize data processing performance.

Mandatory Skills:

- Azure Databricks

- Azure Data Factory (ADF)

- PySpark

- Python

- SQL

- Azure Data Lake Storage (ADLS)

- Delta Lake / Delta Live Tables

- Azure Synapse

- Azure SQL Database

Good to Have:

- Azure DevOps

- CI/CD

- Data warehousing concepts

- Big Data technologies

- Experience designing analytical data pipelines

- Strong understanding of data ingestion and transformation frameworks

Candidate Details:

Interested candidates can share their updated resume at anil.katta@valuemomentum.com along with:

- Total Years of Experience

- Relevant Data Engineering Experience

- Databricks Experience

- Azure Data Factory Experience

- PySpark Experience

- SQL Experience

- Delta Live Tables Experience

- Current CTC

- Expected CTC

- Notice Period

- Current Location

- Willingness to work from office 4 days/week

- Availability for final face-to-face interview

- Immediate to 30-day joiners will be highly preferred.