Job Details :

Employment Type : Permanent Payroll of the hiring organization

Client : A Leading IT Services Company

Experience Required : 5 - 16 Years

Location : PAN India (Hybrid)

Notice Period : 0-30 days

Key Responsibilities :

- Design, develop and optimize ETL/ELT pipelines using Databricks PySpark to ingest, transform and serve data for digital customer experience use cases

- Build and maintain high-quality performant SQL transformations and dimensional curated data layers for analytics and downstream consumption

- Implement best practices for Databricks engineering notebooks vs repos, modular code, cluster/job configuration, performance tuning and cost awareness

- Use Python for data processing utilities, validations, orchestration helpers and reusable libraries

- Manage source control using Git with enterprise workflows across GitHub, Bitbucket; enforce PR reviews, branching strategies and coding standards

- Build and maintain CI/CD pipelines using Azure DevOps automating testing, packaging and deployment of data code/artifacts across environments

- Ensure data quality and reliability through validations, reconciliation checks, monitoring and operational runbooks

- Collaborate with product/app teams, analysts and platform teams to translate requirements into scalable data products aligned to customer experience journeys

- For Senior Developer: lead module-level design, mentor engineers, drive standards for CI/CD and code quality, and own delivery for critical pipelines

Primary Skills (Must-Have) :

- Strong hands-on experience with :

1. Python

2. PySpark

3. Databricks jobs, workflows, clusters, repos

4. SQL advanced querying, optimization

- Strong experience with Git and repository platforms GitHub and/or Bitbucket

- Hands-on experience implementing CI/CD for data engineering workloads

- Strong working experience with Azure DevOps Boards, Repos, Pipelines, build/release workflows