Position: Azure Databricks Developer (Pyspark, Databricks)

Overall/Total Experience: 8-15 years only

Location: Bengaluru/Chennai/Hyderabad/Gurugram/Mumbai/Kolkata/Noida/Pune

Working Days: 5 Days from Office

Notice Period Requirement: Immediate Joiners Only

Client's Company Size: Startup / Small Enterprise

Interview Process: Technical interview (Round 2) will be a face-to-face interview at the end client's office

Roles & Responsibilities:

- Design, develop, and deliver scalable end-to-end data pipelines using Azure Data Factory, ensuring robust integration of enterprise-wide data from diverse sources.

- Build and optimize data engineering workflows using Databricks and PySpark.

- Write efficient, high-performance SQL for data transformation and analysis.

- Work with the Azure Cloud platform and associated services, applying strong understanding of data warehousing, data models, and pipelines.

- Provide technical leadership to a team of developers, including code reviews and enforcing best practices across the development lifecycle.

- Oversee CI/CD implementation using Azure DevOps, managing deployments across development, QA, and production environments with proper change control processes.

- Collaborate with cross-functional teams to translate business requirements into scalable data solutions.

- Ensure data quality, reliability, and performance across all pipelines and platforms.

Candidate Requirements:

- Must have minimum 8+ years of overall experience in Data Engineering, Data Development, or related data technology roles, with strong hands-on experience in enterprise data pipeline development.

- Must have strong hands-on experience with Azure Databricks, including development and optimization of scalable data engineering workflows using Databricks and PySpark.

- Must have strong hands-on proficiency in PySpark/Python and SQL, with proven experience developing complex data transformations, processing workflows, and performance-optimized queries.

- Must have hands-on experience with Azure Data Factory (ADF) for designing, developing, and orchestrating end-to-end data pipelines and integrating data from multiple sources.

- Must have strong experience working on the Azure Cloud platform and associated data services, with solid understanding of data warehousing, data modeling, pipeline architecture, and enterprise data solutions.

- Must have hands-on experience implementing CI/CD using Azure DevOps, including deployment and release management across development, QA, and production environments.