Job Summary :

We are seeking an experienced AI/ML Developer with strong expertise in Azure Databricks, Python, PySpark, and SQL to design, develop, and deploy scalable machine learning and data engineering solutions. The ideal candidate will work closely with data scientists, architects, and business stakeholders to deliver high-impact AI/ML solutions on the Azure cloud platform.

Key Responsibilities :

- Design, develop, and maintain end-to-end AI/ML solutions using Azure Databricks

- Build and optimize data pipelines using PySpark and Spark SQL

- Develop, train, evaluate, and deploy machine learning models in production environments

- Perform data preprocessing, feature engineering, and model tuning

- Implement scalable batch and streaming data solutions

- Optimize Spark jobs for performance, cost, and reliability

- Collaborate with data scientists to productionize ML models

- Ensure best practices in code quality, testing, version control, and CI/CD

- Work with large, complex datasets across structured and semi-structured sources

- Monitor model performance and data drift in production

- Document technical designs, workflows, and solutions

Required Skills & Qualifications :

- 5+ years of hands-on experience in AI/ML or data engineering roles

- Strong proficiency in Python for data processing and ML development

- Extensive experience with Azure Databricks

- Solid expertise in PySpark and Spark SQL

- Strong knowledge of SQL for complex data analysis and transformations

- Experience building and deploying machine learning models (regression, classification, clustering, etc.)

- Familiarity with ML libraries such as Scikit-learn, MLflow, TensorFlow, or PyTorch

- Experience with Azure services such as :

1. Azure Data Lake Storage (ADLS)

2. Azure Synapse Analytics

3. Azure Machine Learning (preferred)

- Understanding of ETL/ELT concepts, data warehousing, and big data architectures

- Experience with Git and collaborative development workflows

- Strong problem-solving and analytical skills

- Excellent communication and stakeholder collaboration skills

Preferred / Nice-to-Have Skills :

- Experience with real-time/streaming data (Kafka, Event Hubs, Structured Streaming)

- Knowledge of MLOps practices, CI/CD pipelines, and model lifecycle management

- Exposure to Delta Lake and data versioning

- Experience with containerization (Docker) and orchestration tools

- Understanding of data governance, security, and compliance in Azure

- Domain experience in finance, healthcare, retail, or telecom (optional)