Netscribes - Senior Data Engineer - Azure Platform

Description :

We are looking for a highly skilled Senior Azure Data Engineer with 6+ years of experience in designing, building, and maintaining scalable data solutions on Microsoft Azure.

The ideal candidate will have strong expertise in Azure data services, data modeling, ETL/ELT pipelines, and performance optimization, along with experience working in agile, cross-functional teams.

Key Responsibilities :

- Design, develop, and maintain end-to-end data pipelines using Azure data services

- Build and optimize ETL/ELT workflows for structured and unstructured data

- Implement data ingestion solutions using Azure Data Factory (ADF)

- Develop and manage data solutions using Azure Synapse Analytics and/or Azure SQL Database

- Work with Azure Data Lake Storage (ADLS Gen2) for large-scale data storage

- Perform data transformations using Azure Databricks (PySpark / Spark SQL)

- Ensure data quality, data governance, and security best practices

- Optimize query performance, cost, and scalability of Azure data platforms

- Collaborate with data scientists, analysts, and business stakeholders

- Implement CI/CD pipelines and version control for data engineering solutions

- Monitor, troubleshoot, and resolve production data issues

- Mentor junior data engineers and review code/designs

Required Skills & Qualifications :

- 7+ years of overall experience in Data Engineering / Data Warehousing

- Strong hands-on experience with Microsoft Azure Data Services, including:

- Azure Data Factory (ADF)

- Azure Synapse Analytics

- Azure Data Lake Storage (ADLS Gen2)

- Azure SQL Database / SQL Server

- Proficiency in SQL (advanced querying, performance tuning)

- Strong experience with Python (especially PySpark)

- Experience with Azure Databricks and Spark-based processing

- Knowledge of data modeling, star/snowflake schemas

- Experience working with large-scale datasets and distributed systems

- Familiarity with CI/CD, Git, and DevOps practices

- Understanding of data security, RBAC, and compliance in Azure

Good to Have (Preferred Skills) :

- Experience with streaming data (Azure Event Hubs / Kafka / Stream Analytics)

- Knowledge of Power BI or other reporting tools

- Experience with Delta Lake, data versioning, and lakehouse architecture

- Exposure to multi-cloud or hybrid data environments

Soft Skills :

- Strong problem-solving and analytical skills

- Excellent communication and stakeholder management

- Ability to work independently and lead technical initiatives

- Mentoring and leadership experience