Job Description
Description :
We are looking for a highly skilled Azure Data Engineer with 810 years of experience in designing, building, and optimizing large-scale data solutions on Microsoft Azure. The ideal candidate will have deep expertise in data integration, data warehousing, big data processing, and cloud-native architectures, enabling data-driven decision-making across the organization.
Key Responsibilities :
Data Engineering & Architecture :
- Design, develop, and maintain end-to-end data pipelines using Azure services
- Build scalable, secure, and high-performance data architectures on Azure
- Implement batch and real-time data processing solutions
Azure Data Services :
- Develop solutions using Azure Data Factory (ADF) for data ingestion and orchestration
- Build and optimize data processing using Azure Databricks / Spark
- Work with Azure Synapse Analytics for data warehousing and analytics
- Manage data storage using Azure Data Lake Storage Gen2, Blob Storage
Data Modeling & Transformation :
- Design and implement data models (Star / Snowflake schemas)
- Develop complex transformations using PySpark, SQL
- Ensure data quality, validation, and governance standards
Performance & Optimization :
- Optimize pipelines for performance, scalability, and cost efficiency
- Tune Spark jobs, SQL queries, and Synapse workloads
- Monitor and troubleshoot pipeline failures and performance bottlenecks
Security & Governance :
- Implement data security, encryption, RBAC, and access controls
- Ensure compliance with enterprise data governance and audit requirements
- Work with Azure Purview / Microsoft Fabric (optional) for data cataloging
DevOps & Automation :
- Implement CI/CD pipelines using Azure DevOps or GitHub Actions
- Automate deployments and infrastructure using ARM / Bicep / Terraform
- Follow best practices for version control, monitoring, and logging
Collaboration & Leadership :
- Work closely with Data Architects, BI teams, Data Scientists, and business stakeholders
- Translate business requirements into scalable technical solutions
- Mentor junior data engineers and conduct code reviews
Required Technical Skills :
Core Azure Skills :
- Azure Data Factory (ADF)
- Azure Databricks (Spark)
- Azure Synapse Analytics (Dedicated & Serverless)
- Azure Data Lake Storage Gen2
- Azure SQL Database / SQL Server
Programming & Querying :
- Strong experience in SQL
- Hands-on coding in Python / PySpark
- Experience with REST APIs and data integrations
Big Data & Streaming (Good to Have) :
- Azure Event Hubs / Kafka
- Azure Stream Analytics
DevOps & Monitoring :
- Azure DevOps / GitHub
- CI/CD pipelines
- Azure Monitor, Log Analytics
Did you find something suspicious?
Similar jobs that you might be interested in
Posted by
Narayana Jalla
Talent Acquisition Head at sugandi consultancy services pvt ltd
Last Active: 5 Feb 2026
12
Posted in
Data Engineering
Functional Area
Data Engineering
Job Code
1609773
