Netscribes - Azure Data Engineer

Description :

Job Summary :

We are seeking a skilled Azure Data Engineer with 3 - 4 years of experience in building scalable data solutions on Microsoft Azure. The ideal candidate should have strong experience in data pipeline development, API integrations, cloud-based ETL/ELT processes, and data modeling. You will work closely with data architects, analysts, and application teams to design and implement robust data integration solutions.

Key Responsibilities :

- Design, develop, and maintain data pipelines using Azure Data Factory

- Build and manage data storage solutions using Azure Data Lake Storage and Azure SQL Database

- Develop and optimize data transformations using Azure Databricks

- Implement real-time and batch processing solutions

- Develop serverless workflows using Azure Functions

- Work with event-driven architectures using Azure Event Hub

- Monitor and optimize data workflows for performance and cost efficiency

- Implement CI/CD pipelines using Azure DevOps

- Ensure data quality, governance, and security compliance

- Collaborate with stakeholders to gather data requirements and translate them into technical solutions

Required Skills & Qualifications :

- 3 - 4 years of experience in Data Engineering

- Strong hands-on experience with Microsoft Azure data services

- SQL (complex queries, performance tuning)

Good knowledge of :

1. Data warehousing concepts (Star/Snowflake schema)

2. ETL/ELT design patterns

3. Data modeling

- Experience with Git-based version control

- Understanding of authentication mechanisms (OAuth, API keys, JWT)

- Strong debugging and problem-solving skills

Preferred Skills :

- Experience with Azure Synapse Analytics

- Exposure to containerization (Docker)

- Experience with Power BI integration

- Knowledge of streaming data processing

- Familiarity with Agile/Scrum methodologies

Education :

- Bachelors degree in Computer Science, Information Technology, or related field

Key Competencies :

- Strong analytical mindset

- Excellent communication skills

- Ability to work independently and in a team