Aventior - Senior Data Engineer - ETL

Job Title : Senior Data Engineer

Required Experience : 5+ years

We are looking for an experienced Senior Data Engineer to join our team.

You will be responsible for large-scale data ingestion, cleaning, and standardization from diverse data sources into Microsoft SQL Server.

The ideal candidate will have expertise in creating efficient data pipelines, writing complex stored procedures, and managing ETL processes using SSIS, Azure Data Factory, and Python.

Experience with .NET C# is a plus.

If you have a passion for working with large volumes of data, optimizing data performance, and working in cloud environments, this role is for you!

Key Responsibilities :

- Design, implement, and manage mass data ingestion processes into MSSQL Server from various data sources.

- Clean, transform, and standardize large data sets to ensure data integrity and consistency.

- Write and optimize complex stored procedures to process and clean data efficiently.

- Develop, deploy, and maintain ETL pipelines using SSIS and Azure Data Factory.

- Build and automate data pipelines using Python for continuous data integration and transformation.

- Collaborate with stakeholders to define and implement data quality standards and ensure adherence.

- Manage Azure cloud infrastructure to support scalable and efficient data processing.

- Create technical documentation and maintain data process flows.

- Leverage .NET C# (if applicable) for additional data processing and automation tasks.

Required Qualifications :

- 5+ years of experience as a data engineer working with large-scale data systems.

- Strong proficiency in Microsoft SQL Server, including expertise in writing and optimizing stored procedures.

- Hands-on experience with ETL tools, specifically SSIS and Azure Data Factory.

- Proficient in Python for data processing and pipeline creation.

- Experience in handling large volumes of data in a production environment.

- Solid understanding of data warehousing concepts and techniques.

- Azure cloud experience with data management, ingestion, and pipeline automation.

- Excellent problem-solving and analytical skills.

- Strong communication skills to work with cross-functional teams.

Nice To Have :

- Experience with .NET C# for building data solutions.

- Familiarity with Azure DevOps or other CI/CD pipelines.

- Knowledge of modern cloud data architecture and best practices