Techolution - Senior Azure Data Engineer - PySpark

We are seeking a skilled Sr Azure Data Engineer with hands-on experience in modern data engineering tools and platforms within the Azure ecosystem. The ideal candidate will have a strong foundation in data integration, transformation, and migration, along with a passion for working on complex data migration projects.

Job Title : Sr. Azure Data Engineer

Location : Remote work

Work Timings : 2 : 00 PM 11 : 00 PM IST

No of Openings : 2

- Design, develop, and manage end-to-end data pipelines using Azure Data Factory or Synapse Data Factory to orchestrate migration and ETL processes.

- Build and administer scalable, secure Azure Data Lakes to store and manage structured and unstructured data during and post-migration.

- Utilize Azure Databricks, Synapse Spark Pools, Python, and PySpark for advanced data transformation and processing.

- Develop and fine-tune SQL/T-SQL scripts for data extraction, cleansing, transformation, and reporting in Azure SQL Database, SQL Managed Instances, and SQL Server.

- Design and maintain ETL solutions using SQL Server Integration Services (SSIS), including reengineering SSIS packages for Azure compatibility.

- Collaborate with cloud architects, DBAs, and application teams to assess existing workloads and define the best migration approach.

- Continuously monitor and optimize data workflows for performance, reliability, and cost-effectiveness across Azure platforms.

- Enforce best practices in data governance, security, and compliance throughout the migration lifecycle.

Required Skills and Qualifications :

- 3+ years of hands-on experience in data engineering, with a clear focus on SQL workload migration to Azure.

- Deep expertise in : Azure Data Factory / Synapse Data Factory, Azure Data Lake, Azure Databricks / Synapse Spark Pools, Python and PySpark, SQL

- SSIS design, development, and migration to Azure

- Proven track record of delivering complex data migration projects (on-prem to Azure, or cloud-to-cloud).

- Experience re-platforming or re-engineering SSIS packages for Azure Data Factory or Azure-SSIS Integration Runtime.

- Microsoft Certified : Azure Data Engineer Associate or similar certification preferred.

- Strong problem-solving skills, attention to detail, and ability to work in fast-paced environments.

- Excellent communication skills with the ability to collaborate across teams and present migration strategies to stakeholders.