Azure Data Engineer - PySpark/SQL
Posted on: 08/09/2025
Job Description
About Us :
Talpro is leading the way in transforming the talent acquisition landscape.
We deliver innovative, sustainable, and cost-effective recruitment solutions tailored to todays business needs.
Our mission is to offer comprehensive hiring strategies that address immediate recruitment demands while laying the groundwork for long-term success.
Job Description :
This is a remote position.
We are looking for a skilled and experienced Azure Data Engineer with expertise in ADF (Azure Data Factory), strong RDBMS and SQL skills, and familiarity with Informatica PWC and Oracle PL/SQL.
As an Azure Data Engineer, you will be responsible for understanding and converting Informatica PWC and Oracle PL/SQL code into ADF and Azure SQL.
Additionally, you will work on Azure and Databricks "Lakehouse" implementation, translating business requirements into technical solutions for data curation and consumption.
Responsibilities :
- Data Curation and Transformation: Translate business requirements into technical solutions for data curation and transformation, specifically using Databricks Lakehouse from a modeling and ELT perspective.
- Azure Data Engineering: Develop data pipelines and orchestration using Azure Data Factory and other Azure Modern Data Warehouse platform components.
- SQL and Pyspark: Utilize SQL programming and Pyspark for data manipulation and processing tasks.
- Azure Services: Work with Azure services such as ADLS (Azure Data Lake Storage), ADX (Azure Data Explorer), and Databricks.
- Data Migration: Experience in SQL Server migration to the cloud and handling structured and unstructured datasets.
- DevOps and CI/CD: Good knowledge of DevOps tools and processes, and experience in automating data pipelines through a CI/CD delivery methodology.
- Databricks Expertise: In-depth hands-on implementation knowledge on Azure Databricks, Databricks Delta Lake, and managing Delta Tables.
- Data Modeling: Understand and implement data modeling for the data lake.
- Data Transfer and Oracle PL/SQL: Hands-on experience in using secure file transfer tools like Kiteworks, and Oracle PL/SQL knowledge will be a plus.
- Effort Estimation: Provide effort estimation for new projects related to data engineering.
- Complex Design and Agile Environment: Drive complex design and development efforts in an agile environment.
Qualifications :
- Minimum of 5 to7 years of experience working on Azure and Databricks "Lakehouse" implementation.
- Strong experience in ADF (Azure Data Factory) and SQL as primary skills.
- Familiarity with Informatica PWC and Oracle PL/SQL.
- Experience in SQL programming and Pyspark.
- 2 or more years of experience as a Data Engineer, specifically in the Azure Modern Data Warehouse platform.
- Good understanding of data modeling and data lake concepts.
- Expertise in Databricks, ADLS, ADX, and other Azure services.
- Prior experience in SQL Server migration to the cloud.
- Knowledge of DevOps tools and processes
Did you find something suspicious?
Posted By
90
Posted in
Data Engineering
Functional Area
Data Engineering
Job Code
1542648
