Azure Data Engineer - Python/SQL

Description :

Job Summary :

We are seeking experienced and technically proficient Azure Data Engineers to join our team. You should be well versed in coding, spark core and data ingestion using Azure. Experience with core Azure DE skills and coding skills (pyspark, python and SQL).

Key Responsibilities :

- Create and maintain data storage solutions including Azure SQL Database, Azure Data Lake, and Azure Blob Storage.

- Design, implement, and maintain data pipelines for data ingestion, processing, and transformation in Azure Create data models for analytics purposes.

- Utilizing Azure Data Factory or comparable technologies, create and maintain ETL (Extract, Transform, Load) operations.

- Use Azure Data Factory and Databricks to assemble large, complex data sets.

- Implementing data validation and cleansing procedures will ensure the quality, integrity, and dependability of the data.

- Ensure data security and compliance.

- Collaborate with data engineers, and other stakeholders to understand requirements and translate them into scalable and reliable data platform architectures.

Role Requirements and Qualifications :

- Should have minimum 5 years of relevant Data Engineering experience.

- Familiarity with Azure DevOps.

- Strong experience with Apache Spark, Python with SQL proficiency.

- Knowledge with Azure Databricks.

- Experience with big data technologies.

- Blend of technical expertise, analytical problem-solving, and collaboration with cross-functional teams