Azure Data Engineer

Description :

Requirements :

- Bachelor's Degree or Equivalent.

- Total Experience : 5-7 years.

- Relevant Experience in ADF and SQL : 5+ years.

Key Skills :

Technical(Primary) :

- Excellent in SQL, ADF is a must.

- Strong experience in building data pipelines in Azure Data Factory.

- Experience calling REST APIs using ADF.

- ETL, API (Rest, OAuth, SOAP, etc) data integration into ADLS Gen2/ Azure Synapse Analytics, and data migration.

- Experience in Ingestion of batch and streaming data with complex transformations.

- Experience in handling Semi-structured data in various data formats (Parquet, JSON) and manipulating data in complex data types.

- Azure Synapse/data warehouse experience using Synapse/data warehouse to present data securely and to build and manage data models.

- Azure Data lake/Delta lake, Blob Storage

- Knowledge of data modeling, design, manipulation, optimization, and best practices.

- Experience in working with a very large volume of log data and building analytical insights based on user requirements

Technical(Secondary) Skills :

- Knowledge of DevOps tools and experience in building CI/CD pipelines on Azure.

- Write programs to pull data from External Applications and Services using the REST API with different authentication methods.

- Knowledge of NoSQL Database types like Document and Graph DB is a plus.

Behavioral :

- Good Communication Skills.

- Ability to work in a cooperative team environment.