Description :

Experience : 4+ years

Location : Chennai, Pune, Bangalore, Mumbai, Kochi

Required Technical Skill Set :

- Azure Databricks: Hands-on experience working with Azure Databricks for building scalable ETL pipelines and integrating with Azure Data Lake Storage.

- ETL Development: Strong experience in building ETL pipelines to manage large-scale data flows and data integration.

- Data Lake Storage: Familiarity with Azure Data Lake Storage and its integration into the broader data architecture.

- Apache NiFi: Secondary expertise in using Apache NiFi for data integration, transformation, and flow management.

- Azure Cloud: Knowledge of Azure services related to data engineering, including Azure Data Lake, Azure Synapse, and Azure SQL.

Must-Have :

- Strong experience in Azure Databricks for ETL development and managing big data pipelines.

- Proficiency with Azure Data Lake Storage and integration into cloud architectures.

- Familiarity with Apache NiFi for data ingestion, transformation, and routing.

- Experience in PySpark

- Solid understanding of cloud-based data engineering and storage systems.

- Strong problem-solving skills to troubleshoot and optimize ETL workflows.

Good-to-Have :

- Experience with other Azure services like Azure Synapse, Azure Data Factory, and Azure Functions.

- Understanding of streaming data and real-time data integration.

- Ability to collaborate effectively with cross-functional teams, including data scientists and business analysts.

- Good communication skills for presenting and explaining technical solutions.