- Develop and optimize ETL/ELT pipelines using Azure Data Factory (ADF), Databricks, and Synapse Analytics.

- Design and implement scalable data architectures following Medallion Architecture and best practices.

- Perform data ingestion, transformation, and orchestration across structured and unstructured datasets.

- Develop and maintain data lake solutions in Azure Data Lake Storage (ADLS) Gen2.

- Write and optimize SQL queries for data extraction, transformation, and analysis.

- Implement CI/CD pipelines for data workflows using Azure DevOps.

- Collaborate with stakeholders to understand data requirements and ensure data availability.

- Ensure data governance, security, and compliance in Azure-based data solutions.

- Monitor and troubleshoot data pipelines to maintain reliability and performance.

- Stay updated with the latest Azure and big data technologies and implement best practices.

- Resolving issues that are raised during code/review, through exhaustive systematic analysis of the root cause, and being able to justify the decision taken.

- Carrying out POCs to make sure that suggested design/technologies meet the requirements.

Must to have :

- Strong experience in Azure Data Engineering with Data Factory, Synapse, Fabric, Databricks.

- Expertise in SQL, T-SQL, and Python for data processing and transformation.

- Hands-on experience with PySpark for big data processing.

- Experience in designing ETL/ELT pipelines and working with large datasets.

- Proficiency with Azure Data Lake (ADLS) Gen2 for data storage and processing.

- CI/CD and DevOps knowledge, including Azure DevOps, Git, and automated deployments.

- Understanding of data modeling, data warehousing, and schema design principles.

Good to have :

- Experience in New Age Technologies like Low Code, No Code, DevOps.

- Familiarity with Data Governance and Security best practices in cloud-based data solutions.

- Experience with real-time data processing using Kafka, Event Hub, or Stream Analytics is a plus.

- Knowledge of DataOps methodologies and best practices.

- Experience with APIs, REST services, and integrating third-party data sources.

- Familiarity with Power BI or other visualization tools is an added advantage.

About Damco :

- We are a global technology company with more than two decades of core IT experience.

- Our differentiators are technological prowess with unwavering back-end support on a wide range of technologies and industry-leading platforms.

- At Damco, we take pride in building innovative, efficient, and robust IT solutions for our clients.

- We match the clients business goals with our technology expertise and immaculate execution capabilities to solve issues that matter to the end-user.

- Damco has developed hundreds of products and applications, redefined countless processes, built numerous technology teams and systems, and delivered significant financial results to customers from diverse verticals.

- We believe in empowering our people to perform and grow by offering opportunities, learning, and inspirationto act and accomplish.

- If you are a self-starter looking for an open and collaborative work culture to excel in career, we are the place for you.

- Here is what you can expect from our work-culture.