As a Data Engineer, you will play a crucial role in developing, maintaining, and optimizing our data platform. Your expertise will drive the evolution of our platform, enabling seamless end-to-end transformation from raw data to insightful data products shared across the organization. You will collaborate closely with data product teams to understand their needs, challenges, and opportunities, ensuring the platform supports a wide range of data initiatives.

You will also contribute to the architecture and design decisions of the platform, aligning with the principles of data mesh to promote domain-oriented decentralized data ownership and architecture. As a data engineer, you are also expected to participate in continuous learning and training to stay updated on the latest trends and technologies in data engineering and AI automation within DE. You will also work on pipeline optimization for cost, performance, and reliability.

Requirements :

- A graduate/post graduate degree in Computer science, Software engineering with 4 - 6 years of experience as a Data Engineer.

- Strong proficiency in ETL pipelines, Databricks, SQL, Data Lakes/Datawarehouse.

- Extensive experience working in Azure / Fabric environment.

- Hands-on experience with Azure Data Factory / Fabric, Databricks, Azure Notebooks, Pyspark, Synapse.

- Proven experience in SQL, data warehousing, data modeling, data architecture, and building data pipelines.

- Must have hands on experience in Git, CI/CD, Azure DevOps, Terraform, Event hub/Spark streaming/ Kafka.

- Excellent problem-solving skills and the ability to troubleshoot data-related issues.

- Strong communication and collaboration skills to work effectively with global teams.

- A proactive mindset and willingness to learn new technologies and methodologies.

- Preferred experience in data security tools /RBAC, IAM and data governance tools like Collibra/ Purview.

- Familiarity with other big data technologies and AI enablement/automation within DE.

- Demonstrate a strong understanding of data governance and security best practices.

- Develop relationships and processes with Business Owners, Analytics and other cross-functional stakeholders.

- Experience in Finance, Supply Chain, Sales & Marketing and Procurement domains is an added advantage.