Roles and Responsibilities :

- Build pipelines to bring in wide variety of data from multiple sources within the organization as well as from social media and public data sources.

- Collaborate with cross functional teams to source data and make it available for downstream consumption.

- Work with the team to provide an effective solution design to meet business needs.

- Ensure regular communication with key stakeholders, understand any key concerns in how the initiative is being delivered or any risks/issues that have either not yet been identified or are not being progressed.

- Ensure dependencies and challenges (risks) are escalated and managed.

- Escalate critical issues to the Sponsor and/or Head of Data Engineering.

- Ensure timelines (milestones, decisions and delivery) are managed and value of initiative is achieved, without compromising quality and within budget.

- Ensure an appropriate and coordinated communications plan is in place for initiative execution and delivery, both internal and external.

- Ensure final handover of initiative to business as usual processes, carry out a post implementation review (as necessary) to ensure initiative objectives have been delivered, and any lessons learned are fed into future initiative management processes

Required Skills :

- Azure Data Bricks

- Azure Data Factory

- Spark

- SQL

- Data Engineering