Cloud Data Engineer - Azure Cloud Services

Job Description :

Key Responsibilities :

- Understanding operational needs by collaborating with specialized teams.

- Supporting key AXA business operations.

- This involves architecture designing, building and deploying data systems, pipelines, etc.

- Build and support scalable and cost-efficient solutions using multiple data services.

Technical and Professional Skills :

- Proficient in Cloud Services Azure.

- Support on analyzing data pipelines utilizing Azure data stack capabilities.

- Close coordination with the Command Centre, which performs BAU monitoring and L1 Support.

- Deep dive of failed pipelines to formulate root cause analysis, L2/L3 support.

- Coordinate with the Development team on the analysis of incidents.

- Analysis of long-running data pipelines and propose optimization opportunities.

- Building logic to formulate and debug datasets using PySpark, Spark Scala and Spark SQL.

- Setup process and automation of workflow.

- Maintain and utilize SOP documents.

- Work prioritization as per ticket severity.

- Building Complex Notebook in Databricks to achieve business Transformations.

- Familiarity with building datasets using Scala.

- Good Understanding of tools such as ServiceNow and ControlM.

- Good communication and interpersonal skills.

Soft Skills and Competencies :

- Good communication skills to coordinate between business stakeholders & engineers.

- Strong results orientation and time management.

- True team player who is comfortable working in a global team.

- Ability to establish relationships with stakeholders quickly in order to collaborate on use cases.

- Comfortable working in a multidisciplinary team within a fast-paced environment.

Background and Experience :

- Bachelors Degree in Computer Science or related field

- 2 to 6 years of experience in Cloud Data Engineering