Job Summary :

We are seeking a highly skilled and experienced Cloud Data Engineer to join our Digital Technologies team. The ideal candidate will have 6 to 9 years of experience in designing, building, and maintaining cloud-based data solutions on Azure or AWS platforms. This role will require expertise in data integration, pipeline development, data modelling and AIML workloads.

Key Responsibilities :

- Design, build, and optimize scalable, reliable, and efficient ETL/ELT pipelines for large data set processing.

- Automate data workflows to ensure real-time and batch data availability.

- Develop and manage data solutions using Azure services such as Data Factory, Synapse Analytics, Azure Databricks, and Azure SQL.

- Work with AWS services like Glue, Redshift, S3, Lambda, and Athena to create robust data solutions.

- Integrate structured, semi-structured, and unstructured data from various sources.

- Create and maintain data models that support analytics and reporting needs.

Collaboration and Stakeholder Engagement :

- Work closely with cross-functional teams, including Data Scientists, Analysts, and Software Engineers.

- Translate business requirements into technical specifications for data solutions.

- Manage IAM roles, policies, and encryption for data at rest and in transit.

- Manage and Mentor Junior data Engineers in the team.

- Experience in AIML and Generative AI in Areas of Data engineering

Performance Optimization :

- Monitor and optimize the performance of cloud data pipelines and infrastructure.

- Debug and resolve data-related issues in a timely manner.

Required Qualifications :

- Bachelor's degree in Computer Science, Engineering, or a related field.

- 6-9 years of hands-on experience in cloud data engineering, with a focus on Azure and AWS.

- Good experience In Azure Databricks and AIML workloads.

- Proficiency in Python, SQL, and other scripting languages for data manipulation and automation.

- Experience in data orchestration tolls like Airflow and relevant cloud components.

- Strong understanding of distributed computing and big data frameworks like Apache Spark and Hadoop.

- Knowledge of Cloud data Warehouses like Synapse, Snowflake.

- Experience with CI/CD pipelines for data workflows using tools like Jenkins, GitHub Actions, or Azure DevOps.

- Certification in Azure/AWS and Databricks.

- Familiarity with containerization and orchestration tools (e.g., Docker, Kubernetes).

- Strong problem-solving skills and the ability to work independently or as part of a team.

Work Location :

- Whitefield, Bangalore