Azure Data Engineer - Python/SQL

Description :

Job Title : Azure Data Engineer

Company : Capgemini

Experience : 4 to 7 Years

Location : Banda, Uttar Pradesh

Employment Type : Full-Time

Role Overview :

As an Azure Data Engineer, you will be responsible for designing, building, and maintaining large-scale, cloud-based data solutions. You will work with modern data tools and platforms, contribute to data modelling and transformation, and support analytics and machine learning initiatives. The role requires a strong foundation in Azure data services, Python/SQL, and end-to-end data engineering practices.

Key Responsibilities :

- Design, build, and deploy scalable and secure data pipelines on Azure cloud.

- Develop and maintain ETL/ELT workflows using tools like Azure Data Factory, Databricks, and Azure Data Lake.

- Build and optimize data models, schemas, and transformation pipelines following best practices.

- Work with Python, SQL, and frameworks such as Spark, dbt, Airflow, or Pandas for data manipulation.

- Integrate data from multiple sources including batch, streaming, and real-time platforms (Kafka, Kinesis, etc.).

- Implement best practices for data governance, security, compliance, and documentation.

- Collaborate with data scientists, analysts, and business stakeholders to enable insights, ML pipelines, and feature engineering.

- Work with cloud-native storage solutions such as Azure Storage, Data Lake, Redshift, Snowflake, or BigQuery.

- Implement CI/CD pipelines for data deployments using Terraform, CloudFormation, or Azure DevOps.

- Ensure operational excellence by monitoring data pipelines, ensuring reliability, and troubleshooting issues.

Required Qualifications & Skills :

- Bachelors degree in Computer Science, Information Systems, Engineering, or related field.

- 4+ years of experience in cloud data engineering.

- Strong proficiency in Python, SQL, and data processing tools.

- Practical experience with :

Azure Data Factory, Azure Databricks, Azure Data Lake

OR AWS equivalents (Glue, S3, Redshift, SageMaker)

- Experience integrating data pipelines with data lakes, data warehouses, and streaming frameworks.

- Knowledge of data modelling, data transformation patterns, and schema design.

- Hands-on experience with CI/CD, infrastructure-as-code (Terraform/CloudFormation), and pipeline automation.

Preferred Qualifications :

- Experience building data solutions to support AI/ML use cases, feature stores, or real-time ingestion systems.

- Familiarity with data testing, versioning, and observability tools (e.g., Great Expectations, MLflow, Delta Lake).

- Experience interacting with cross-functional teams and understanding business data requirements.

- Exposure to the Power, Energy, or Electrification sector is a strong advantage.

- Working knowledge of enterprise-grade security practices, compliance, and data governance.

Why Join Capgemini? :

- Be part of a diverse team of innovators, technologists, and free-thinkers working on impactful digital transformation projects.

- Contribute to building a more sustainable and inclusive future using the power of technology.

- Work with global clients and cutting-edge technologies in cloud, data, and AI.

- Collaborate in a culture that values creativity, continuous learning, and growth.

- Shape your career through mentorship, mobility opportunities, and exposure to modern engineering practices.