Position: Data Engineer - Databricks & PySpark

Experience: 3 - 5 years

Location: Gurgaon, India

Work Mode: Work from Office (Monday - Friday)

Shift: 2:00 PM - 11:00 PM IST

About the Job:

MantriAI is hiring for a leading global analytics and advisory firm, helping banks and financial institutions drive revenue growth, reduce costs and manage risk through Big Data, Advanced Analytics and deep industry expertise.

Key Responsibilities:

- Develop data ingestion and transformation pipelines using Databricks, PySpark, Python and SQL

- Integrate data from multiple sources and prepare datasets for reporting, analytics and machine-learning use cases

- Build reusable transformation components and analytical data models

- Implement data-quality checks, reconciliation, exception handling and pipeline monitoring

- Optimize Spark workloads for performance, reliability and cost

- Apply data security, access controls, lineage and documentation standards

- Support automated deployment, production troubleshooting and ongoing pipeline maintenance

- Translate banking business requirements into sustainable data solutions

Required Skills & Experience:

- Strong hands-on experience with Databricks and PySpark

- Proficiency in Python and SQL

- Experience building ETL/ELT pipelines and working with a data lake

- Understanding of distributed processing, workflow orchestration and performance tuning

- Working knowledge of the banking domain, including banking data and metrics

- Understanding of data-quality requirements: validation, completeness, accuracy and consistency

Preferred Skills:

- Experience with Azure-based data platforms

- Familiarity with enterprise data governance and sensitive-data handling

- Experience preparing data for Power BI and machine-learning applications