About the Role :

We are building an independent AI team to power next-generation data-driven solutions for AashaPurti (Personal & Gold Loans) and India Online Pay (Payment Gateway). As a Data Engineer, you will play a key role in designing and implementing scalable data pipelines, data lakes, and ETL workflows to support AI models, real-time analytics, and BI dashboards. You will ensure high-quality, reliable, and secure data availability for credit scoring, fraud detection, and other fintech use cases.

Key Responsibilities :

- Design, develop, and maintain ETL/ELT pipelines for structured and unstructured data from multiple sources (loan management systems, payment gateways, transaction logs, external APIs like CIBIL).

- Build and manage data lakes and data warehouses for analytics and machine learning use cases.

- Optimize data ingestion and processing frameworks for real-time and batch workflows.

- Implement data quality, validation, and monitoring systems.

- Work closely with Data Scientists, AI Engineers, and BI teams to deliver high-quality datasets for model training and dashboards.

- Ensure data security and compliance with RBI guidelines, GDPR, and internal policies.

- Collaborate with MLOps engineers for model deployment pipelines.

- Troubleshoot data-related issues and optimize performance for scalability.

- Document data models, workflows, and processes.

Required Skills & Qualifications :

Education : B.E/B.Tech/MCA/M.Sc. in Computer Science, Data Engineering, or related field.

Experience : 36 years in Data Engineering roles (preferably in fintech, banking, or payment systems).

Technical Skills :

- Strong programming skills in Python (Pandas, PySpark) or Java/Scala.

- Proficient in SQL and NoSQL databases (PostgreSQL, MongoDB, Cassandra).

- Experience with big data technologies : Apache Spark, Hadoop, Kafka.

- Hands-on with ETL tools (Airflow, Prefect, Luigi).

- Familiarity with cloud platforms (AWS/GCP/Azure) and data services (S3, BigQuery, Redshift).

- Knowledge of data lake and warehouse design.

Bonus Skills :

- Experience with real-time streaming (Kafka, Kinesis).

- Exposure to MLOps and AI/ML data pipelines.

- Understanding of fintech data structures (KYC, transactions, credit scoring).

Soft Skills :

- Strong problem-solving and analytical skills.

- Ability to work in a fast-paced, agile environment.

- Excellent communication and documentation skills.

Compliance & Security Awareness :

- Familiarity with RBI guidelines, data localization, and data privacy regulations.

- Experience implementing data encryption and masking techniques.

Why Join Us?

- Work on cutting-edge AI and analytics solutions in the fintech domain.

- Be part of a new AI innovation team with high visibility and impact.

- Opportunity to design data architecture from the ground up.

- Competitive compensation, flexible work culture, and growth opportunities