HamburgerMenu
hirist

Data Engineer - AWS

XANDER CONSULTING AND ADVISORY PRIVATE LIMITED
Bangalore
3 - 6 Years

Posted on: 13/10/2025

Job Description

Description :


Responsibilities :


- Scalable Data Pipelines : Develop and maintain scalable data pipelines using AWS technologies (e. g., AWS Glue, AWS Lambda) to handle increasing data volumes and complexity.


- API Integrations : Build and manage API integrations to ingest data from various sources, including Moengage, Appsflyer S3 buckets, Google/Facebook/Instagram APIs, and Call Center data.


- Collaborative Development : Work closely with analytics and business teams to enhance data models for business intelligence tools, promoting data accessibility and data-driven decisions across the organization.


- Data Quality Monitoring : Implement robust processes and systems for monitoring data quality, ensuring production data is accurate and readily available for key stakeholders and business processes.


- Testing and Documentation : Write unit and integration tests, contribute to the engineering wiki, and thoroughly document your work.


- Data Analysis and Troubleshooting : Conduct data analysis to identify and resolve data-related issues, supporting the maintenance of data integrity.


- Team Collaboration : Collaborate with frontend and backend engineers, product managers, and analysts to ensure seamless integration and data flow.


- Data Asset Definition : Define company data assets and develop Spark, SparkSQL, and HiveSQL jobs to populate data models.


- Integration and Quality Framework : Design data integrations and develop a comprehensive data quality framework.


- Tool Evaluation : Assess and recommend open-source and vendor tools for data lineage and other data management needs.


- Strategic Development : Work with all business units and engineering teams to develop a long-term strategy for our data platform architecture, emphasizing scalability, reliability, and performance.


Requirements :


- Proven experience with AWS data engineering tools (AWS Glue, Redshift, Athena, Lambda, etc. ).


- Familiarity with ingesting data from various sources and integrating it into a centralized data platform.


- Experience in designing and building Customer Data Platforms (CDP) to unify customer data across multiple touchpoints.


- Strong understanding of data models, data quality frameworks, and data lineage tools.


- AWS Data Engineering certification is preferred.


- Previous experience in a fintech environment is a plus.


- Excellent problem-solving skills and attention to detail.


- Strong communication skills and ability to work collaboratively in a team-oriented environment.


info-icon

Did you find something suspicious?