Posted on: 17/11/2025
Description :
Were looking for a Senior Data Engineer to join our Microservices Data Ingestion Platform (MDIP) team within the Datalake Zone in Bangalore.
This team builds and maintains the data infrastructure that enables seamless data flow from microservices datastores to our datalake.
We specialize in continuous data streaming, ETL/ELT processes, and ensuring data quality and reliability for downstream analytics and reporting.
Education, Experience & Skills:
- 5-9 years of experience in data engineering.
- Bachelors degree or equivalent; quantitative discipline preferred.
- Strong programming skills (Java, Python, C#, etc.)
- Familiarity with Unix/Linux, SQL, NoSQL, and big data tools (Kafka, Spark, Cassandra, Elasticsearch).
- Experience with Snowflake or Redshift is a plus.
- Knowledge of RESTful APIs and microservices architecture.
- Experience with ETL/ELT tools like Airflow, dbt.
- Exposure to AWS or private cloud environments.
- Understanding of schema evolution and data versioning.
Key Responsibilities :
Data Pipeline Development :
- Build Kafka-based streaming pipelines from PostgreSQL RDS to Snowflake.
- Optimize S3-based data staging and transformation.
- Configure Snowpipe for automated data loading.
- Implement validation, alerting, monitoring, and error handling.
- Explore new technologies for scalable, high-performance solutions.
Microservices Data Ingestion :
- Collaborate with microservices teams to understand schemas and integration needs.
- Design low-impact data extraction strategies.
- Implement CDC solutions for synchronization.
- Ensure consistency across distributed systems.
- Tune Kafka performance and throughput.
- Design cost-effective S3 storage with lifecycle policies.
- Build automated testing frameworks for pipeline validation.
- Ensure compliance with healthcare regulations (HIPAA, etc.)
Operational Excellence & Agile Collaboration :
- Set up monitoring and alerting for pipelines.
- Maintain runbooks and documentation.
- Participate in on-call rotation.
- Act as SME for data integration and pipeline architecture.
- Engage in agile ceremonies and support team productivity.
- Mentor team members and share learnings across engineering.
Behaviors & Abilities :
- Fast learner with a focus on writing clean, scalable code.
- Strong collaboration across cross-functional teams.
- Ability to prioritize tasks and mentor junior engineers.
- Ownership mindset and proactive problem-solving.
- Effective communication with technical and business stakeholders.
- Active contributor to athenas culture and engineering excellence.
Bonus Healthcare Industry Knowledge :
- Familiarity with HL7, FHIR standards.
- Experience handling PHI/PII data and compliance.
- Understanding of healthcare workflows and clinical data structures.
Did you find something suspicious?
Posted By
Judah Muthiah
Senior Recruiting Manager at athenaHealth Technology Private Limited.
Last Active: 5 Dec 2025
Posted in
Data Engineering
Functional Area
Big Data / Data Warehousing / ETL
Job Code
1575345
Interview Questions for you
View All