Senior Software Engineer - Data & AI

Description :

Key Responsibilities :

- Design, build, and maintain scalable data pipelines and ETL/ELT workflows for batch and real-time / near real-time data processing.

- Develop and manage data models, data transformations, and metadata frameworks ensuring high data reliability and quality.

- Build and deploy analytics solutions into production systems, enabling actionable insights for business and product teams.

- Work with cloud-native data infrastructure and services, ideally AWS (S3, Glue, Redshift, Athena, EMR, Lambda, etc.).

- Implement monitoring, logging, and observability frameworks to track data pipeline performance, data quality, and system reliability.

- Collaborate with product, engineering, and analytics teams to understand data needs and build solutions that support insights and reporting.

- Apply data quality best practices including anomaly detection, schema validation, lineage tracking, and automated quality checks.

- Partner with AI/ML teams to operationalize models and integrate ML-generated insights into production workflows.

- Analyze data to uncover trends and patterns, contributing to improvements in product performance and customer experience.

- Conduct root-cause analysis for data-related issues and drive continuous improvement across data systems.

- Maintain strong engineering standards through code reviews, automated testing, and documentation.

Qualifications :

- 6+ years of experience in data engineering or software engineering with a strong focus on data.

- Hands-on experience developing data pipelines and processing large-scale datasets (batch + streaming).

- Strong proficiency in SQL and at least one programming language (Python, Java, or Scala).

- Experience with AWS or other cloud-native data platforms.

- Familiarity with distributed data systems, data warehousing, and modern data lake / data mesh architectures.

- Experience with monitoring, observability, and telemetry systems.

- Strong problem-solving skills and ability to translate business needs into data solutions.

- Excellent communication and stakeholder collaboration skills.