Overview :

We are looking for an experienced Data Engineer to manage, enhance and scale our internal analytics platform that supports both real-time and historical data processing. The role involves working across streaming systems, data infrastructure, APIs, and reporting layers to ensure high performance, reliability, and scalability.

Job Profile & Qualification:

- B.Tech / MCA / M.Sc (IT, Computer)

- 8 - 12 years relevant experience in data management and interpretation for B2C websites and mobile apps.

- Experience in Digital space (website and mobile applications) is mandatory.

- Experience in working with various web analytics tools like Google Analytics (GA4), Chartbeat, Comscore etc.

- Good analytical, mathematical and problem solving skills.

- Exposure to JavaScript, Java, Web API development.

- Hands-on exposure to NoSQL (DynamoDB, Accumulo etc) and large data stores on Snowflake, Pinot etc.

- Experience with workflow orchestration tools (Airflow).

- Strong experience in real-time streaming systems (Kinesis).

- Working with structured/un-structured data, file parsing etc.

- Experience in data models and reporting packages.

- Ability to analyse large datasets.

- Ability to write comprehensive reports.

- Excellent verbal and written communication skills.

Key Responsibilities :

- Own and manage the existing real-time and batch data platform, ensuring high availability and reliability.

- Monitor, troubleshoot, and optimize data pipelines and streaming systems.

- Enhance performance and scalability of analytics data stores (Pinot, Snowflake, Accumulo, DynamoDB etc).

- Maintain and improve data ingestion, processing, and transformation workflows.

- Manage and optimize Airflow jobs, scheduled workflows, and reporting pipelines.

- Support and enhance data APIs for internal analytics consumption.

- Ensure data quality, consistency, and low-latency data availability across systems.

- Work on new initiatives within the data platform, including building and integrating new data pipelines, features, and use cases.

- Design and develop dashboards and reporting solutions to support business and product teams.

- Translate business requirements into scalable data models, metrics, and visualizations.

- Identify and implement improvements in system performance, cost optimization, and scalability.

- Collaborate with product, analytics, and business teams to support evolving data and reporting needs.

- Implement monitoring, alerting, and observability for proactive issue detection.

- Drive continuous improvements and architectural enhancements as the platform evolves.