Job Role/Title : Senior Manager- Data Engineering (Pinot Exp Must)

Experience : 13 - 20 Years

Location : Noida

Those who share our core belief of 'Every Day is Game Day'

We at Pine Labs are looking for those who share our core belief - Every Day is Game day. We bring our best selves to work each day to realize our mission of enriching the world through the power of digital commerce and financial services.

ROLE PURPOSE :

We are seeking a Delivery Head/Senior Manager/Dept Head with deep expertise in open-source data technologies, streaming platforms, and the AWS ecosystem to lead the next wave of innovation for our fintech data platform. You will play a pivotal role in designing, implementing, and evolving scalable data infrastructure and tools that power analytics, AI, and real-time insights across the organization. This role replaces a legacy builder who laid the data foundation using custom-built platforms and brought modern technologies like Superset, Airflow, MSK, and Debezium to production. Youll now take this ecosystem to the next level.

THE RESPONSIBILITIES WE ENTRUST YOU WITH :

- Own the data lake/OLAP - from streaming ingestion to analytics-ready layers.

- Lead and evolve our real-time data pipelines using Apache Kafka/MSK, Debezium CDC, and Apache Pinot.

- Deliver data related projects end to end by team of Data Engineers.

- Implement and maintain custom-built Java/Python-based frameworks for data ingestion, validation, transformation,
and replication.

- Design and manage data lakes using Apache Iceberg, Glue, and Athena over S3.

- Define and enforce data modeling standards across Pinot, Redshift and warehouse layers.

- Drive cloud-native deployment strategies using ECS/EKS, Terraform/CDK, Docker.

- Collaborate with ML, product, and business teams to support advanced analytics and AI use cases.

- Mentor data engineers and evangelize modern architecture and engineering best practices.

- Ensure observability, lineage, data quality, and governance across the data stack.

WHAT MATTERS IN THIS ROLE :

Experience & Portfolio :

- Must have 13+ years of experience.

- B.E./B.Tech/M.Tech in Computer Science, Engineering, or related field

- 13+ years of experience in data engineering and architecture roles

- Proven experience building systems from scratch and scaling them in production

- Fintech or financial services domain experience is a strong plus

Technical Skills & Efficiency :

- Proven expertise in Kafka/MSK, Debezium, and real-time event-driven systems.

- Hands-on experience with Pinot, Redshift, RocksDB or noSQL DB.

- Strong background in custom tooling using Java and Python

- Experience with Apache Airflow, Iceberg, Athena, and Glue

- Strong AWS ecosystem knowledge (IAM, S3, Lambda, Glue, ECS/EKS, CloudWatch, etc.)

- Deep understanding of data lake architecture, streaming vs batch processing, CDC concepts

- Familiarity with modern data formats (Parquet, Avro) and storage abstractions.

Communication & Ownership :

Nice To Have :

- Excellent communication and stakeholder management.

- Ability to work with both business and engineering teams.

- Attention to detail and strong ownership mindset.

- Ability to manage multiple integrations in parallel.

- Exposure to dbt, Big query, Trino/Presto, ClickHouse, or Druid