Technical Project Manager Big Data & Data Engineering

Location : Pune

Experience : 10- 15 Years

Role Summary :

The Technical Project Manager (TPM) is the strategic engine driving the execution of our enterprise-scale data engineering programs. This role requires a sophisticated blend of deep technical literacy in Big Data ecosystems and elite project governance.

You will be responsible for navigating complex cross-functional dependencies, ensuring that engineering velocity remains high while aligning technical outputs with overarching business roadmaps. You will act as the critical interface between executive stakeholders and high-performance engineering squads, ensuring predictable, high-quality delivery in a fast-paced Agile environment.

Responsibilities :

- Lead end-to-end delivery governance for high-complexity data programs, spanning from initial data discovery and ingestion to advanced analytics and platform scaling.

- Orchestrate sprint execution for multiple data engineering squads, ensuring rigorous adherence to Scrum/Agile ceremonies and maintaining a high-quality, groomed backlog.

- Act as the primary liaison between business units and technology teams, translating high-level commercial requirements into actionable technical milestones.

- Identify, track, and mitigate program-level risks and cross-functional dependencies, particularly between data producers, platform engineering, and downstream consumers.

- Collaborate closely with Principal and Lead Engineers to align architectural decisions with delivery timelines, ensuring technical debt is managed without compromising deadlines.

- Define and monitor key performance indicators (KPIs) such as velocity, burn-down accuracy, and defect density to drive continuous process improvement.

- Oversee comprehensive resource planning and budget tracking, ensuring optimal allocation of engineering talent across competing project priorities.

- Direct the release management process, coordinating with DevOps and QA leads to ensure seamless deployment of data pipelines into production environments.

- Design and maintain executive-level dashboards and reporting frameworks that provide real-time visibility into program health, financial burn, and milestone achievement.

- Facilitate "Scrum of Scrums" and steer-co meetings to resolve organizational bottlenecks and ensure synchronization across global delivery centers.

Technical Requirements :

- 10- 15 years of experience in technical project management, with at least 5 years specifically leading Data Engineering, Data Warehousing, or Big Data initiatives.

- Proficient understanding of the Big Data technology stack (Hadoop, Spark, Kafka, Airflow, and Cloud Data Warehouses like Snowflake or BigQuery) to effectively challenge estimates and identify technical risks.

- Mastery of Agile/Scrum methodologies and expert-level proficiency in tooling such as JIRA, Confluence, and MS Project for lifecycle management.

- Proven track record of managing large-scale data migrations or platform modernization projects in an enterprise environment.

- Strong grasp of the Data Development Life Cycle (DDLC), including data quality frameworks, CI/CD for data, and automated testing paradigms.

- Experience in financial management for technology programs, including CAPEX/OPEX modeling and vendor management.

Preferred Skills :

- PMP or ACP (Agile Certified Practitioner) certification is highly desirable.

- Experience with Scaled Agile Framework (SAFe) for managing large, multi-squad programs.

- Technical background as a former Data Engineer or Developer is a significant advantage for gaining credibility with engineering leads.

- Familiarity with Data Governance, Privacy (GDPR/DPDP), and Security compliance requirements within a data program.

- Knowledge of Cloud infrastructure (AWS/Azure/GCP) cost optimization and resource tagging strategies.

- Exceptional communication and negotiation skills, with a proven ability to manage expectations of C-suite stakeholders while advocating for engineering excellence.