Role Overview :

As a Senior GCP Data Engineer, you will architect, build, and maintain scalable data pipelines that serve as the backbone for our advanced analytics and machine learning initiatives. You will work closely with cross-functional teams, including data scientists, product managers, and business stakeholders, to transform complex raw data into actionable insights. By leveraging the full suite of Google Cloud Platform services, you will play a pivotal role in optimizing data infrastructure, ensuring high availability, and driving data-informed decision-making that directly impacts our business growth and customer experience across our global operations in Bangalore, Chennai, Gurgaon, Hyderabad, and Pune.

Key Responsibilities :

- Design and implement robust, end-to-end data pipelines using PySpark and Dataproc to process large-scale datasets, ensuring high performance and reliability for downstream analytical applications.

- Orchestrate complex data workflows using Apache Airflow to automate scheduling, monitoring, and error handling, thereby improving operational efficiency for the data engineering team.

- Develop and optimize high-performance data models within BigQuery to support business intelligence reporting and ad-hoc analysis for stakeholders.

- Collaborate with software engineering and DevOps teams to implement best practices in data governance, security, and CI/CD, ensuring that all data solutions are compliant and scalable.

- Mentor junior engineers and conduct code reviews to foster a culture of technical excellence and continuous improvement within the data organization.

- Troubleshoot and resolve complex data quality issues, performing root cause analysis to maintain the integrity of the data ecosystem for the entire enterprise.

Required Skillset :

- Demonstrated expertise in building data solutions on Google Cloud Platform, with a deep understanding of cloud-native architecture and distributed computing principles.

- Advanced proficiency in Python and PySpark, with a proven ability to write clean, maintainable, and highly efficient code for large-scale data processing.

- Strong command of SQL for complex query optimization and data manipulation within BigQuery or similar cloud data warehouses.

- Proven experience in managing workflow orchestration using Apache Airflow, including the ability to design idempotent and fault-tolerant pipelines.

- Excellent communication skills with the ability to translate technical data challenges into clear business language for non-technical stakeholders.

- A minimum of 6 to 14 years of professional experience in data engineering, demonstrating a track record of delivering high-impact data projects in a fast-paced environment.

- Ability to thrive in a hybrid work environment, collaborating effectively with distributed teams across our various office locations in India.

- A Bachelors or Masters degree in Computer Science, Engineering, or a related quantitative field, reflecting a strong foundation in algorithmic thinking and system design.