Infinite Computer Solutions - Lead Data Engineer - Google Cloud Platform

Key Responsibilities :

- Lead the design and implementation of scalable batch and real-time data pipelines on GCP.

- Drive technical solutions using BigQuery, Dataflow, Dataproc, Pub/Sub, and related GCP services.

- Design and optimize complex ETL/ELT workflows and distributed data processing solutions.

- Develop and review Python code and advanced SQL queries for performance, maintainability, and reliability.

- Establish standards for data pipeline development, testing, monitoring, and deployment.

- Optimize BigQuery workloads, query performance, resource utilization, and cloud costs.

- Lead technical discussions, architecture reviews, and solution design sessions.

- Mentor engineers, conduct code reviews, and drive engineering excellence across the team.

- Collaborate with enterprise architects, product owners, and business stakeholders to translate requirements into technical solutions.

- Manage technical risks, resolve complex production issues, and ensure adherence to security and governance standards.

- Support CI/CD implementation, automated testing, and DevOps practices for data engineering workloads.

Required Skills :

- 10-14 years of overall experience in data engineering, cloud data platforms, or related technologies.

- Strong hands-on expertise in GCP data engineering services, particularly BigQuery, Dataflow, Dataproc, and Pub/Sub.

- Advanced proficiency in Python and SQL.

- Proven experience designing enterprise-grade data pipelines and data processing architectures.

- Strong knowledge of batch processing, streaming, distributed computing, and data warehousing.

- Experience in technical leadership, code reviews, mentoring, and delivery ownership.

- Strong troubleshooting, performance optimization, and problem-solving skills.

- Excellent communication and stakeholder management capabilities

- -