Description :

Role Overview :

WillWare Technologies is seeking an experienced Technical Lead GCP / Databricks to drive and lead data engineering initiatives across cloud-native platforms. This role requires deep hands-on expertise in Google Cloud Platform (GCP) and Databricks, along with the ability to mentor teams, design scalable data architectures, and collaborate closely with stakeholders to deliver high-impact data solutions.

Key Responsibilities :

- Lead the design, development, and deployment of scalable data engineering solutions on GCP and Databricks.

- Architect and optimize data pipelines using PySpark on Databricks.

- Implement and manage data governance using Databricks Unity Catalog.

- Ensure high-quality code through unit testing frameworks for PySpark and data pipelines.

- Automate cloud infrastructure provisioning using Terraform.

- Design and implement ETL / ELT pipelines and data warehousing solutions.

- Collaborate with architects, product owners, and stakeholders to define technical solutions.

- Mentor and guide data engineers, ensuring best practices and technical excellence.

- Participate in code reviews, architecture reviews, and technical decision-making.

- Ensure performance, scalability, reliability, and security of data platforms.

- Support production deployments and ongoing optimization initiatives.

Required Skills & Qualifications :

- 8+ years of experience in data engineering and cloud technologies.

- Strong hands-on experience with Google Cloud Platform (GCP).

- Extensive experience with Databricks and PySpark.

- Hands-on expertise with Databricks Unity Catalog for data governance.

- Strong knowledge of unit testing frameworks for PySpark and data pipelines.

- Experience with Terraform for infrastructure automation.

- Solid understanding of data warehousing concepts, ETL/ELT, and big data architectures.

- Excellent communication skills (verbal and written).

- Proven leadership and team-handling experience.

- Ability to work independently in a remote delivery environment.

Good to Have-

- Experience with CI/CD pipelines for data engineering.

- Exposure to streaming technologies (Kafka, Pub/Sub).

- Knowledge of data security and compliance best practices.

- Experience working in Agile / Scrum environments.

Why Join WillWare Technologies?-

- Lead enterprise-scale data platforms using modern cloud technologies.

- Fully remote role with high ownership and visibility.

- Opportunity to mentor teams and shape data architecture strategy.

- Collaborative and growth-focused work culture.