Mandatory Skills :

- Google Cloud Platform (GCP)

- Scala

- Data Engineering

- BigQuery

- Apache Spark

- Cloud Dataflow

- Apache Beam

- SQL

- ETL/ELT Pipelines

- Git

Job Summary:

We are looking for a skilled Data Engineer - Data Platforms (Google Cloud | Scala) to design, develop, and optimize scalable data platforms and pipelines on Google Cloud Platform (GCP). The ideal candidate should have strong expertise in Scala, distributed data processing, cloud-native technologies, and modern data engineering practices.

You will work closely with data architects, analysts, and cross-functional teams to build reliable, high-performance data solutions that support business intelligence, analytics, and machine learning initiatives.

Key Responsibilities:

- Design, develop, and maintain scalable data pipelines using Scala and Google Cloud Platform (GCP).

- Build batch and streaming data processing solutions using Apache Spark, Cloud Dataflow, and Apache Beam.

- Develop and optimize data models and datasets in BigQuery.

- Design and implement robust ETL/ELT workflows for structured and unstructured data.

- Integrate data from multiple internal and external sources.

- Optimize data processing performance, scalability, and cost on GCP.

- Ensure data quality, governance, security, and compliance across data platforms.

- Monitor, troubleshoot, and resolve production data pipeline issues.

- Collaborate with Data Scientists, Data Analysts, DevOps Engineers, and Product teams.

- Participate in Agile ceremonies, sprint planning, code reviews, and technical discussions.

Required Skills :

- Strong hands-on experience with Google Cloud Platform (GCP).

- Excellent programming skills in Scala.

- Experience with Apache Spark for large-scale data processing.

- Strong knowledge of BigQuery, Cloud Storage, and Cloud Dataflow.

- Experience building batch and real-time data pipelines.

- Strong SQL skills and experience with relational databases.

- Knowledge of Apache Beam and event-driven data processing.

- Experience with version control systems such as Git.

- Understanding of CI/CD pipelines and DevOps practices.

- Familiarity with data modelling, data warehousing, and distributed systems.

- Strong analytical and problem-solving skills.

Preferred Qualifications :

- Bachelor's or Master's degree in Computer Science, Information Technology, Engineering, or a related field.

- Google Cloud Professional Data Engineer certification is a plus.

- Experience with Airflow, Dataproc, Pub/Sub, or Kafka is an advantage.

- Knowledge of Python or Java is desirable.

- Experience working in Agile/Scrum environments.

- Excellent communication and collaboration skills.