Role : GCP & Hadoop Data Engineer

Mandatory Skills :

Must have good experience in below tech stack :

- Hadoop

- Hive

- HDFS

- Apache Spark

- Scala

- GCP

- Jenkins

- Airflow

- SQL

Hands-on experience on Data Migration and Data Processing on the Google Cloud stack, specifically :

- BigQuery

- Cloud Dataflow

- Cloud Dataproc

- Cloud Storage

- Cloud Dataprep

- Cloud Pub/Sub

- Cloud Composer & Airflow

- Must have understanding of Scala.

- Experience designing and deploying large-scale distributed data processing systems with technologies such as PostgreSQL or equivalent databases, SQL, Hadoop, Spark, Tableau.

- Proven ability to define and build architecturally sound solution designs.

- Demonstrated ability to rapidly build relationships with key stakeholders.

- Experience of automated unit testing, automated integration testing, and a fully automated build and deployment process as part of DevOps tooling.

- Must have the ability to understand and develop the logical flow of applications at a technical code level.

- Strong interpersonal skills and ability to work in a team and in global environments.

- Should be proactive, have a learning attitude, and adapt to work in dynamic work environments.

- Exposure to Enterprise Data Warehouse technologies.

- Exposure in a customer-facing role working with enterprise clients.

- Experience with industry-standard version control tools (Git, GitHub), automated deployment tools (Ansible & Jenkins), and requirement management in JIRA.

- Exposure to DevOps & Agile Project methodologies such as Scrum and Kanban.

- Understanding of big data modelling techniques using relational and non-relational techniques.

- Experience in debugging code issues and publishing the highlighted differences to the development team/architects.

- Understanding of or experience with Cloud design patterns.

- Good to have Google Cloud Certification.