Description :

We are seeking experienced Data Engineering professionals with 4 - 6 years of hands-on expertise in Big Data technologies, with a focus on building scalable data solutions using Google Cloud Platform (GCP).

Key Skills & Experience :

- Proven expertise in PySpark (DataFrame and SparkSQL), Hadoop, and Hive

- Strong programming skills in Python and Bash

- Solid understanding of SQL and data warehousing concepts

- Demonstrated analytical and problem-solving abilities, particularly in data analysis and troubleshooting

- Innovative thinker with a passion for building efficient, scalable data solutions

- Excellent verbal and written communication skills, with the ability to work collaboratively across teams

Preferred/Good to Have :

- Experience with GCP services such as BigQuery, Dataflow, Dataproc, Cloud Storage, Pub/Sub, and IAM

- Familiarity with Airflow or other orchestration tools

- Exposure to cloud migration projects (on-prem to GCP or cloud-to-cloud)

Roles & Responsibilities :

- Design and develop robust and scalable ETL pipelines on GCP to meet business needs

- Ensure code quality and performance by adhering to development best practices and standards

- Perform integration testing and troubleshoot pipeline issues across environments

- Estimate efforts for development, testing, and deployment tasks

- Participate in code reviews and provide feedback to maintain high development standards

- Where applicable, design cost-effective data pipelines leveraging GCP-native services