Data Engineer - Google Cloud Platform

Responsibilities :

- Design, develop, and maintain scalable data pipelines and ETL processes on Google Cloud Platform (GCP).

- Work extensively with BigQuery for data modeling, query optimization, and large-scale data processing.

- Build and manage data integration workflows using Python and automation scripts.

- Write and optimize complex SQL queries for analytics, reporting, and data transformations.

- Manage and maintain structured and unstructured data in PostgreSQL and MongoDB.

- Ensure data accuracy, consistency, and availability across multiple systems.

- Collaborate with data scientists, analysts, and stakeholders to understand business requirements and deliver reliable data solutions.

- Implement data quality checks, monitoring, and performance improvements.

- Ensure compliance with security, privacy, and governance standards in data handling.

- Proven experience as a Data Engineer with strong expertise in Google Cloud Platform (GCP) services.

- Hands-on experience with BigQuery (data modeling, partitioning, performance tuning).

- Proficiency in Python for data engineering, automation, and scripting.

- Strong knowledge of SQL with the ability to write complex queries and optimize performance.

- Experience working with PostgreSQL and MongoDB databases.

- Solid understanding of data warehouse concepts, ETL pipelines, and real-time/streaming data solutions.

- Experience with version control (Git), CI/CD pipelines, and cloud-native tools.

- Strong problem-solving skills and ability to work in a collaborative environment.

- Bachelor's degree in Computer Science, Information Technology, or related field (or equivalent work experience).

- Experience with data orchestration tools (e. g., Airflow, Luigi, Dataflow).

- Familiarity with containerization and orchestration (Docker, Kubernetes).

- Exposure to data visualization or BI tools (e. g., Looker, Tableau, Power BI).