Role Overview :

As a GCP Data Engineer, you will be at the forefront of building and maintaining robust data pipelines and infrastructure on the Google Cloud Platform. Your day-to-day will involve designing, developing, and deploying scalable data solutions, working closely with data scientists, analysts, and business stakeholders to understand their data needs and translate them into efficient and reliable systems. You will collaborate with cross-functional teams to ensure data quality, security, and compliance. Your work will directly impact the business by enabling data-driven decision-making, improving operational efficiency, and driving innovation through advanced analytics.

Key Responsibilities :

- Design and implement scalable and reliable data pipelines using Google Cloud Platform services like Dataflow, Data Fusion, and Cloud Composer to ingest, process, and transform large datasets for various analytical and operational needs.

- Develop and maintain data warehouses and data lakes using BigQuery and Cloud Storage to provide a centralized and accessible repository for structured and unstructured data.

- Optimize data processing and storage solutions for performance and cost-effectiveness to ensure efficient utilization of GCP resources.

- Implement data quality checks and monitoring systems to ensure data accuracy, completeness, and consistency across all data pipelines and storage solutions.

- Collaborate with data scientists and analysts to understand their data requirements and provide them with the necessary data infrastructure and tools to perform advanced analytics and machine learning.

- Automate data infrastructure deployment and management using Infrastructure-as-Code (IaC) principles to improve efficiency and reduce manual effort.

- Troubleshoot and resolve data-related issues to ensure the smooth operation of data pipelines and data warehouses.

- Implement and maintain data security and access control policies to protect sensitive data and comply with regulatory requirements.

Required Skillset :

- Demonstrated ability to design, develop, and deploy data pipelines and data warehouses on Google Cloud Platform using services like BigQuery, Dataflow, Data Fusion, Dataproc, Cloud Composer, and Cloud Storage.

- Proven expertise in ETL processes, data modeling, and data warehousing concepts.

- Strong proficiency in programming languages such as Python or Java for data processing and automation.

- Ability to write complex SQL queries for data extraction, transformation, and loading.

- Excellent problem-solving and analytical skills with a strong attention to detail.

- Effective communication and collaboration skills to work with cross-functional teams and stakeholders.

- Bachelor's or Master's degree in Computer Science, Engineering, or a related field.

- 6 -12 years of experience in data engineering or a related field.