Description :

Job Title : GCP Data Engineer Adobe Experience Platform Integration.

Experience : 8+ Years.

Location : Remote.

Employment Type : Contract (Freelancing).

Shift : General IST/UK Shift.

Roles and Responsibilities :

Project Overview :

This project aims to establish Google Cloud Platform (GCP) as the central data foundation layer for the integration of website (Hybris CMS) and offline (Instore SaaS, EDW, Loyalty, Rewards) data sources into Adobe Experience Platform (AEP).

The vendor will be responsible for building, configuring, and operationalizing the data pipelines, schemas, and integration components necessary for seamless data ingestion and activation.

Objectives :

- Design and deploy a scalable GCP architecture to support AEP integrations.

- Enable secure and automated data ingestion from multiple enterprise systems (Hybris, Oracle EDW, TAMS, etc.

- Standardize data using defined schema structures (Customer, Transaction, Product, Store, Custom).

- Facilitate incremental and historical data feeds to AEP using Adobe connectors.

- Ensure data governance, security, and monitoring best practices are implemented.

Scope of Work :

1 GCP Environment Setup :

- Configure GCP project structure, IAM roles, and service accounts.

- Set up secure networking, encryption, and audit logging policies.

- Deploy foundational services : BigQuery, Cloud Storage, Dataflow, and Pub/Sub.

2 Data Ingestion & Processing :

- Build data pipelines to ingest data from :

- Hybris CMS (Website data).

- Instore SaaS (Offline transactions).

- Oracle Database / Customer EDW.

- Loyalty & Rewards and TAMS systems.

- Implement both batch (historical) and streaming (near real-time) ingestion modes.

- Transform data into standardized structures and validate quality checks.

3 Schema Design & Data Modeling :

Develop and maintain schema definitions for :

- Customer Data.

- Transactions Data.

- Product Catalog.

- Store Metadata.

- Custom Business Schemas (if applicable).

- Maintain schema documentation aligned with AEP XDM (Experience Data Model) standards.

4 AEP Integration :

- Configure and validate AEP GCP Connector for BigQuery datasets.

- Support Adobe CJA, (AA) Source Connector, Web SDK, and Klaviyo integrations.

- Map Google BigQuery datasets to Adobe XDM Schemas through Datastream Mapping.

5 Monitoring & Automation :

- Deploy automated workflows for data refresh, validation, and schema updates.

- Configure alerts for failures, data delays, and schema mismatches.

- Implement logging and health dashboards using GCP Monitoring tools.

6 Documentation & Knowledge Transfer :

- Deliver architecture diagrams, pipeline workflows, and access management documentation.

- Conduct hands-on knowledge transfer sessions with internal data engineering and marketing teams.

Experience with Google analytics, Adobe Analytics clickstream data will be an additional advantage.