Data Engineer - Python/Scala

Job Description :

Responsibilities :

- Build and maintain ingestion pipelines into AEP (batch, streaming, APIs).

- Map and transform source data (CRM, billing, OCS, channels) into XDM schemas.

- Ensure data quality, deduplication, and reconciliation across datasets.

- Optimize data pipelines for performance, scale, and cost efficiency.

- Support debugging of ingestion issues and coordinate fixes with Adobe/vendor teams.

- Document data pipelines, mappings, and transformation logic for sustainability.

Skills & Qualifications :

- Strong SQL, Python/Scala, and ETL/ELT development skills.

- Hands-on experience with APIs, JSON, Kafka, and cloud data platforms (AWS, Azure, GCP).

- Familiarity with Adobe AEP XDM schemas and Identity Service.

- Strong problem-solving and debugging ability.

- Experience in data quality frameworks and reconciliation processes.