Engineer will be part of the datastore-migration Factory team that will be responsible to perform for the end-to-end datastore migration from on-prem DataLake to AWS hosted LakeHouse.

Key Responsibilities :

- Migrate data pipelines, logic, and scheduling from legacy systems to Lakehouse architecture.

- Move and validate datasets ensuring data integrity and accuracy.

- Convert and optimize SQL/Spark-based workloads for Snowflake and Iceberg.

- Analyze data usage patterns to support correct data product design.

- Perform data reconciliation and ensure functional equivalence with production systems.

- Collaborate with business and technical stakeholders for sign-off and delivery.

- Work with platform teams to support new workflows and tools.

- Support CI/CD, deployment, and Kubernetes-based environments.

- Ensure data quality, performance, and scalable design practices.

Required Skills :

- Minimum 35 years experience in data engineering or software development.

- Strong coding skills in Python or Java.

- Strong SQL and data troubleshooting experience.

- Experience with Spark, Kafka, and distributed data systems.

- Knowledge of Hadoop, Snowflake, and data formats (Parquet, JSON, Avro).

- Understanding of CI/CD pipelines and SDLC practices.

- Basic exposure to Kubernetes and cloud environments.

Good to Have :

- Experience with Apache Iceberg and schema evolution.

- Knowledge of temporal data modeling (SCD Type 2).

- Understanding of data partitioning, clustering, and performance tuning.

- Familiarity with Sybase IQ or similar legacy platforms.

- Strong stakeholder communication and global team collaboration skills.