Senior Data Engineer - Python/SQL

Role : Senior Data Engineer

Location : Remote (India)

Experience : 8+ Years

Key Responsibilities :

- Design batch & real-time data pipelines using Apache Iceberg, AWS (S3, Glue, Athena, EMR).

- Lead Oracle-to-cloud migration (schema translation, optimization).

- Implement real-time data ingestion (Kafka/Kinesis/Flink) and bi-directional sync.

- Build data abstraction layers (APIs, semantic layers) for secure access.

- Optimize Iceberg tables (partitioning, schema evolution).

- Use Presto/Trino for federated querying across data sources.

- Ensure data governance, security, and compliance in cloud environments.

- Collaborate with analysts, scientists, and engineers on scalable solutions.

Required Skills :

- 8+ years in data engineering.

- Strong Apache Iceberg, AWS (S3, Glue, EMR, Redshift).

- Hands-on real-time processing (Kafka/Kinesis/Flink).

- Oracle migration expertise (PL/SQL, performance tuning).

- SQL, Python, Spark, Presto/Trino.

- CI/CD, Terraform/CloudFormation.

Good to Have :

- Delta Lake/Hudi, Docker/Kubernetes.

- Oracle GoldenGate, ODI.

- Data mesh architecture.