HamburgerMenu
hirist

Job Description

We are seeking an experienced Senior Engineer - Data Platform with a passion for building scalable, modular ELT/ETL systems. You will be central to developing and enhancing a platform designed to efficiently handle vast data volumes, ensuring quick and reliable data ingestion and processing. If you are a problem-solver, a team player, and have expertise in building and optimizing data pipelines


Key Responsibilities:


- Own and operate the end-to-end data pipeline platform, ensuring high availability and resilience.

- Design, develop, and deploy new ELT/ETL pipelines to meet evolving product requirements.

- Lead efforts to enhance the platform's architecture, targeting a 10x scalability increase.

- Proactively monitor, troubleshoot, and optimize pipeline performance, focusing on ingestion and processing efficiency.

- Collaborate effectively within a cross-functional team environment.


Qualifications :


- Bachelor's degree in CS, Engineering, or related field.

- 5+ years of experience focused on building and managing data pipelines and ELT systems.

- Strong Python programming skills applied to data engineering tasks.

- Mandatory hands-on experience with PySpark.

- Solid working knowledge of streaming technologies (Kafka/Pulsar) and caching (Redis).

- Familiarity with monitoring tools like Grafana and Prometheus.

- Good to have practical experience with Apache Flink.

- Proven ability to work independently and deliver results.


info-icon

Did you find something suspicious?