Data Engineer

Description :

Job Description :

Seeking a talented Individual to join our analytics and engineering team, focusing on building scalable data processing solutions using Java, Scala, or Kotlin, Apache Spark, and SQL. This role involves collaborating with cross-functional teams to design, implement, and optimize big data pipelines and backend systems for high-volume, real-time and batch processing.

Key Responsibilities :

- Develop robust, scalable, and efficient data pipelines using Java, Scala, or Kotlin with Apache Spark for batch and streaming data.

- Write optimized SQL queries for data extraction, transformation, and loading across various data platforms.

- Integrate with cloud and on-premise data sources, ensuring data quality, consistency, and reliability.

- Collaborate with product, data science, and analyst teams to deliver end-to-end data solutions.

- Participate in code reviews, test automation, and continuous integration practices.

- Troubleshoot, monitor, and improve existing data processing applications for performance and reliability.

Required Skills & Qualifications :

- 5+ years hands-on experience in solutions using Java, Scala, or Kotlin.

- Deep understanding of Spark for large-scale data processing and analytics.

- Advanced SQL skills for querying and manipulating large datasets.

- Solid grasp of software engineering principles and design patterns.

- Familiarity with version control (Git), Agile development methodologies, and CI/CD pipelines.

- Experience with data warehousing, ETL, and big data tools (Hadoop, Hive, etc.) is a plus.

Preferred Qualifications :

- Exposure to cloud data platforms (AWS, GCP, Azure) and containerization (Docker, Kubernetes).

- Knowledge of additional JVM languages and frameworks.

- Strong problem-solving, analytical, and communication skills.

- Experience working in a highly collaborative and fast-paced environment.