Data Engineer - Scala

Job Description :

We are seeking a highly skilled and experienced Backend Engineer with strong proficiency in Scala or Python and a solid understanding of Microservices Architecture. The ideal candidate will have hands-on experience working with cloud-native technologies and a proven track record in designing and deploying scalable, low-latency systems.

Key Responsibilities :

- Develop and maintain high-performance backend systems using Scala or Python.

- Design and implement microservices-based architectures that are scalable and resilient.

- Work with Amazon Web Services (AWS) to build and manage cloud-native solutions.

- Leverage tools like Spark, Splunk, Docker, Grafana, and Prometheus for data processing, monitoring, and observability.

- Optimize system performance using efficient algorithms and data structures.

- Troubleshoot complex issues and contribute to overall system reliability.

- Write efficient SQL queries and interact with relational databases.

- Collaborate with cross-functional teams in an Agile environment to deliver end-to-end solutions.

Required Skills :

- Strong experience in Scala or Python programming.

- Solid understanding of microservices architecture and distributed systems.

- Proficient with AWS and cloud-native application development.

- Experience with Spark for data processing.

- Familiarity with Splunk, Docker, Grafana, and Prometheus for logging, containerization, and monitoring.

- Strong knowledge of algorithms, data structures, and system design.

- Good hands-on experience with SQL and working with large datasets.

- Ability to diagnose and resolve production issues efficiently.

Preferred Qualifications :

- Prior experience designing and deploying large-scale, low-latency systems on the cloud.

- Working knowledge of CI/CD pipelines and DevOps practices.

- Experience in performance tuning and security best practices for cloud systems.