About the Role :

We are seeking a highly skilled Senior Software Engineer with deep expertise in big data technologies, including Apache Spark and Apache Airflow. This hybrid position bridges software engineering and data engineering, requiring the ability to design, build, and maintain scalable systems for both application development and large-scale data processing.In this role, you will collaborate with cross-functional teams to architect and manage robust, production-grade data products and APIs that power critical capabilities across the advertising platform. You will work with technologies such as Apache Spark, Apache Airflow, ScyllaDB/Cassandra, Aerospike, Kubernetes, and SpringBoot to deliver reliable, high-performance solutions. The ideal candidate is a proactive, self-motivated professional with a strong track record in building high-scale data services and a dedication to delivering exceptional results.

What Youll Be Doing :

Software Development :

- Design and build APIs and backend services using Spring Boot to support data products and audience management workflows.

- Write clean, maintainable, and efficient code, ensuring adherence to best practices through code reviews.

Big Data Engineering :

- Design, develop, and maintain data pipelines and ETL workflows using Apache Spark and Apache Airflow.

- Optimize data storage, retrieval, and processing systems to ensure reliability, scalability, and performance.

- Develop and fine-tune complex queries using Apache Spark for large-scale datasets.

- Monitor, troubleshoot, and improve data systems to minimize downtime and maximize efficiency.

API and Platform Development :

- Design, Development, and maintain large scale, low latency API systems using SpringBoot and Kubernetes

- Maintain NoSQL Infrastructure including ScyllaDB and Aerospike

Collaboration & Mentorship :

- Partner with the machine learning team, software engineers, and other teams to deliver integrated, high-quality solutions.

- Provide technical guidance and mentorship to junior engineers, promoting best practices in software and data engineering.

Were Excited If You Have :

- Bachelor's degree in computer science, Engineering, or a related field (or equivalent experience).

- 8+ years of experience in software and/or data engineering with expertise in big data technologies such as Apache Spark, Apache Airflow.

- Expertise in developing low latency APIs

- Strong understanding of SOLID principles and distributed systems architecture.

- Proven experience in distributed data processing, data warehousing, and real-time data pipelines.

- Advanced SQL skills, with expertise in query optimization for large datasets.

- Exceptional problem-solving abilities and the capacity to work independently or collaboratively.

- Excellent verbal and written communication skills.

- Experience with cloud platforms such as AWS, GCP, or Azure, and containerization tools like Docker and Kubernetes. (preferred)

- Experience in AdTech, in advertising data platforms and audience management. (preferred)

- Strong programming skills in Python, Java, and/or Scala. (preferred)