Senior Software Engineer - Big Data Platform

About the Role :

We are seeking a Senior Software Engineer Big Data Platform Engineer to design, develop, and optimize large-scale data processing systems.

You will work with high-volume, high-velocity datasets and ensure the platforms scalability, performance, and reliability.

This role requires expertise in big data frameworks, distributed systems, and data engineering best practices.

Key Responsibilities :

- Design and implement big data solutions for large-scale data processing and analytics.

- Develop and maintain data pipelines using big data frameworks such as Hadoop, Spark, Kafka, or Flink.

- Work closely with data scientists, analysts, and product teams to deliver reliable and efficient data infrastructure.

- Optimize data storage, processing, and retrieval for high performance.

- Ensure data quality, governance, and security standards are met.

- Troubleshoot and resolve issues related to big data processing and platform infrastructure.

- Participate in architecture design and contribute to technical decision-making.

Required Skills & Qualifications :

- Experience : 58 years in software engineering, with at least 3 years in big data engineering.

- Proficiency in big data technologies : Hadoop, Spark, Hive, HBase, Kafka, Flink.

- Strong skills in programming languages : Java, Scala, or Python.

- Experience with distributed systems, parallel computing, and performance optimization.

- Knowledge of cloud-based big data platforms (AWS EMR, Azure HDInsight, GCP Dataproc) is a plus.

- Strong understanding of data modeling, ETL, and data warehousing concepts.

- Excellent problem-solving skills and ability to work in agile teams.

Preferred Attributes :

- Experience with real-time streaming and event-driven architectures.

- Exposure to containerization and orchestration tools like Docker, Kubernetes.

- Knowledge of CI/CD pipelines for data engineering workflows