- Strong expertise in Python (Advanced OOP, multithreading, data structures, exception handling).

- Hands-on experience with Apache Spark / PySpark.

- Strong working knowledge of Hive (HiveQL, partitions, performance tuning).

- Knowledge of Big Data technologies including :

o HDFS, YARN

o Kafka (optional but preferred)

o Airflow / Oozie / Luigi for workflow orchestration

o SQL and NoSQL databases

- Experience handling large-scale datasets in distributed environments.

- Understanding of CI/CD pipelines, Git, and containerization (Docker/Kubernetes is a plus).

- Familiarity with cloud environments (AWS, GCP, or Azure) is highly preferred.

Preferred Qualifications :

- Experience with AWS EMR, Glue, Lambda, S3, Athena, or equivalent cloud-native data services.

- Exposure to Machine Learning workflows is an added advantage.

- Bachelor's or Master's degree in Computer Science, Engineering, or related fields.

Soft Skills :

- Strong analytical and problem-solving abilities.

- Excellent communication and documentation skills.

- Ability to collaborate across teams in fast-paced environments.

- Leadership qualities to mentor junior developers (for senior-level roles).