Responsibilities :

- Design, develop, and implement robust Big Data solutions using technologies such as Hadoop, Spark, and NoSQL databases.

- Build and maintain scalable data pipelines for effective data ingestion, transformation, and analysis.

- Collaborate with data scientists, analysts, and cross-functional teams to understand business requirements and translate them into technical solutions.

- Ensure data quality and integrity through effective validation, monitoring, and troubleshooting techniques.

- Optimize data processing workflows for maximum performance and efficiency.

- Stay up-to-date with evolving Big Data technologies and methodologies to enhance existing systems.

- Implement best practices for data governance, security, and compliance.

- Document technical designs, processes, and procedures to support knowledge sharing across teams.

Requirements :

- Bachelor's or Master's degree in Computer Science, Engineering, or a related field.

- 4+ years of experience as a Big Data Engineer or in a similar role.

- Strong proficiency in Big Data technologies (Hadoop, Spark, Hive, Pig) and frameworks.

- Extensive experience with programming languages such as Python, Scala, or Java.

- Knowledge of data modeling and data warehousing concepts.

- Familiarity with NoSQL databases like Cassandra or MongoDB.

- Proficient in SQL for data querying and analysis.

- Strong analytical and problem-solving skills.

- Excellent communication and collaboration abilities.

- Ability to work independently and effectively in a fast-paced environment.

Benefits :

- Competitive salary and benefits package.

- Opportunity to work on cutting-edge technologies and solve complex challenges.

- Dynamic and collaborative work environment with opportunities for growth and career advancement.

- Regular training and professional development opportunities.