Big Data Engineer - ETL/Python

Description :

- Big Data Developer

- Focus: Building applications and solutions

- Writes code and develops software applications that process big data

- Creates data-driven applications and analytical tools

- Focuses on implementing business logic and algorithms

- Build backend services and APIs to facilitate secure and efficient data exchange.

Key Responsibilities :

- Develop data processing applications using Spark, Hadoop

- Write MapReduce jobs and data transformation logic

- Implement machine learning models and analytics solutions

- Code optimisation and debugging

- Hands on experience into Databricks

- Hands on experience on Airflow

- Hands-on experience on any Ci/cd tools ( jenkins preferred)

Primary Skills :

- Programming languages (Scala, Python programming )

- Spark,

- Data structures and algorithms

- Application development

- Software development best practices