Job Title : Data Engineer (Engineering Lead - Python/Data Management)

Job Description :

Strong programming skills in Python and SQL.

- Strong experience in AWS, GCP or Azure

- Should have implemented Microservices

- Hands-on API Development and Management

- Experience with data processing leveraging programming skills in Python and Spark

- In-depth understanding of the Kafka platform for (real-time) data ingestion and processing of high-volume data.

- Implement and troubleshoot data flows, data management in Cloud environment which are scalable, repeatable and eliminate time consuming steps.

- Clear skills in using version control systems like GIT and developing (technical) documentation (e.g., in WIKI).

- Experience in Infrastructure as Code for robust deployment, replication, and uniform management

- Effective collaboration and communication skills to engage with and lead teams

- A proactive mindset with the ability to drive tasks to completion

- Agile/Scrum/Kanban methodologies for efficient product execution and management.

Job Summary :

- Bachelor or Master's degree in Computer Science/Information Systems

- Proven experience in leading and managing teams.

- At least 7+ years of experience in building data flows and data management on modern big data tech stack

- Strong experience in using ETL framework (eg. Airflow, Jenkins, databricks/DBT/AWS Glue) to build and deploy production-quality ETL pipelines

- Knowledge of data structures.

- Open to learn and implement new technologies

- Ability to think and perform data engineering workstreams with a product mindset Skills.