Senior Data Engineering Manager - Python/Scala/SQL

Description :

Responsibilities :

- Lead, mentor, and grow a team of data engineers.

- Set clear goals, provide regular feedback, and manage performance.

- Foster a collaborative, high-performing engineering culture.

- Architect and implement robust, scalable data pipelines and ETL processes.

- Drive the development of data models, data lakes, and data warehouses.

- Partner with data scientists, analysts, and software engineers to deliver high-quality data solutions.

- Collaborate with cross-functional teams to understand business needs and translate them into technical requirements.

- Manage project timelines, prioritise tasks, and ensure timely delivery.

- Ensure compliance with data governance and security policies.

- Establish best practices for data engineering, including testing, version control, and documentation.

- Evaluate and integrate new technologies and tools as appropriate.

- Continuously improve system performance, cost, and scalability.

Requirements :

- Bachelor's or Master's degree in Computer Science, Engineering, or a related field.

- 9+ years of experience in data engineering or software engineering.

- 2+ years of experience in a leadership or managerial role.

- Expertise in SQL and data modelling.

- Strong proficiency in Python, Scala, or Java.

- Experience with data pipeline orchestration tools (e. g., Airflow).

- Familiarity with big data technologies (e. g., Spark, EMR).

- Experience with cloud platforms (e. g., AWS) and services like S3 Redand shift.

- Solid understanding of data warehousing concepts and real-time data streaming (e. g., Kafka).

- Excellent communication and interpersonal skills.

- Strong problem-solving skills and attention to detail.

- Ability to balance technical leadership with people management.