Role Overview :

As a Data Engineering Manager, you will lead a team of talented data engineers in building and maintaining robust and scalable data pipelines and infrastructure.

You will collaborate closely with data scientists, product managers, and business stakeholders to understand their data needs and translate them into technical solutions.

Your work will directly impact the company's ability to make data-driven decisions, improve product performance, and enhance customer experiences.

Key Responsibilities :

- Lead and mentor a team of data engineers, fostering a culture of collaboration, innovation, and continuous improvement.

- Design, develop, and maintain scalable and reliable data pipelines using Python, PySpark, and AWS services to ingest, process, and transform large datasets.

- Collaborate with data scientists and business stakeholders to understand data requirements and translate them into technical specifications.

- Manage data engineering projects, ensuring timely delivery, adherence to quality standards, and alignment with business objectives.

- Implement and enforce data governance policies and procedures to ensure data quality, security, and compliance.

- Optimize data infrastructure for performance, scalability, and cost-efficiency.

- Stay up-to-date with the latest data engineering technologies and trends, and evaluate their potential application to our business.

Required Skillset :

- Demonstrated ability to lead and manage a team of data engineers, providing guidance, mentorship, and performance feedback.

- Proven expertise in designing, developing, and maintaining data pipelines using Python and PySpark.

- Strong proficiency in SQL and experience with relational databases.

- Hands-on experience with AWS cloud services, including S3, EC2, EMR, and Redshift.

- Excellent project management skills, with the ability to plan, execute, and monitor data engineering projects.

- Exceptional communication and interpersonal skills, with the ability to effectively collaborate with cross-functional teams.

- A Bachelor's or Master's degree in Computer Science, Engineering, or a related field.

- 8-15 years of relevant experience.