BPK Tech - Lead Data Engineer - Python

Position : Lead Data Engineer

Experience range 10+ years

Primary Skills/Mandatory Skills : Snowflake, Python, DBT, Prefect, Git, AWS, Azure, Experience with data warehousing, and data modelling.

Job description :

We are seeking a talented and motivated Lead Data Engineer. You will be working closely with our Client Lead data engineer to perform data validation and build data pipelines.

Responsibilities :

- Design, develop, and maintain data pipelines and infrastructure

- Ensure data is clean, accurate, and accessible

- Build and maintain data warehouses, data lakes, and other data storage solutions

- Develop and maintain ETL processes

- Collaborate with other engineers, data architect, ETL developers, and stakeholders to ensure that our data infrastructure meets business needs.

- Stay up to date with the latest developments in data engineering and recommend new tools and techniques to improve our data infrastructure

Requirements :

- At least 3 years of experience using Snowflake

- At least 3 years of experience using DBT

- Strong knowledge of SQL, Prefect, DBT, Git

- Experience with cloud-based data storage solutions such as AWS

- Experience with data warehousing, data lakes, and data modelling

- Strong problem-solving skills and ability to work independently