As a Data Engineering Tech Lead, you will be working on developing ETL/ELT code using Python, Big Query, and GCP. You will work with a dedicated business, offshore development team and follow a Scrum process to develop SQL and Python code to get the data from different source systems and transform this data in a centralized Transformed Data Zone in a way that is easily consumable by the business for Brady Corporation and various other brands owned by the company.

Project Description :

As a Member of the Data & Analytics team, youll work on transforming data from multiple sources into useful, consistent and easily consumable data elements. Youll strive to continuously improve the data lake and data warehouse and achieve our goals of a best-in-class data platform.

Tech Stack & Requirements :

- SQL, Python, BigQuery, GCP experience is a must.

- Develop and unit test data pipelines, database views, functions, and stored procedures to extract data from various sources and transform it within the Transformed Data Zone to meet business needs.

- Monitor execution of jobs and fix the failures.

Responsibilities :

- Develop SQL/BigQuery/Python code or data flow to integrate and transform data from multiple sources.

- Design and build tables in the Cloud Data Warehouse tailored to business requirements, transforming raw sources into standardized, consistent, and easily accessible data elements.

- Understand warehouse concepts and dimensional data models.

- Work on Unit Testing/Data validation and scheduling of data pipelines, DB views, functions, and stored procedures.

- Provide ongoing enhancement and support for data pipelines in the production environment.

- Work on getting the data from different source systems using Python, APIs, etc.

- Work closely with the business analysts and fellow team members to discuss the requirements, come up with the solution, and implement it.

- Follow the Scrum process and participate in all Scrum ceremonies.

- Take ownership of independent stories or modules.

Minimum Qualifications :

- BE/MCA/B.Sc or M.Sc degree in Computer Science or a related field.

- 8-10 years of hands-on experience developing ETL code using Informatica IICS/GCP/BigQuery.

- 8-10 years of hands-on experience developing SQL code, DB views, functions, and stored procedures.

- Extensively worked on Python development.

- Exposure to scheduling, monitoring, and rerunning jobs (Airflow & Control-M Preferred).

- Hands-on experience with relational, dimensional, and unstructured databases.

- Strong communication and problem-solving skills.

- Ability to contribute independently.