Natobotics - Snowflake Data Engineer - Python/ETL

Description :

Job Title : Snowflake Data Engineer

Experience : 7 to 9 years

Key Responsibilities :

- Data Solution Design :

- Create and implement data warehouses, data lakes, and robust data models on the Snowflake platform.

- ETL/ELT Pipeline Development :

- Design, develop, and optimize pipelines for extracting, transforming, and loading data from diverse sources.

- Performance Tuning & Optimization :

- Utilize Snowflake features such as micro-partitions, clustering, and virtual warehouses to enhance scalability and performance.

- Data Modeling :

- Design and maintain efficient data models and stored procedures to support reporting and analytics.

- SQL Expertise :

- Write complex, optimized SQL queries for data transformation, manipulation, and analytics.

- Data Security & Governance :

- Implement and manage security measures including Role-Based Access Control (RBAC) and encryption to maintain compliance.

- Semi-structured Data Handling :

- Work with JSON, XML, and Parquet using Snowflakes VARIANT attribute for flexible data storage.

- Migration :

- Develop strategies and execute migrations from on-premises databases or other platforms to Snowflake.

- Collaboration & Mentorship :

- Work with data engineers, analysts, and business stakeholders to translate requirements into technical solutions.

- Provide guidance and mentor junior developers to foster best practices and team development.

- Documentation :

- Maintain technical specifications, deployment procedures, and knowledge sharing materials for the team.

Required Skills & Tools :

- Snowflake Platform :

- Expert in Snowflake architecture, features, and functionalities.

- SQL :

- Advanced proficiency in writing complex and optimized queries.

- Data Modeling :

- Strong understanding of data warehousing, star schema, and dimensional modeling.

- ETL/ELT Tools :

- Experience with dbt, Snowpark, PySpark, or AWS Glue for pipeline automation.

- Programming :

- Proficiency in Python for data processing and automation.

- Cloud Platforms :

- Familiarity with AWS or other cloud services for scalable solutions.

- BI Tools :

- Tableau, Power BI, or similar tools for analytics and visualization.

- Version Control :

- Experience with Git or other version control systems.

Primary Skills :

- Liaise and communicate effectively with senior technical stakeholders.

- Perform analysis and data modeling required in Snowflake.

- Estimate implementation efforts and define technical plans.

- Lead and manage the implementation team (Data Engineers and Qlik report developers) on a day-to-day basis.

- Ensure deliverables meet quality, performance, and scalability standards