Senior Data Engineer - Snowflake DB

Job Description :

Essential Skills & Experience :

Snowflake :

- Minimum of 5 years of experience is preferred.

- Familiarity with virtual data warehouses.

- Experience with Snowpipe.

- Understanding of Snowflake scaling behaviors.

DBT (Data Build Tool) :

- Minimum of 1.5 years of experience is required.

- Basic understanding of DBT concepts, including creating models, setup, and testing.

- Candidates with 5 years of Snowflake experience and basic DBT knowledge are still considered good fits, as DBT is a new technology for the team.

SQL :

- Strong SQL skills are crucial, ranging from basic transformations to complex queries.

- Candidates must be comfortable finding solutions independently when encountering unfamiliar query formats or issues (e.g., searching for solutions online and testing them).

- An independent mindset is highly valued.

SSIS Packages :

- Ability to reverse engineer SSIS packages to understand their functionality.

- Experience in optimizing and rewriting SSIS package logic in Snowflake (e.g., converting a 15-step SSIS process into a single step in Snowflake).

- This requires strong data modeling skills.

- Data Competency : High data competency is essential.

- Communication Skills : Good communication skills are required.

- Solutioning & Documentation : Experience in both solutioning and documentation.

Desired (Nice-to-Have) Skills :

- Python : Any experience with Python.

- PySpark : Any exposure to PySpark.

- Analysis/Requirement Gathering : While not a primary requirement, the individual will be given opportunities to drive analysis if they demonstrate the competency and confidence. Onshore resources typically handle most analysis and business-facing tasks.

Other Important Points :

Data Modeling :

- Implicitly required due to the 5 years of Snowflake experience and the need to reverse engineer SSIS packages and rewrite them efficiently in Snowflake.

- Candidates are expected to have driven data modeling conversations and potentially smaller-scale data model designs in their past roles.

Cloud Experience :

- Any cloud experience (AWS or Azure) is acceptable, as the interviewer believes that once familiar with one cloud environment, learning another is straightforward.

- There is no specific preference for Azure.