Role: SDE III Data Engineer

Location: Pune (Hybrid)

Employment Type: Contract (6 months)

Application Stack:

- Python/ PySpark

- Apache AirFlow

- Snowflake

- SQL Database

- MLOps

- Snowpark

- Azure/AWS Functions

- Blob Storage

- XML, JSON

- GitHub

Essentials for Being Successful in This Role:

- Minimum 5 years of experience in software development and system design.

- Minimum 2 years of experience as a Data Engineer focused on data modelling, governance, and platform administration.

- Expertise in Snowflake or similar MPP databases.

- Strong SQL skills.

- Experience with multiple database technologies (MSSQL, PostgreSQL, OLAP, OLTP).

- Familiarity with ETL/ELT tools and methodologies.

- Experience with database health monitoring, stored procedures, and schema design.

- Practical understanding of data governance principles.

- Experience with cloud environments (SaaS, PaaS, IaaS).

- Strong communication skills, both written and verbal.

- Experience in technical design and documentation.

- Proficiency with source control systems (Git, Gitflow).

- Experience with Agentic AI (Claude, GPT, etc.).

Desirables (Nice to Have):

- Familiarity with Generative AI and Spec-Driven Development.

- Experience with test automation.

- Experience with Kafka, Azure Event Hubs, Azure Service Bus.

- Knowledge of CI/CD practices.

- Ability to work independently and within Agile teams.

- Experience with Azure cloud services.

- Exposure to Master Data Management (MDM).

- Python skills for data transformation and pipeline automation.

- Understanding data mesh principles.

- Strong prioritization and multitasking abilities.

Roles & Responsibilities:

- Designing, building, testing, and maintaining scalable data models using Apache Airflow and Python.

- Administering Snowflake environments, monitoring system health and performance.

- Managing and optimizing Snowflake virtual warehouses for efficiency and cost-effectiveness.

- Managing the MLOps workflow through Snowflake registrations and Snowpark.

- Promoting self-service and decentralized data ownership across teams.

- Enforcing data governance policies to ensure standardization, quality, and compliance.

- Providing technical assistance and cross-training to team members.

- Participating in design sessions and creating technical design documents and diagrams.

- Conducting code reviews and offering constructive feedback.

- Mentoring engineers to support team growth and development.

- Collaborating with senior engineers in the Architecture Review Board.

- Ensuring delivery quality and supporting production services.