Role : Senior Data Engineer - Hybrid Chennai

Role Overview :

We are seeking an experienced Senior Data Engineer to support a strategic SAP HANA to Snowflake Data Platform Modernization initiative. The ideal candidate should possess strong expertise in cloud data engineering, ELT/ETL pipeline development, data modeling, and Snowflake architecture.

The Senior Data Engineer will be responsible for designing and validating scalable data ingestion and transformation frameworks, building proof-of-concept pipelines, establishing cloud-native engineering patterns, and collaborating with Data Architects, SAP HANA SMEs, BI teams, and business stakeholders to deliver a robust migration strategy. The role requires hands-on experience in designing enterprise data platforms using modern cloud technologies and Medallion Architecture.

Key Responsibilities :

- Design and develop scalable ELT/ETL pipelines to migrate data from SAP HANA to Snowflake.

- Build Proof of Concepts (PoCs) to validate migration approaches, performance, and scalability.

- Design and implement Medallion Architecture (Bronze, Silver, Gold) for enterprise data platforms.

- Develop historical and incremental data loading frameworks using Change Data Capture (CDC) strategies.

- Create reusable transformation logic using SQL, Python, PySpark, and dbt.

- Design and optimize Snowflake objects including databases, schemas, virtual warehouses, stages, streams, tasks, and Snowpipe.

- Implement Slowly Changing Dimensions (SCD Type 1 & Type 2) and dimensional modeling techniques.

- Perform data profiling, data validation, reconciliation, and quality assessments.

- Optimize SQL queries, ELT processes, and Snowflake compute/storage usage for performance and cost efficiency.

- Evaluate and recommend data ingestion and orchestration tools such as dbt, Matillion, Fivetran, Azure Data Factory, AWS Glue, or Apache Airflow.

- Collaborate with Data Architects and SAP HANA SMEs to define source-to-target mappings and transformation strategies.

- Produce technical design documents, engineering standards, and implementation guidelines.

- Mentor Data Engineers and participate in architecture reviews, code reviews, and Agile ceremonies.

Required Skills :

- Strong experience in Snowflake architecture, SQL, Snowpipe, Streams & Tasks, Virtual Warehouses, and performance optimization.

- Hands-on expertise in SQL, Python, and PySpark for building scalable data pipelines.

- Experience in ETL/ELT development, data transformation, and Change Data Capture (CDC).

- Proficiency with dbt and exposure to tools such as Matillion, Fivetran, Azure Data Factory, AWS Glue, or Apache Airflow.

- Strong understanding of Medallion Architecture, dimensional data modeling, and SCD Type 1 & Type 2.

- Experience working with SAP HANA and migrating data to cloud data platforms such as Snowflake.

- Knowledge of cloud platforms (AWS, Azure, or GCP) and cloud storage services.

- Familiarity with Git, Azure DevOps, Jira, and Confluence.

- Excellent analytical, problem-solving, communication, and stakeholder collaboration skills.

Preferred Qualifications :

- Bachelor's degree in Computer Science, Information Technology, Engineering, or a related discipline.

- Experience implementing enterprise-scale Snowflake solutions.

- SnowPro Core Certification or equivalent is preferred.

- Cloud certification (AWS, Azure, or GCP) is an added advantage.

- Experience working in Agile/Scrum environments.

Project-Specific Expectations :

The Senior Data Engineer will support the project by designing and validating the target data engineering framework and should :

- Design scalable ELT pipelines for SAP HANA to Snowflake migration.

- Build prototype pipelines to validate migration strategies and architecture.

- Implement Medallion Architecture and cloud-native engineering best practices.

- Develop reusable transformation logic using SQL, Python, PySpark, and dbt.

- Define CDC strategies, historical load frameworks, and incremental processing mechanisms.

- Collaborate with Data Architects, SAP HANA Leads, and BI teams to ensure migration readiness.

- Produce implementation-ready technical documentation, engineering standards, and migration recommendations.

Nice to Have :

- Experience with Snowpark.

- Knowledge of AI/ML data engineering concepts.

- Exposure to Large Language Models (LLMs), Prompt Engineering, or Retrieval-Augmented Generation (RAG).

- Experience implementing DataOps or CI/CD pipelines for data platforms.

- Experience working with globally distributed teams.