Description :

AI And DATA - Snowflake - Senior

As part of our EY-GDS D&A (Data and Analytics) team, we help our clients solve complex business challenges with the help of data and technology. We dive deep into data to extract the greatest value and discover opportunities in key business and functions like Banking, Insurance, Manufacturing, Healthcare, Retail, Manufacturing and Auto, Supply Chain, and Finance.

Location : Only Coimbatore (Face to Face Interview)

Experience : 3 to 8years

Job description :

Your key responsibilities :

- Develop & deploy big data pipelines in a cloud environment using Snowflake cloud DW

- ETL design, development and migration of existing on-prem ETL routines to Cloud Service

- Interact with senior leaders, understand their business goals, contribute to the delivery of the workstreams

- Design and optimize model codes for faster execution

Skills and attributes for success :

- Hands on developer in the field of data warehousing, ETL

- Hands on development experience in Snowflake.

- Experience in Snowflake modelling - roles, schema, databases.

- Experience in Integrating with third-party tools, ETL, DBT tools

- Experience in Snowflake advanced concepts like setting up resource monitors and performance tuning would be preferable

- Applying object-oriented and functional programming styles to real-world Big Data Engineering problems using Java/Scala/Python

- Develop data pipelines to perform batch and Real - Time/Stream analytics on structured and unstructured data.

- Data Ingress, Egress, Querying using Kafka, NiFi

- Deep understanding of AWS S3, Lambda, EMR, Glue

- Data processing patterns, distributed computing and in building applications for real-time and batch analytics.

- Handling large data sets and perform data wrangling, analysis, etc., using various SQL & NoSQL database technologies, and programming languages such as Java/Scala/Python

- Good understanding of different file format (ORC, Parquet, AVRO) to optimize queries/processing and compression techniques

- Have knowledge and skills in DevOps and containerization. Preferable - having deployment knowledge