Data Engineer - SQL/Python

Position Title : Data Engineer (Snowflake & Databricks)

Total Experience : 5-8 Years

Relevant Experience : 4-5 Years

Location : Bangalore, Hyderabad, Chennai

Notice Period : Immediate to 30Days only

Job Description :

- 4 to 5 years of experience in Snowflake with Databricks

- Experience working with large, heterogeneous data sets in building and optimizing data pipelines and solutions on the Databricks platform to support our data-driven initiatives

- Develop data set processes for data modeling and data mining purposes

- Proficiency in Python programming with a strong understanding of data processing frameworks.

- Strong knowledge of SQL and experience in relational and non-relational databases

- Experience in troubleshooting performance issues, identifying root cause and applying fixes.

- Ability to implement and manage CI/CD pipelines for data engineering projects, leveraging tools like Azure DevOps.

- Working experience with Salesforce data is a plus.

Roles & Responsibilities :

- Build data-intensive solutions that are highly available, scalable, reliable, secure, and cost-effective.

- Create and maintain highly scalable data pipelines, including the use Azure Databricks using Python.

- Design and build ETL / ELT data pipelines to extract and process data from a variety of external / internal data sources.

- Build data insights, data analytics, ML models, fraud and anomaly detection using Snowflake / Databricks

- Define, implement, and build jobs to populate data models and modern data solutions.

- Identify, design, and implement internal process improvements : automating manual -processes, optimizing data delivery.

- Relational and NoSQL database management

- Utilize applicable query languages to query data repositories.

- Build and utilize CI / CD pipelines within a DevOps framework.