Description : Data Engineer

Experience Level : 5- 6 years preferred (Mid to Senior level)

Joining Preference : Immediate Joiners Preferred

Job Summary :

We are seeking a highly skilled and experienced Data Engineer to join our team on-site in Pune.

The ideal candidate will have 5- 6 years of hands-on experience in designing, developing, and maintaining robust data pipelines and data warehousing solutions.

This role requires strong expertise in ETL processes, SQL Server, and a solid understanding of data APIs and modern data integration techniques, including GraphQL.

You will be instrumental in ensuring data quality, consistency, and availability to support critical business operations and analytical needs.

Key Responsibilities :

- Design, develop, implement, and optimize ETL (Extract, Transform, Load) processes to ingest, transform, and load data from various sources into our data warehouse and other data systems.

- Work extensively with SQL Server, including database design, writing complex queries, stored procedures, functions, and performance tuning for optimal data processing and retrieval.

- Build and maintain efficient data pipelines that ensure reliable and timely data delivery, leveraging various data integration tools and technologies.

- Implement and manage data mappings (RMI/VIPS) to ensure accurate and consistent data transformation and migration, maintaining data lineage and metadata.

- Develop and integrate with APIs, including understanding of RESTful services and GraphQL, to facilitate data exchange between systems and build robust data layers.

- Collaborate with data architects, data scientists, and business intelligence teams to understand data requirements and deliver scalable data solutions.

- Conduct thorough data quality checks and validation to ensure accuracy, completeness, and consistency of data throughout the pipelines.

- Troubleshoot and resolve complex data-related issues, identifying root causes and implementing effective solutions.

- Monitor data pipeline performance, identify bottlenecks, and implement optimizations for improved efficiency and reliability.

- Contribute to the design and development of data warehousing solutions, ensuring best practices in data modeling and schema design.

- Participate in code reviews, technical discussions, and contribute to the continuous improvement of data engineering processes and standards.

Required Skills and Qualifications :

- Bachelor's degree in Computer Science, Engineering, Information Technology, or a related field.

- 5- 6 years of preferred experience in a Data Engineer role, demonstrating a mid to senior level of expertise.

- Strong, hands-on experience with ETL processes and tools.

- Expertise in SQL Server, including advanced SQL querying, stored procedures, functions, and performance tuning.

- Solid understanding and practical knowledge of GraphQL, data pipelines, and API concepts.

- Proven experience with Data Mapping methodologies, specifically RMI/VIPS.

- Demonstrated ability to work with large datasets and complex data structures.

- Excellent analytical, problem-solving, and debugging skills.

- Strong communication and collaboration skills, with the ability to work effectively in an on-site team environment.

Additional Requirements :

- Hands-on experience required, not just theoretical knowledge.

- We are looking for individuals who can immediately contribute to development efforts.

- Immediate joiners preferred.

Preferred Skills :

- Experience with cloud data platforms including Azure Data Factory, AWS Glue, or Google Cloud Dataflow.

- Familiarity with scripting languages for data processing such as Python.

- Knowledge of data warehousing concepts and dimensional modeling.

- Experience with version control systems including Git.

- Understanding of data governance and data security principles