Description :

- Design, develop, implement, and optimize ETL (Extract, Transform, Load) processes to ingest, transform, and load data from various sources into our data warehouse and other data systems.

- Work extensively with SQL Server, including database design, writing complex queries, stored procedures, functions, and performance tuning for optimal data processing and retrieval.

- Build and maintain efficient data pipelines that ensure reliable and timely data delivery, leveraging various data integration tools and technologies.

- Implement and manage data mappings (RMI/VIPS) to ensure accurate and consistent data transformation and migration, maintaining data lineage and metadata.

- Develop and integrate with APIs, including understanding of RESTful services and GraphQL, to facilitate data exchange between systems and build robust data layers.

- Collaborate with data architects, data scientists, and business intelligence teams to understand data requirements and deliver scalable data solutions.

- Conduct thorough data quality checks and validation to ensure accuracy, completeness, and consistency of data throughout the pipelines.

- Troubleshoot and resolve complex data-related issues, identifying root causes and implementing effective solutions.

- Monitor data pipeline performance, identify bottlenecks, and implement optimizations for improved efficiency and reliability.

- Contribute to the design and development of data warehousing solutions, ensuring best practices in data modeling and schema design.

- Participate in code reviews, technical discussions, and contribute to the continuous improvement of data engineering processes and standards.

Required Skills and Qualifications :

- Bachelor's degree in Computer Science, Engineering, Information Technology, or a related field.

- 5-6 years of preferred experience in a Data Engineer role, demonstrating a mid to senior level of expertise.

- Strong, hands-on experience with ETL processes and tools.

- Expertise in SQL Server, including advanced SQL querying, stored procedures, functions, and performance tuning.

- Solid understanding and practical knowledge of GraphQL, data pipelines, and API concepts.

- Proven experience with Data Mapping methodologies, specifically RMI/VIPS.

- Demonstrated ability to work with large datasets and complex data structures.

- Excellent analytical, problem-solving, and debugging skills.

- Strong communication and collaboration skills, with the ability to work effectively in an on-site team environment.

Additional Requirements :

- Hands-on experience required, not just theoretical knowledge.

- We are looking for individuals who can immediately contribute to development efforts.

- Immediate joiners preferred.

Preferred Skills :

- Experience with cloud data platforms including Azure Data Factory, AWS Glue, or Google Cloud Dataflow.

- Familiarity with scripting languages for data processing such as Python.

- Knowledge of data warehousing concepts and dimensional modeling.

- Experience with version control systems including Git.

- Understanding of data governance and data security principles