Description :

Company Overview :

TECHSOPHY is a leading technology solutions provider specializing in data-driven innovation for the financial services and healthcare industries. We empower our clients with cutting-edge analytics and scalable data platforms, enabling them to make informed decisions and optimize their operations. Our expertise spans across data engineering, machine learning, and cloud computing, serving a diverse portfolio of clients globally.

Role Overview :

As a Data Engineer at TECHSOPHY, you will be instrumental in building and maintaining our data infrastructure, ensuring the reliable and efficient delivery of data to our analytics and business intelligence teams. You will collaborate closely with data scientists, software engineers, and product managers to design, develop, and deploy scalable ETL pipelines and data warehousing solutions. Your work will directly impact the quality and accessibility of data used for critical business decisions and innovative product development.

Key Responsibilities :

- Design and implement robust and scalable ETL pipelines to ingest, transform, and load data from various sources into our data warehouse.

- Develop and maintain data models and schemas to ensure data consistency and integrity across our data platforms.

- Optimize data storage and retrieval processes to improve query performance and reduce latency for our analytics teams.

- Collaborate with data scientists and analysts to understand their data requirements and provide them with the necessary data infrastructure and tools.

- Monitor and troubleshoot data pipeline performance, identifying and resolving data quality issues in a timely manner.

- Implement data governance policies and procedures to ensure data security and compliance with regulatory requirements.

Required Skillset :

- Demonstrated ability to design, develop, and maintain ETL pipelines using Spark and Scala.

- Proven experience in building and deploying data applications using Play Framework.

- Strong understanding of data warehousing concepts, data modeling techniques, and database technologies.

- Excellent problem-solving and analytical skills, with the ability to troubleshoot complex data-related issues.

- Effective communication and collaboration skills, with the ability to work effectively in a team environment.

- Bachelor's or Master's degree in Computer Science, Engineering, or a related field.

- Ability to work on-site in Hyderabad.