Description :

As a Data Engineer, you will be responsible for designing, developing, and maintaining our data pipelines, databases, and systems. You will work closely with cross-functional teams to ensure efficient data flow and support data-driven decision-making across the organization.

Your Main Responsibilities Will Include :

- Designing and implementing scalable, reliable, and efficient data pipelines and ETL processes to collect, process, and store large volumes of structured and unstructured data from various sources.

- Collaborating with data scientists, analysts, and other stakeholders to understand data requirements and ensure data quality, integrity, and availability.

- Building and optimizing data warehouses, data lakes, and other storage solutions to support analytics, reporting, and machine learning initiatives.

- Developing and maintaining data infrastructure and tools, automating processes, and implementing best practices for data management, governance, and security.

- Troubleshooting issues, identifying bottlenecks, and optimizing performance of data systems to meet business needs and performance goals.

Responsibilities :

- Manage the end-to-end implementation of the Data Warehouse/Datalake project, ensuring adherence to timelines, and quality standards.

- Working closely with the development team to design and implement appropriate data models, ETL processes, and reporting solutions.

Requirements :

- Bachelor's or Master's degree in Computer Science, Information Technology, or a related field.

- Proven experience working as a Data Engineer or similar role, handling large-scale data infrastructure and ETL processes.

- Proficiency in programming languages such as Python, Java, or SQL for data processing and manipulation.

- Strong knowledge of database technologies (SQL, Redshift) data warehousing concepts, and big data tools/frameworks (PySpark, Kafka, etc.).

- Excellent communication and interpersonal skills with the ability to convey technical concepts to non-technical stakeholders.

- Experience with cloud platforms like AWS or Google Cloud and their data services (S3, Redshift, , etc.).

- Candidate is form BFSI industry is a plus.