Data Engineer - Python/Spark

Job Description :

Key Responsibilities :

- Collaborate with cross-functional teams to understand data requirements and design scalable data models and architectures that align with BFSI industry needs.

- Optimize data storage, processing, and retrieval for maximum performance and cost-efficiency in Azure cloud environments.

- Implement data security and compliance measures to ensure the protection and integrity of sensitive BFSI data.

- Work closely with data scientists and analysts to enable seamless access to high-quality data for analytical purposes.

- Troubleshoot and resolve data-related issues, ensuring data availability and reliability for BFSI customers.

- Stay updated on industry best practices, emerging cloud technologies, and trends in the BFSI sector to drive continuous improvement and innovation.

Qualifications :

Must Have Skills :

- Strong experience in Python and Spark.

- Strong experience in Batch Ingestion and Processing.

- Strong experience working on Azure/GCP/AWS Cloud platform.

- Experience with any Database (Postgres, MySQL, Oracle, etc.)

Good to Have Skills :

- Synapse

- Microsoft Fabric

- Azure Certifications

- Streaming and Kafka (For any future streaming use cases)

What Do You Get :

- Competitive Salary Packages.

- Group Medical Policies.

- Equal Employment Opportunity.

- Maternity Leave.

- Opportunities for upskilling and exposure to the latest technologies.

- 100% Sponsorship for certification