Lead Data Engineer - Synapse Analytics

Job Description :

We are seeking a highly skilled Azure Data Engineer to join our dynamic team. As a Data Engineer at LUMIQ, you will play a crucial role in designing, developing, and maintaining our cloud-based data infrastructure to support our BFSI customers. You will work at the intersection of cloud technologies, data engineering, and the BFSI domain to deliver robust and scalable data solutions.

Key Responsibilities :

- Design, develop, and implement data pipelines, ETL processes, and data integration solutions.

- Collaborate with cross-functional teams to understand data requirements and design scalable data models and architectures that align with BFSI industry needs.

- Optimize data storage, processing, and retrieval for maximum performance and cost-

efficiency in Azure cloud environments.

- Implement data security and compliance measures to ensure the protection and integrity of sensitive BFSI data.

- Work closely with data scientists and analysts to enable seamless access to high-quality data for analytical purposes.

- Troubleshoot and resolve data-related issues, ensuring data availability and reliability for BFSI customers.

- Stay updated on industry best practices, emerging cloud technologies, and trends in the BFSI sector to drive continuous improvement and innovation.

Must Have Skills :

- Strong experience in Python and Spark.

- Strong experience in Batch Ingestion and Processing.

- Strong experience working on Azure Cloud platform.

- Experience with any Database (Postgres, MySQL, Oracle, etc.)

Good to Have Skills :

- Databricks

- Synapse

- Microsoft Fabric

- Azure Certifications

- Streaming and Kafka (For any future streaming use cases)

What Do You Get :

- Opportunity to contribute to an entrepreneurial culture and exposure to the startup hustler culture.

- Competitive Salary Packages.

- Group Medical Policies.

- Equal Employment Opportunity.

- Maternity Leave.

- Opportunities for upskilling and exposure to the latest technologies.

- 100% Sponsorship for certification