Role: Senior Data Engineer

Location: Hyderabad

What we're looking for:

- 57 years of data engineering experience delivering production data products at enterprise scale.

- Hands-on experience with modern Lakehouse platforms (Delta Lake, Unity Catalog, PySpark, SQL); strong performance tuning and tiered data product design.

- Hands-on experience with cloud data warehousing (SQL, secure views, role-based access, warehouse optimization).

- Strong SQL fundamentals: query optimization, set-based transformations, reconciliation patterns, SCD Type 1 and Type 2.

Key Responsibilities :

- Design and implement end-to-end data ingestion and transformation pipelines using Azure Data Factory to ensure seamless data flow across the enterprise.

- Develop high-performance data processing solutions using PySpark and Databricks to handle large-scale datasets and complex analytical workloads.

- Collaborate with stakeholders to translate business requirements into technical data models that drive strategic growth and operational efficiency.

- Optimize existing data architectures for cost, performance, and scalability to support the evolving needs of our global client base.

- Mentor junior engineers through code reviews and technical guidance to foster a culture of engineering excellence and continuous improvement.

- Automate data quality checks and monitoring processes to maintain high standards of data integrity and reliability across all production environments.

Tech Stack :

- Azure Data Factory, Azure Databricks, Microsoft Fabric, Delta Lake, SQL, PySpark, Python, DBT (Data Build Tools), Medallion Architecture, Real time Streaming Pipelines, Snowflake, Data Modelling, ETL/ELT Pipelines, Control-M, CI/CD, GITLAB