Job Description :

Job Title : Data Engineer

Experience : Mid-Level

Location : Hyderabad, India

Job Summary :

We are looking for a mid-level Data Engineer to design and develop scalable data pipelines on the Azure Databricks platform. You will be responsible for transforming raw data into actionable insights using PySpark and presenting them via high-performance Power BI dashboards.

Key Responsibilities :

- Design and implement end-to-end data pipelines using Azure Databricks and PySpark to process large-scale datasets.

- Build and optimize Delta Lake tables using the Medallion Architecture (Bronze, Silver, Gold).

- Collaborate with stakeholders to define data modeling strategies that support advanced analytics and reporting requirements.

- Automate data workflows and orchestration processes to reduce manual intervention and improve the reliability of data delivery.

- Create interactive and complex Power BI reports, utilizing DAX for advanced calculations and performance tuning.

- Write and tune complex SQL queries for data extraction and transformation within the Lakehouse environment.

- Work closely with business analysts to translate requirements into technical data models.

Technical Skills Required :

- Core : Python, PySpark, Spark SQL.

- Platform : Azure Databricks (Workflows, Unity Catalog, Delta Live Tables).

- BI : Power BI (Desktop & Service), DAX, Power Query.