Job Title : Lead Data Engineer

Experience : 8 - 12 Years

Location : Hyderabad, Telangana, India

Industry : IT Services & Consulting

Role Overview :

We are hiring a Lead Data Engineer to design, develop, and optimize scalable cloud data platforms and modern ETL/ELT pipelines using Microsoft Fabric, Databricks, or Snowflake. In this role, you will lead the architecture, construction, and maintenance of data lakehouse and data warehouse solutions, build high-performance data pipelines, enable business analytics, and establish data engineering best practices.

Key Responsibilities :

Architecture & Pipeline Design :

- Design, build, and optimize scalable batch and real-time ETL/ELT pipelines, data models, and lakehouse/data warehouse architectures using Microsoft Fabric, Databricks, or Snowflake.

High-Performance Data Processing :

- Develop robust data processing, cleansing, and transformation solutions using PySpark, Python, Scala, and SQL for large and complex datasets.

Analytics & Visualization Support :

- Support business intelligence and self-service analytics by enabling robust data models for Power BI and other visualization tools.

Technical Leadership & Governance :

- Establish coding standards, reusable frameworks, and data engineering best practices while conducting code reviews and driving CI/CD practices.

Quality & Reliability :

- Implement data quality, governance, security, access control, and monitoring while resolving complex production and performance bottlenecks.

Required Qualifications & Skills :

Education & Experience :

- Bachelor's/Master's degree in Computer Science, IT, Engineering, or a related field with 6 - 10 years of core data engineering experience.

Primary Platforms (at least one) :

- Microsoft Fabric : Data Factory, Lakehouse, Data Warehouse

- Databricks : Spark, Delta Lake, PySpark, MLflow

- Snowflake : Data Warehousing, Snowpipe, Performance Optimization

- Power BI : Data Modeling, DAX, Report Development

Core Technical Expertise :

- Exceptional skills in SQL, Python/Scala, PySpark/Apache Spark, and cloud data services (Azure, AWS, or GCP).

Engineering Standards :

- Deep expertise in data modeling, ETL/ELT concepts, CI/CD, Git, and DevOps workflows.