Position Summary :

We are looking for a highly skilled Senior Databricks Data Engineer with strong expertise in Databricks, PySpark, SQL, and AWS cloud technologies.

This role involves designing and implementing scalable data architectures, developing robust batch and real-time data pipelines, managing data governance frameworks, and delivering high-performance data solutions.

The ideal candidate will have hands-on experience with Databricks Lakehouse, Delta Lake, Unity Catalog, data modeling, and cloud-based data platforms while collaborating with stakeholders to translate business requirements into technical solutions.

Your Role Responsibilities and Duties :

- Design and develop scalable batch and real-time data pipelines using Databricks, PySpark, and SQL

- Optimize SQL queries and PySpark workloads for performance and cost efficiency

- Implement data governance and access controls using Unity Catalog

- Build cloud-based data solutions leveraging AWS services

- Develop and maintain data models, warehousing solutions, and analytics datasets

- Collaborate with stakeholders to gather requirements and deliver technical solutions

- Drive best practices around code quality, CI/CD, testing, and version control

- Mentor team members and support continuous improvement initiatives

- Troubleshoot and resolve data platform and pipeline issues

Required Skills and Qualifications: Core Engineering (30% Weightage)

- 68 years of Data Engineering experience

- Strong hands-on experience with Databricks, Delta Lake, and Unity Catalog

- Advanced proficiency in PySpark and SQL

- Experience with AWS cloud services (S3, IAM, Lambda, EC2, Redshift, etc.)

- Strong understanding of data warehousing, dimensional modeling, and ETL processes

- Experience building scalable batch and streaming data solutions

- Excellent communication and stakeholder management skills

- BE/B.Tech/M.Tech/MCA or equivalent qualification

What We Offer :

- Opportunity to work on enterprise-scale data engineering and cloud transformation initiatives

- Exposure to cutting-edge Databricks and AWS technologies

- Collaborative, innovation-driven, and learning-focused work environment

- Opportunity to work with global clients and complex data ecosystems

- Competitive compensation and career growth opportunities