eSolutionsFirst - Databricks Expert & Solution Engineer

Job Title : Databricks Expert & Solution Engineer

Location : Hyderabad, India (100% On-site)

Employment Type : Full-time

Education : B.Tech/Bachelors Degree in Computer Science only

Certification : Databricks Certification

CTC : Open /Negotiable based on experience and skills

Job Summary :

We are looking for an experienced Databricks Expert / Solution Engineer to join our team in Hyderabad. The ideal candidate will have strong expertise in designing, implementing, and optimizing modern data platforms using Databricks and cloud technologies. This is an on-site role that requires close collaboration with cross-functional teams, stakeholders, and customers to deliver scalable, high-performance data solutions.

Key Responsibilities :

- Design, develop, and maintain scalable data engineering solutions using Databricks.

- Build and optimize ETL/ELT pipelines using Apache Spark, PySpark, and SQL.

- Develop and manage Delta Lake architectures for reliable and efficient data processing.

- Collaborate with business stakeholders, data scientists, and application teams to understand requirements and deliver robust solutions.

- Design and implement Lakehouse architectures on cloud platforms such as Azure, AWS, or Google Cloud.

- Optimize Databricks workloads for performance, scalability, and cost efficiency.

- Implement data governance, security, and access controls.

- Troubleshoot production issues and provide technical support for data platforms.

- Develop CI/CD pipelines and automate deployment of Databricks assets.

- Create technical documentation, architecture diagrams, and operational procedures.

- Stay current with Databricks features, cloud services, and industry best practices.

Required Qualifications :

- Bachelor's or Master's degree in Computer Science, Information Technology, Engineering, or a related field.

- 10+ years of experience in Data Engineering or Analytics Engineering.

- 5+ years of hands-on experience with Databricks.

- Strong expertise in Apache Spark, PySpark, SQL, and Python.

- Experience with Delta Lake, Unity Catalogue, and Databricks Workflows.

- Strong understanding of data warehousing and modern Lakehouse architecture.

- Experience working with Azure Databricks, AWS Databricks, or Google Cloud Databricks.

- Knowledge of data modeling, ETL/ELT processes, and performance optimization.

- Experience with Git, Azure DevOps, GitHub Actions, or similar CI/CD tools.

- Strong analytical, troubleshooting, and problem-solving skills.

- Excellent verbal and written communication skills.

Preferred Qualifications :

- Databricks Certified Data Engineer Associate or Professional certification.

- Experience with Azure Data Factory, Azure Synapse, AWS Glue, or similar data integration tools.

- Knowledge of streaming technologies such as Structured Streaming or Apache Kafka.

- Familiarity with Infrastructure as Code tools such as Terraform.

- Experience working in Agile/Scrum environments.

Mandatory Technical Skills :

- Databricks

- Apache Spark

- PySpark

- SQL

- Python

- Delta Lake

- Unity Catalog

- Azure, AWS, or Google Cloud

- Data Engineering

- ETL/ELT

- Git

- CI/CD

- Data Warehousing

- Lakehouse Architecture

- AI/BI Genie