Job Summary:

We are looking for an experienced Databricks Developer with strong expertise in Python, SQL, and Databricks to develop scalable data solutions, build curated datasets, and support self-service analytics using Databricks Genie and AI/BI capabilities.

Key Responsibilities:

- Develop modular Python applications, reusable utilities, APIs, and scalable data solutions on Databricks.

- Build and maintain curated datasets and semantic layers using Databricks SQL and Unity Catalog.

- Configure and optimize Databricks Genie/AI-BI spaces to enable natural-language querying and self-service analytics.

- Manage metadata, instructions, and data definitions to improve the accuracy and quality of natural-language queries.

- Develop and optimize SQL queries and data processing workflows.

- Work with Apache Spark and PySpark for data transformation and processing.

- Implement data governance, access controls, and security best practices using Unity Catalog.

- Debug technical issues, troubleshoot data pipelines, and optimize application and query performance.

- Collaborate with data engineers, analysts, and business stakeholders to deliver reliable data solutions.

Required Skills:

- 5+ years of experience in Python development and data engineering.

- Strong proficiency in Python, SQL, and Databricks.

- Hands-on experience with Databricks SQL and Unity Catalog.

- Experience building APIs, reusable Python modules, and data processing solutions.

- Knowledge of Apache Spark/PySpark and data transformation techniques.

- Exposure to Databricks Genie, AI/BI spaces, and natural-language query configuration.

- Understanding of data governance, metadata management, debugging, and performance optimization.

- Strong analytical, problem-solving, and communication skills.