Senior Data Cloud Engineer Databricks & Azure + Java

Role Overview :

We are looking for a Senior Data Cloud Engineer with 46 years of strong experience in Azure Data Engineering and Databricks.

The ideal candidate should have hands-on expertise in Databricks REST APIs, Databricks SDK (Python/Java), and Databricks CLI, along with strong experience in developing Java/Spring Boot microservices and REST APIs.

The candidate will be responsible for designing and developing API-driven Databricks integrations, automating Databricks administration and deployments, and building scalable cloud data engineering solutions.

Top 3 Mandatory Skills :

- Databricks REST API

- Databricks SDK (Python/Java)

- Databricks CLI

Key Responsibilities :

- Design and develop integrations using Databricks REST APIs, SDKs, and automation frameworks.

- Create and manage Databricks Jobs, Workflows, Clusters, Repos, Unity Catalog, and Workspace resources through APIs.

- Develop API-driven solutions for orchestrating Databricks notebooks, jobs, and streaming pipelines.

- Integrate Databricks with enterprise applications, microservices, and external platforms using REST APIs.

- Develop and maintain Databricks and Azure Data Factory (ADF) pipelines.

- Automate Databricks administration, deployment, monitoring, and operational activities.

- Develop scalable and reusable data engineering solutions on Microsoft Azure.

Technical Requirements :

- Databricks : Strong hands-on experience with Databricks REST API, SDK (Python/Java), and CLI. Understanding of Jobs API, Clusters API, Workspace API, SQL Execution API, Unity Catalog API, and Delta Sharing API.

- Azure Data Engineering : 4+ years of experience in Azure Data Engineering and Databricks. Hands-on experience developing Azure Data Factory pipelines.

- Java / Microservices : Experience developing Java/Spring Boot microservices and REST APIs.

- API Security : OAuth 2.0, IDP / Identity Providers, JWT, Service Principals, RBAC, Secrets Management.

Required Qualifications :

- 4-6 years of overall experience in cloud data engineering and transformation.

- Bachelors degree in Computer Science, Information Technology, Engineering, or an equivalent discipline.

Important :

Candidates without hands-on experience in Databricks REST API, Databricks SDK, and Databricks CLI should not be considered.