Description : Senior Databricks Delta Live Tables Engineer.

About The Opportunity :

- We are a cloud data engineering & analytics consulting firm serving enterprise customers across data modernization, real-time analytics, and data governance initiatives.

- We design and implement scalable, production-grade data platforms using Databricks, Delta Lake, and modern CI/CD practices to accelerate business insights.

Role & Responsibilities :

- Design, develop and operate production Databricks Delta Live Tables (DLT) pipelines for batch and streaming use-cases ingestion, transformation, and consumption.

- Implement Delta Lake table design, partitioning, compaction and performance-tuning (file sizing, Z-ordering) to meet SLAs and cost targets.

- Author PySpark/SQL transformations and data quality rules (expectations/assertions) within DLT and automate testing for data correctness.

- Integrate DLT pipelines with Git-based CI/CD, automated testing, and deployment workflows to Databricks workspaces and jobs.

- Build observability and alerting for pipeline health, job failures, latency, and data lineage; perform root-cause analysis and remediation.

- Collaborate with data engineers, data scientists and stakeholders to define data contracts, schemas and operational runbooks.

Skills & Qualifications :

Must-Have :

- Databricks Delta LiveTables.

- Apache Spark.

- PySpark.

- Delta Lake.

- SQL.

- CI/CD.

Preferred:

- AWS.

- Terraform.

- Apache Airflow.

Additional Qualifications:

- 7+ years of professional experience in data engineering with demonstrable production experience building and operating Databricks-based pipelines.

- Proven track record delivering end-to-end data platform features with automated testing, deployment pipelines and SLAs.

Benefits & Culture Highlights:

- Fully remote role with flexible hours and a focus on outcome-driven delivery.

- Opportunities to work on large-scale, multi-cloud data modernization programs and to upskill on Databricks and modern data stack technologies.

- Collaborative, mentor-driven environment that emphasizes engineering excellence and automation.

Location: Remote (India).

If you are a highly motivated data engineer with deep Databricks DLT expertise and a passion for building reliable, high-performance data platforms, we'd love to hear from you.

Skills: apache spark,terraform,azure,sql,aws,databricks,delta live tables.