HamburgerMenu
hirist

Senior Data Engineer - Databricks

ARA Resources
7 - 13 Years
Multiple Locations

Posted on: 18/11/2026

Job Description

Role Summary:

The ideal candidate will design, build, and optimize scalable data pipelines using Databricks and related technologies, enabling faster data-driven decisions for the company.

Key Responsibilities:

- Design, develop, and optimize end-to-end batch and streaming data pipelines using Azure Databricks and Spark.

- Apply Medallion Architecture to structure data layers (raw, enriched, curated).

- Ensure data accuracy, consistency, and governance using tools like Azure Purview and Unity Catalog.

- Optimize Spark jobs, Delta Lake tables, and SQL queries for efficiency.

- Collaborate closely with analysts, architects, and business teams to deliver end-to-end data solutions.

- Support and maintain existing data pipelines and solutions.

- Implement data quality rules and principles.

- Participate in code reviews and contribute to best practices.

Must-Have Qualifications:

- Hands-on experience with Databricks, Delta Lake, and Data Factory.

- Proficiency in Python, PySpark, and SQL with strong query optimization skills.

- Deep understanding of Lakehouse architecture and Medallion design patterns.

- Experience building scalable ETL/ELT pipelines.

- Familiarity with Git, CI/CD pipelines, and Agile methodologies.

Nice to Have:

- Knowledge of data quality frameworks and monitoring practices.

- Experience with data visualization tools.

- Experience working in managed services.

Behavioral Competencies:

- Strong problem-solving and analytical skills.

- Attention to detail and commitment to data quality.

- Collaborative mindset and effective communication.

- Proactive and self-driven.

Why Join Us:

- The company offers a dynamic work environment that fosters innovation.

- Recognized as a Great Place to Work in 2021, ensuring a high-trust and high-performance culture.

- Employees have the opportunity to work with cutting-edge technologies.

- Committed to personal and professional growth.

info-icon

Did you find something suspicious?

Similar jobs that you might be interested in

Loading chat...