Posted on: 18/11/2026
Role Summary:
The ideal candidate will design, build, and optimize scalable data pipelines using Databricks and related technologies, enabling faster data-driven decisions for the company.
Key Responsibilities:
- Design, develop, and optimize end-to-end batch and streaming data pipelines using Azure Databricks and Spark.
- Apply Medallion Architecture to structure data layers (raw, enriched, curated).
- Ensure data accuracy, consistency, and governance using tools like Azure Purview and Unity Catalog.
- Optimize Spark jobs, Delta Lake tables, and SQL queries for efficiency.
- Collaborate closely with analysts, architects, and business teams to deliver end-to-end data solutions.
- Support and maintain existing data pipelines and solutions.
- Implement data quality rules and principles.
- Participate in code reviews and contribute to best practices.
Must-Have Qualifications:
- Hands-on experience with Databricks, Delta Lake, and Data Factory.
- Proficiency in Python, PySpark, and SQL with strong query optimization skills.
- Deep understanding of Lakehouse architecture and Medallion design patterns.
- Experience building scalable ETL/ELT pipelines.
- Familiarity with Git, CI/CD pipelines, and Agile methodologies.
Nice to Have:
- Knowledge of data quality frameworks and monitoring practices.
- Experience with data visualization tools.
- Experience working in managed services.
Behavioral Competencies:
- Strong problem-solving and analytical skills.
- Attention to detail and commitment to data quality.
- Collaborative mindset and effective communication.
- Proactive and self-driven.
Why Join Us:
- The company offers a dynamic work environment that fosters innovation.
- Recognized as a Great Place to Work in 2021, ensuring a high-trust and high-performance culture.
- Employees have the opportunity to work with cutting-edge technologies.
- Committed to personal and professional growth.
Did you find something suspicious?
Posted by
Posted in
Data Engineering
Functional Area
Data Engineering
Job Code
1684175