HamburgerMenu
hirist

Senior Data Engineer - SQL/PySpark

Square Root Consulting
4 - 9 Years
Multiple Locations

Posted on: 23/06/2026

Job Description

Role Overview :


Our client is looking for a highly skilled Senior Data Engineer to design, build, and optimize scalable data platforms and distributed data pipelines for global customers.

This role is ideal for someone passionate about :

- Modern cloud-based data platforms

- Large-scale data processing

- Databricks & PySpark ecosystems

- Real-time streaming systems

- AI-driven data engineering

- You will work closely with product teams, architects, and global customers to build reliable, production-grade data systems that power analytics and intelligent applications.

Key Responsibilities :

- Design and build scalable ETL/ELT pipelines using PySpark, SQL, and Databricks

- Develop modern cloud-native data architectures and scalable data platforms

- Modernize legacy systems and migrate them into scalable distributed environments

- Implement Medallion Architecture (Bronze/Silver/Gold layers) using Delta Lake

- Build and manage real-time/event-driven data pipelines using Kafka or similar technologies

- Optimize Spark jobs for performance, scalability, and cost efficiency

- Implement data quality, governance, observability, and monitoring frameworks

- Automate workflows and orchestration using Databricks Workflows or equivalent tools

- Collaborate with customers, architects, and engineering teams across geographies

- Participate in architecture reviews, technical discussions, and engineering best practices

Required Skills & Experience :

- 8+ years of experience in Data Engineering

- Strong hands-on expertise in :

a. Databricks

b. PySpark

c. SQL

d. ETL/ELT Pipelines

e. Distributed Data Systems

- Strong understanding of :

a. Data modeling

b. Data lake architectures

c. Event-driven systems

d. Streaming platforms

Experience with :

- Kafka or equivalent streaming technologies

- Azure Data ecosystem (ADLS, Azure services, etc.)

- Large-scale data processing systems

- Good understanding of scalable cloud-native architectures

- Strong problem-solving and analytical skills

- Excellent communication and stakeholder management abilities

- Experience working with global clients or distributed teams.

Good to Have :

Experience in :

- Healthcare / HealthTech

- EMR/EHR integrations

- Clinical data platforms

Exposure to :

- FHIR / HL7 / CDA standards

- Patient data platforms

- Healthcare interoperability systems

- Familiarity with AI-assisted development tools and modern GenAI workflows

info-icon

Did you find something suspicious?

Similar jobs that you might be interested in

Loading chat...