Our client is looking for a highly skilled Senior Data Engineer to design, build, and optimize scalable data platforms and distributed data pipelines for global customers.
This role is ideal for someone passionate about :
- Modern cloud-based data platforms
- Large-scale data processing
- Databricks & PySpark ecosystems
- Real-time streaming systems
- AI-driven data engineering
- You will work closely with product teams, architects, and global customers to build reliable, production-grade data systems that power analytics and intelligent applications.
Key Responsibilities :
- Design and build scalable ETL/ELT pipelines using PySpark, SQL, and Databricks
- Develop modern cloud-native data architectures and scalable data platforms
- Modernize legacy systems and migrate them into scalable distributed environments
- Implement Medallion Architecture (Bronze/Silver/Gold layers) using Delta Lake
- Build and manage real-time/event-driven data pipelines using Kafka or similar technologies
- Optimize Spark jobs for performance, scalability, and cost efficiency
- Implement data quality, governance, observability, and monitoring frameworks
- Automate workflows and orchestration using Databricks Workflows or equivalent tools
- Collaborate with customers, architects, and engineering teams across geographies
- Participate in architecture reviews, technical discussions, and engineering best practices
Required Skills & Experience :
- 8+ years of experience in Data Engineering
- Strong hands-on expertise in :
a. Databricks
b. PySpark
c. SQL
d. ETL/ELT Pipelines
e. Distributed Data Systems
- Strong understanding of :
a. Data modeling
b. Data lake architectures
c. Event-driven systems
d. Streaming platforms
Experience with :
- Kafka or equivalent streaming technologies
- Azure Data ecosystem (ADLS, Azure services, etc.)
- Large-scale data processing systems
- Good understanding of scalable cloud-native architectures
- Strong problem-solving and analytical skills
- Excellent communication and stakeholder management abilities
- Experience working with global clients or distributed teams.
Good to Have :
Experience in :
- Healthcare / HealthTech
- EMR/EHR integrations
- Clinical data platforms
Exposure to :
- FHIR / HL7 / CDA standards
- Patient data platforms
- Healthcare interoperability systems
- Familiarity with AI-assisted development tools and modern GenAI workflows