Job Description :

Skills : Confluent Kafka Admin, Confluent Cloud, GCP, Flink, PowerQuery, Confluence, Concur, Data streaming

Responsibilities :

- Support the design, deployment, and maintenance of real-time data streaming pipelines using Kafka (Confluent), StreamSets, Datastream, and related tools.

- Build and maintain ingestion frameworks for HL7, FHIR, CCD, EDI, and other healthcare data formats.

- Develop and optimize streaming dataflows for low-latency, high-throughput processing.

- Implement and manage Kafka clusters, topics, schemas, connectors, and security configurations.

- Configure and maintain StreamSets pipelines for batch and streaming ingestion.

- Use Datastream for change data capture (CDC) and real-time replication across systems.

- Build Looker dashboards and semantic models to support real-time analytics and operational insights.

- Collaborate with business stakeholders to understand requirements and translate them into scalable streaming solutions.

- Participate in CI/CD processes for deploying streaming pipelines and integration components.

- Support high-availability and disaster recovery strategies for streaming platforms.

- Monitor pipeline performance, troubleshoot issues, and implement tuning recommendations.

- Identify opportunities to automate manual tasks and streamline operational workflows.

- Ensure compliance with PHI/PII handling, HIPAA requirements, and enterprise data governance policies.

- Maintain documentation for streaming architectures, pipelines, and operational procedures.

- Stay current with streaming technologies and contribute to modernization initiatives.