Data Engineer - ETL Pipeline

Key Responsibilities :

- Design, develop, and maintain robust and scalable ETL/ELT pipelines to ingest and transform large datasets from various sources.

- Optimize and manage both SQL and NoSQL databases to ensure efficient data storage, retrieval, and manipulation for structured and unstructured data.

- Collaborate with data scientists, analysts, and engineers to integrate data from multiple sources and maintain smooth data flows across systems.

- Implement and maintain data validation and monitoring processes to ensure data accuracy, consistency, and availability.

- Automate repetitive tasks in the data engineering lifecycle and optimize workflows for performance and scalability.

- Partner with cross-functional teams to understand their data needs and build solutions that scale with business operations.

- Maintain comprehensive documentation for data engineering processes, workflows, and infrastructure for ease of understanding and long-term maintainability.

Required Qualifications & Skills:

- 37 years of hands-on experience as a Data Engineer or in a similar data-focused role.

- Proficiency in ETL tools such as Apache Airflow, Talend, or Informatica.

- Strong expertise in SQL and NoSQL databases (e.g., MySQL, PostgreSQL, MongoDB, Cassandra).

- Solid programming skills in Python, Scala, or Java for data manipulation and pipeline development.

- Experience with cloud platforms (AWS, Google Cloud, Azure) and their associated data services (e.g.,

S3, Redshift, BigQuery).

- Familiarity with big data processing frameworks like Apache Hadoop, Spark, or Flink.

- Strong understanding of data warehousing concepts and hands-on experience with platforms like Snowflake or Amazon Redshift.

- Awareness of data governance, data security, and privacy regulations (e.g., GDPR, HIPAA).

- Experience with version control systems, particularly Git.

Preferred Qualities :

- Strong communication skills and the ability to collaborate with both technical and non-technical stakeholders.

- Ability to work independently in a fast-paced and agile environment.

- Interest in healthcare and data-driven innovation.