Responsibilities :

- Function as a key member of the data engineering team, leading data engineering development initiatives for companys internally developed applications and supporting workflows.

- Provide decisive and effective technical leadership for all development efforts.

- Guide cloud architectures with cost optimization techniques.

- Lead development of data platform, supporting upstream and downstream systems through agile methodologies.

- Lead and contribute to the creation of a self-service platform for developers, data scientists, analysts, and non-technical users.

- Independently take on complex development tasks, prototypes, and troubleshooting.

- Collaborate with engineers, product, and business leaders to ensure platforms are integrated with other systems and technologies.

- Lead development process by being involved in code reviews and providing feedback for data engineers.

- Lead solutions development using technical judgment, input from experts, and the involvement of other systems development partners as appropriate.

- Clearly and consistently communicate product vision to the team.

- Guide the team to achieve this vision.

- Design and maintain scalable, secure, and high-performance data architectures that meet business and technical requirements.

- Create and manage conceptual, logical, and physical data models.

- Develop and maintain data architecture standards, best practices, and governance frameworks.

- Expertise with Databricks & Airflow platforms.

- Apache Spark Proficiency : Strong understanding of Spark core concepts, Spark.

- Streaming and data manipulation techniques.

- Expertise with RDBMS, blob storage, and data visualization.

- Transformation of legacy data technologies to modern architecture.

- Designing and building cloud-native data solutions (Azure, AWS, Google Cloud Platform).

- Understanding of LLM solutions, RAG, Vectorization, MLOps.

Requirements :

- To perform this job successfully, an individual must be able to perform each duty satisfactorily.

- The requirements listed below are representative of the knowledge, skills, and/or abilities required.

- Reasonable accommodation may be made to enable individuals with disabilities to perform the duties.

- BS (or higher, MS / PhD) degree in Computer Science / related field, or equivalent technical experience.

- 15 plus years' experience in the development of a data environment, with at least the last few years in a leadership role with progressively increasing responsibilities.

- Experience in developing CI/CD solutions for data platforms.

- Experience designing and implementing a data security and governance platform, adhering to compliance standards (HIPAA, SOC 2) preferred.

- 2 3 4 5 6 7 8 9 Demonstrated success in effectively communicating at all levels of an organization.

- Deep understanding and knowledge of developing products using modern technologies.

- Ability to lead through influence rather than direct authority.

- Demonstrated successful time management and organization skills.

- Ability to manage and work with a culturally diverse population.

- Ability to work well and productively, always projecting a positive outlook in a fast-paced, deadline-driven

environment.

- Ability to anticipate roadblocks, diagnose problems, and generate effective solutions.

- Knows how to organize a data team to maximize quality and output.

- Will promote and encourage opportunities for personal and professional growth in employees.