Principal Data Engineer - Metadata

Responsibilities :

- Architect and optimize scalable data platforms that support advanced analytics, AI/ML capabilities, and unified knowledge access.

- Lead the design and implementation of high-throughput data pipelines and data lakes for both batch and real-time workloads.

- Set technical standards for data modeling, data quality, metadata management, and lineage tracking, with a strong focus on AI-readiness.

- Design and implement secure, extensible data connectors and frameworks for integrating customer-provided data streams.

- Build robust systems for processing and contextualizing data, including reconstructing event timelines and enabling higher-order intelligence.

- Partner with data scientists, ML engineers, and cross-functional stakeholders to operationalize data for machine learning and AI-driven insights.

- Evaluate and adopt best-in-class tools from the modern AI data stack (e.g., feature stores, orchestration frameworks, vector databases, ML pipelines).

- Drive innovation and continuous improvement in data engineering practices, data governance, and automation.

- Provide mentorship and technical leadership to the broader engineering team.

- Champion security, compliance, and privacy best practices in multi-tenant, cloud-native environments.