Senior Data Architect - Customer Data Platform

Description :

Roles and Responsibilities :

- Design and build the lakehouse architecture on Databricks including medallion layers, data modeling, and governance.

- Develop and optimize data pipelines using Databricks and dbt for data transformation and processing.

- Design and build RESTful APIs and backend services to support modernization of legacy applications.

- Build proof-of-concepts for AI products, including LLM integrations and ML models.

- Write production-grade code in Python, SQL, and dbt, ensuring performance and cost optimization.

- Establish data platform standards, patterns, governance, and best practices.

- Lead a small team of 23 data engineers; perform code reviews, provide mentorship, and remove technical blockers.

- Define and manage data quality frameworks including monitoring, alerting, and anomaly detection.

- Manage production infrastructure ensuring uptime, performance, and cost efficiency.

- Define and implement security and compliance architecture including access controls, audit trails, and encryption.

- Create modernization blueprints for legacy systems (SQL Server/.NET) to a modern cloud-based stack.

- Coordinate with frontend developers for API integrations and embedded analytics.

- Drive adoption of the modern data platform across teams through demos, training, and technical documentation.

Technical Skill Set :

- Strong knowledge of Lakehouse architecture (medallion pattern, data modeling, optimization).

- Dbt for data transformation, testing, and documentation.

- Python for data engineering, API development, scripting, and automation.

- SQL complex query writing, optimization, and performance tuning.

- Cloud platform: AWS.

- Data pipeline orchestration tools: Airflow, Databricks Workflows, or similar.

- API design and development (RESTful APIs, backend services).

- Legacy system modernization experience (migration from SQL Server/.NET).

- Knowledge of AI/ML integrations (LLMs, ML models) is a plus.

- Familiarity with BI tools like Sigma, Tableau, or Power BI is desirable.

Note : We are looking for someone who can join us within 1 month and are comfortable working in 1pm -10pm shift.