Description :

Job Title : Data Architect/Technical Lead

Duration : Full time/Contract

Job Location : Bangalore, HSR Layout

Job Description :

An Experienced Technical Lead with 10+ years of expertise in architecting, building, and optimizing scalable cloud-based data platforms.

The ideal candidate will bring strong hands-on experience with Azure Databricks, Azure Data Factory, Snowflake, Google Big-Query, Treasure Data CDP, Python, and the modern data stack.

Responsibilities :

- Design, develop, and maintain end-to-end data pipelines using Azure Data Factory (ADF), DBT, Fivetran, and custom Python/SQL scripts.

- Migrated historical consumer data from Legacy SQL Server to Customer Data Platform (CDP), creating ETL scripts for master datasets using SQL and Python within Treasure Data CDP.

- Implement and manage Medallion Architecture (Bronze, Silver, Gold) using Azure Databricks and Delta Lake.

- Build scalable data models using Kimball/Star schema for analytics and reporting.

- Optimize data storage and query performance across Azure Data Lake, Synapse Analytics, Snowflake, and BigQuery.

- Integrate data from on-premises systems, APIs, cloud applications, CRM, and marketing platforms into centralized data platforms.

- Lead legacy data migration projects from SQL Server and other systems to cloud-based data platforms and CDP solutions.

- Configure and manage CI/CD pipelines using Azure DevOps and GitHub.

ensuring continuous data flow and quick issue resolution using Treasure Data monitoring tools.

- Integrated CRM platforms such as Trade Desk, Amazon DCR/Flywheel with Treasure Data CDP, ensuring seamless data flow and synchronization.

- Lead Customer Data Platform (CDP) implementations, particularly Treasure Data CDP.

Provided training and support to team members on Treasure Data CDP best practices, maximizing platform utilization.

- Enable advanced analytics and reporting using Databricks SQL, BigQuery, and Power BI.

- Build dashboards and KPI reports for eCommerce, consumer engagement, finance, and insurance analytics.

- Act as Technical Lead / Data Engineering Lead, guiding team members and ensuring best practices.

Requirements :

- Hands-on experience in Data Engineering experience designing, developing, and operating large-scale data platforms in production environments.

- Strong expertise in Azure Databricks, Delta Lake, and Spark (PySpark) for batch and streaming data processing.

- Experience integrating Customer Data Platforms (CDP)preferably Treasure Data CDPincluding identity resolution, audience segmentation, and activation datasets