We are seeking an experienced Azure Data Platform Architect to join our team in Bangalore. This is a hybrid role, offering a blend of on-site collaboration and remote flexibility. The ideal candidate will be responsible for designing, building, and optimizing Azure-based data solutions, leveraging expertise across Azure Core Services, Modern Data Platform Architecture, and advanced Data Engineering technologies.

Key Responsibilities :

- Architect and implement Azure Modern Data Platform solutions.

- Design and optimize Apache Spark workloads using Azure Databricks, with proficiency in DataFrame/Dataset APIs, Structured and Streaming sources, Delta Lake, SparkSQL, and advanced Spark concepts (Lakehouse, Caching, Stream sources).

- Develop ETL pipelines and automate job scheduling using Azure Data Factory, including incremental loads from external sources (Oracle, SAP HANA, ERP), data flows, triggers, and resource optimization.

- Design, optimize, and secure Data Warehousing solutions (Azure SQL DB, Synapse Analytics, Data Lake, EDW, Snowflake alternatives), including SCDs, data modeling, migration, and data mesh architecture.

- Implement analytics solutions using SQL (Joins, Aggregates, Window Functions, Partitioning, Subqueries), T-SQL, and Microsoft BI stack (SSIS, SSAS, SSRS).

- Build and manage Azure Functions, Logic Apps, and App Services for integration and automation.

- Utilize additional Azure services (PowerShell, Stream Analytics, Event Hub, HDInsight, Service Bus) and manage authentication using Active Directory.

- Develop and maintain CI/CD pipelines via Azure DevOps, manage source code via Git/Bitbucket, and employ Azure Key Vault for secrets management.

Required Skills :

- Deep hands-on experience with Azure Data Bricks, Apache Spark (PySpark/Scala), and Spark performance tuning.

- Strong background in Azure Data Factory ETL development and external data integration.

- Expertise in Data Warehousing, Data Modeling, and Azure SQL services.

- Strong SQL and data analytics skills.

- Knowledge of Azure Functions, Logic Apps, and related serverless components.

- Familiarity with Azure Stream Analytics, Event Hub, HDInsight, Service Bus.

- Cloud DevOps : Hands-on with Azure DevOps (CI/CD), GIT/Bitbucket, secrets management (Key Vault).

- Understanding of data security, migration, and modern data architectures.

- Excellent communication and documentation skills.

Good to Have :

- Previous experience with Data Mesh and large-scale data migrations.

- Knowledge of other cloud platforms and hybrid cloud integrations.