Wipro - Databricks Architect

Location : Bangalore

Shift : 2 PM to 11.30 PM

Experience : 8 - 14 yrs

NP : Immediate to 45 Days only.

About the Position :

The Principal Data Platform Engineer is a member of the Data & Analytics (D&A) Platform and Architecture team responsible for the design, development, testing, maintenance, and support of CSC's Enterprise Data Platform.

Working on a dedicated scrum team, the Principal Data Platform Engineer will provide technical and architectural design, as well as development and analytical support for CSC's D&A platform.

The Principal Data Platform Engineer must have demonstrable big data experience with cloud computing in order to help the D&A team deliver high-quality, first-class reporting to customers. A skillset that includes data architecture and system design is a must.

Your Responsibilities :

- Driving technical vision and architecture for the enterprise data platform, collaborating closely with HQ architects and engineering leads.

- Lead the design, development, and maintenance of scalable data platforms using Databricks, Data Lake, Data Factory, and Data Warehouse.

- Defining and implementing integration patterns across ingestion, transformation, and consumption layers.

- Architect and implement advanced CI/CD pipelines using GitHub and Terraform.

- Identifying performance bottlenecks and leading query and pipeline optimization.

Required :

- 8+ years of experience in data engineering or data platform roles, with at least 5 years designing and building big data systems in a cloud environment (Azure preferred).

- Deep expertise in Python, automated testing, Github actions related to infrastructure development.

- Hands-on experience with Databricks, including Delta Lake, Unity Catalog, and medallion architecture patterns.

- Experience with Azure Data Factory or comparable orchestration tooling.

- In-depth knowledge of Azure Key Vault and security best practices.

- Experience with Unity Catalog and managing multiple workspaces.

- Experience with CI/CD design and infrastructure-as-code practices (Terraform or equivalent).

Preferred :

- Experience with enterprise data governance tools (Collibra or equivalent).

- Exposure to enterprise scheduling/orchestration platforms (e.g., Tidal).

- Familiarity with Power BI or comparable BI platforms at the platform/infrastructure layer.