Job Title : Agentic AI Governance Architect / Responsible AI Architect

Location : Bengaluru, Pune, Mumbai, Noida, Hyderabad

Role Overview :

We are seeking an experienced Agentic AI Governance Architect to define, implement, and operationalize the governance, observability, and Human-in-the-Loop (HITL) operating model for an enterprise-scale Agentic AI platform. The ideal candidate will combine expertise in enterprise architecture, Responsible AI, AI governance, cloud security, observability, and compliance frameworks to ensure AI systems operate safely, reliably, transparently, and in alignment with organizational policies and regulatory requirements.

This role will work closely with Governance, Risk, Compliance, Security, Platform Engineering, Data Engineering, and AI Engineering teams to translate governance requirements into enforceable controls, audit mechanisms, monitoring frameworks, and operational runbooks.

Key Responsibilities :

Governance & Responsible AI :

- Define and document the governance operating model for enterprise Agentic AI platforms.

- Translate governance, risk, compliance (GRC), and Responsible AI requirements into technical guardrails and operational controls.

- Establish policies for model governance, AI safety, ethical AI usage, bias mitigation, explainability, transparency, and accountability.

- Design governance frameworks supporting enterprise audit and regulatory requirements.

Human-in-the-Loop (HITL) Design :

- Design Human-in-the-Loop approval workflows for critical AI decisions and escalations.

- Define escalation matrices, approval chains, SLAs, and exception-handling procedures.

- Implement workflow specifications using Microsoft Teams approvals, Adaptive Cards, and Power Automate.

- Establish governance checkpoints across multi-agent workflows.

Observability & Monitoring :

- Define observability frameworks for Agentic AI systems.

- Implement monitoring strategies covering model performance, latency, reliability, safety, bias detection, drift detection, and user interactions.

- Define telemetry, logging, tracing, and audit requirements using Azure Monitor, Log Analytics, Application Insights, and OpenTelemetry.

- Design executive dashboards and governance reporting mechanisms.

Security & Access Governance :

- Define enterprise RBAC strategies using Entra ID and platform-level authorization models.

- Design access control policies, segregation of duties, approval workflows, and privileged access controls.

- Establish audit trail requirements and compliance evidence collection mechanisms.

- Define governance standards across Azure services, AI platforms, and Snowflake environments.

Agent Reliability & Operational Resilience :

- Design reliability patterns for complex multi-agent workflows.

- Establish standards for :

1. Timeouts

2. Retry mechanisms

3. Circuit breakers

4. Dead-letter queues

5. Fallback routing

6. Idempotency controls

7. Failure recovery processes

- Create operational playbooks for incident response and recovery.

Compliance & Audit :

- Develop governance artifacts including :

1. Runbooks

2. Operating procedures

3. Control documentation

4. Audit evidence repositories

5. Governance dashboards

6. Acceptance review documentation

- Support governance walkthroughs and client acceptance reviews.

- Maintain traceability between governance controls and compliance requirements.

Stakeholder Management :

- Collaborate with governance, risk, compliance, legal, security, and architecture teams.

- Facilitate governance reviews and executive-level discussions.

- Present governance frameworks and operational evidence to stakeholders and auditors.

- Drive alignment between technical implementation and enterprise governance objectives.

Required Skills & Experience :

- 10+ years of experience in Enterprise Architecture, Solution Architecture, or Governance Architecture.

- 3+ years of experience in Responsible AI, AI Governance, Model Risk Management, or AI Compliance programs.

- Strong understanding of enterprise governance frameworks and operational controls.

- Experience with at least three of the following :

1. Azure AI Content Safety

2. Azure Purview

3. Microsoft Defender for Cloud

4. Entra ID (RBAC and Conditional Access)

5. Azure Monitor

6. Log Analytics

7. Application Insights

8. OpenTelemetry

- Experience with LLM observability solutions such as :

1. Azure AI Foundry Evaluations

2. Prompt and response monitoring platforms

3. Model evaluation frameworks

- Experience designing Human-in-the-Loop approval processes.

- Strong understanding of AI safety, compliance, risk management, and audit requirements.

Preferred Qualifications :

- Experience authoring Responsible AI governance frameworks.

- Experience with Microsoft AI Foundry governance blueprints.

- Knowledge of AI ethics review processes and enterprise compliance programs.

- Familiarity with Snowflake RBAC and data governance models.

- Experience supporting regulated industry environments.

- Understanding of Agentic AI architectures and multi-agent orchestration platforms.