Disciplines → 4 of 6

Governance & Guardrails

The four control pillars applied to AI usage, enforced in the systems you already run and proportionate to the risk of the work.

Overview

Governance & Guardrails decides which AI tools, agents and integrations the organisation uses, what they may reach, do and decide, how their use is proven and how problems are detected. It gives the second line controls to assure that are enforced, not merely written down.

Governance here is proportionate by design. The risk tier of the work sets the controls: low-tier work passes automated checks and moves on, and scrutiny concentrates on high and critical work where a mistake is expensive or irreversible. Controls live in the pipeline, the identity platform and the tracker, not in a separate approval queue.

  1. Self-AssessmentAssess: baseline
  2. GuardrailsPrevent: limits
  3. Audit TrailProve: provenance
  4. Self-MonitoringDetect: drift, incidents

What changes in existing practice

PracticeTodayWith Governance & Guardrails
Information-security policyAcceptable-use rules for systems and dataAdds a short AI usage policy keyed to risk tiers: approved tools, data boundaries, who decides at each tier
Risk registerIT and operational risks per systemAI use cases, agents and providers registered with an owner, a tier and the controls that cover them
Vendor managementDue diligence scaled to supplier criticalityAI providers assessed on data use, retention, sub-processors, incident notification, audit rights and exit
Change advisoryBoard reviews changes by categoryLow and medium-tier AI-assisted changes become standard changes; the board spends its time on high and critical
Internal audit planPeriodic audits of IT general controlsCovers AI-assisted work: tests that tier gates, provenance and kill switches operate as designed

Key practices

Keep the usage policy short and tier-based

Most AI usage policies fail by length: a list of prohibitions nobody reads, out of date as soon as a new tool ships. Keep the policy to a page or two: which tools are approved for which data classes, what AI may do at each risk tier, who owns the decision at each tier, and how to request a new tool. Everything else lives in the controls that enforce it. A policy that says what is allowed keeps use inside sanctioned tools; one that only forbids pushes it onto personal accounts.

Inventory every AI use

What is not visible cannot be governed. The inventory lists the AI tools, agents, integrations and use cases in operation, each with an owner, a tier, the data it can reach and the provider behind it. It is not a separate spreadsheet but a view of the element register, filtered to AI-specific elements. Discovery closes the gap: identity logs, network egress, browser extensions and expense claims reveal use that never went through a request.

Treat AI providers as third parties

Every hosted model, assistant or agent platform is a supplier processing your data. Contracts should settle whether inputs and outputs may be used for training, how long they are retained and where, which sub-processors are involved, how quickly incidents are notified, what audit and information rights you hold, and how you exit with prompts, context and logs intact. EU financial entities already manage these providers under DORA's ICT third-party risk rules; AI providers belong in the same register and the same exit planning, not on a side list.

Enforce guardrails as policy-as-code

A guardrail that exists only in a document is an intention. Express the rules where work runs: the pipeline's policy gate maps each change's tier to its required approvals, provenance checks fail unmarked changes, agents run as non-human identities with least privilege and short-lived credentials, and egress rules keep sensitive data away from unapproved providers. Policy code is versioned and reviewed like any other change, so the audit trail shows which rule applied at the time.

Build kill switches, and test them

Every tool, agent and integration needs a fast way to stop it: revoke its credentials, disable the integration, block the provider at the network edge, fall back to the manual path. Name who may pull each switch and set a target time to revoke. Then pull it in a planned exercise: confirm the agent actually stops, nothing retries with cached credentials, and the work continues without it. A kill switch that has never been pulled is an assumption.

Split ownership across three lines

Delivery teams own and operate the controls on their own AI use: they tier the work, run the gates and keep the inventory current. Second-line risk and compliance set the policy, define control standards per tier and assure that they work, drawing on self-monitoring data rather than questionnaires. Internal audit tests the arrangement independently, including sampling AI-assisted changes back to their approvals. No one outside the team becomes a gatekeeper for low-tier work.

Controls by risk tier

TierPrevent (Guardrails)Prove (Audit Trail)Detect (Self-Monitoring)
LowApproved tool catalogue; no sensitive data classes; automated policy checksUse recorded in the inventory; provenance on changesUse outside the catalogue flagged from identity and egress logs
MediumTier gate in the pipeline; agents with scoped, short-lived credentialsApprovals and policy version recorded with the changeSecond-line sampling; usage drift per tool and team
HighProvider fully assessed as a third party; tested kill switch; specialist approvalEvidence bundle retained; agent access recertifiedAlerts on anomalous agent actions; results reviewed by the second line
CriticalAI may inform, never decide or act, enforced by permissions, not policy textDocumented rationale; second-line sign-offAny AI action in scope raises an incident; internal audit samples every cycle

Maturity path

  1. Ad hoc — AI tools used on personal accounts; no policy, no inventory, no view of which providers hold company data.
  2. Experimenting — a basic usage policy; sanctioned pilots with named tools; provider terms checked case by case.
  3. Managed — approved tool catalogue and tier-based policy; inventory drawn from the element register; AI providers in vendor management.
  4. Governed — guardrails enforced as policy-as-code; kill switches tested; second line assures from pipeline data; internal audit covers AI-assisted work.
  5. Optimised — controls and delegation boundaries tuned from monitoring and audit evidence; revocation is fast and routinely exercised.

Assess your organisation →

Measures

Anti-patterns

Regulatory anchors

The EU AI Act takes a risk-based approach, as ScaledAIOps does, but the two classify different things: the Act classifies AI systems by their use (prohibited, high, limited, minimal risk); ScaledAIOps tiers classify work. The inventory records both. Staff of deployers need sufficient AI literacy (Art. 4), which the short policy and enablement support. Where a system in use is high-risk, deployer obligations apply (Art. 26): use in line with the provider's instructions, human oversight by competent people, monitoring of operation and retention of logs, which the pillars supply. AI used to evaluate or monitor workers is high-risk (Annex III, point 4), so governance measures teams, never individuals.

ISO/IEC 42001 frames the pillars as an AI management system: Assess maps to performance evaluation (clause 9), Prevent to planning and operation (clauses 6 and 8), Prove to documented information (7.5), and Detect to monitoring and improvement (9.1, 10).