Article · Human oversight
Why should a person approve what an AI changes?
Because an AI that can change a running system holds authority, and authority needs someone who answers for it. Approval puts a person between the proposal and the change, with the exact diff, the reason and the requester in front of them. It belongs on changes to systems, not on every answer.
In short
Change approval means an AI may propose a change to a system, but only a person can apply it. It is one form of human in the loop.
The terms describe how close a person stands to the decision. In the loop, a person takes part in each decision before it takes effect. On the loop, the system acts on its own while a person watches and can step in. Out of the loop, nobody looks. Approval keeps a person in the loop at one point only: before a running system changes.
Where approval belongs
Not on every answer. A question answered by an assistant changes nothing, and the person who asked is already its reviewer. They read it, check where it came from and decide what to do. A gate in front of each answer only slows the reading down.
Approval belongs where an AI writes to something other people rely on: configuration, code, schemas, access rules, scheduled tasks, migrations that rewrite records. Those changes outlast the conversation, reach other users and can be hard to undo. A simple test: if a person would need a change ticket to do it, an AI needs an approval.
Meta draws the same line in its Agents Rule of Two (October 2025). An agent that reads untrusted input, reaches sensitive systems and can change state “should not be permitted to operate autonomously and at a minimum requires supervision”. An admin assistant has all three by definition.
How it works
A change goes through a person
The assistant does the work up to a staged diff and stops. A person decides, and a rejected diff goes back to the copy it came from. Pick a step to stop the drawing and read it.
- 01
Someone asks
An administrator asks for a change in plain words. The request is on the record from here on.
- 02
The assistant edits a copy
It changes its own copy of the configuration. The running system is untouched.
- 03
It builds and stages a diff
Every changed file is built. The change is staged as one diff, and the assistant stops.
- 04
A person rejects it
The reviewer reads the diff and discards it, with a reason. The change goes back to the copy. Nothing was applied.
- 05
A person approves it
A new diff, built again. The reviewer approves that exact version, and only that one.
- 06
It is applied
The change goes live as one recorded change, under the name of the person who approved it.
What a reviewer must see
An approval is only as good as what the reviewer was shown. Four things at least:
- The diff. The exact lines that will change, file by file. A summary written by the same assistant is a claim, not evidence.
- What it will reach. Which endpoints, tasks or users the change touches, and whether it rewrites stored records.
- Who asked, and why. The request in the requester’s own words, so the reviewer can judge whether the change answers it.
- That it was checked. It builds against the live configuration, and its tests ran.
The approval then has to bind to that version. If the diff changes after the review opened, the approval must not carry over to the new one.
What the rules ask for
The EU AI Act sets this out for high-risk systems. Article 14 requires that they “can be effectively overseen by natural persons during the period in which they are in use”. The people assigned must be able to override or reverse the output. They must also stay aware of relying on it too much, which the Act calls automation bias.
An assistant that edits the configuration of an internal tool is usually not a high-risk system under the Act. The article is still a useful checklist for any AI that changes things.
The NIST AI Risk Management Framework is voluntary and says the same in management terms. Its core asks that “Processes for human oversight are defined, assessed, and documented”. It also asks organizations to define roles and responsibilities for overseeing AI systems.
IBM’s explainer adds the accountability point. Once a person approves or overrides an output, responsibility no longer rests on the model or its developers alone.
The line
What it holds, what it proposes
The safety of an approval depends on what the assistant can do without one. Draw the line first, then put the approval on it.
- 01
It reads as you
The assistant reads with the permissions of the person in the chat, never elevated ones.
- 02
It writes its own copy
Its edits land in a copy of the configuration and in scratch space, nowhere else.
- 03
It checks and stages
It builds the change against the live configuration and stages a diff. That is the most it can do.
- 04
The rest is a person’s
Applying the change, running tasks and migrations, and answering for the result.
- 05
One way across
The staged diff reaches the live system only through a person’s approval.
How approval goes wrong
- A prompt before every command trains people to click yes. Ask once, for the finished change, and make that review count.
- The reviewer reads the assistant’s account of the change instead of the change.
- The approval floats: it is given to one version, and a later one is applied.
- The assistant runs as a service account with more access than the reviewer. The review then guards nothing the account could not do anyway.
- Silence counts as consent: a change applies after a timeout, or when nobody objects.
- Nothing can be undone. An approved change that turns out wrong needs a way back, the same as a change made by hand.
Questions to ask
Ask these of any AI that can change your systems, and of its vendor:
- What can it change without a person? For a running system, the answer should be nothing.
- What exactly does the reviewer approve: a summary, or the diff?
- Is the approval bound to that diff, so a later change needs a new one?
- Whose permissions does it work with: its own, or those of the person in the chat?
- Where is the record of who approved what, and can a change be rolled back like one made by hand?
How Curiosity does it
Sudo is the admin assistant in Curiosity Studio. You ask in plain words. He edits the configuration in a sandbox of his own: endpoints, AI tools, agents, schemas and tasks, as files. Every changed file is built against your deployment and staged as one commit. Then Sudo stops.
The commit waits on a review screen until an administrator approves or discards it. The approval is bound to that commit: if Sudo stages a newer one while the review is open, the review refuses to apply. Sudo asks once, at the end, not before each command. He reads with the permissions of the administrator in the chat, never elevated ones. For an administrator who may only read, he drafts the change and cannot stage it.
An approved change is one entry in your configuration history, under the approver’s name, in the same history as a change made by hand. His sandbox runs inside Studio, on your own infrastructure, with the model you choose (see what is sovereign AI?). Our paper An AI admin you can approve is for the people who decide, and Working with Sudo for the people who review.
References
Sources and further reading
Article 14: Human Oversight
EU Artificial Intelligence Act
High-risk AI must be effectively overseen by people who can override it and know its limits.
ReadAI Risk Management Framework
NIST · January 2023
A voluntary framework for managing the risks of AI systems.
ReadAI RMF Core
NIST Trustworthy and Responsible AI Resource Center
The outcomes the framework asks for, human oversight among them.
ReadWhat is human-in-the-loop?
IBM Think
What human in the loop means, what it is good for and what it costs.
ReadAgents Rule of Two: A Practical Approach to AI Agent Security
Meta AI blog · October 2025
When an agent should not act alone, and needs approval from a person.
ReadAn AI admin you can approve
Curiosity whitepaper · October 2026
How Sudo changes a production configuration without holding the authority to do harm.
ReadFAQ
Questions people ask
What is the difference between human in the loop and human on the loop?
In the loop, a person takes part in each decision before it takes effect. On the loop, the system acts on its own while a person monitors it and can step in. Changes to running systems need the first.
Does the EU AI Act require a person to approve AI changes?
Article 14 requires human oversight of high-risk AI systems: people who can understand, monitor, override and stop them. It does not prescribe an approval for each change. Outside the high-risk categories, approval is a design choice.
Does approving AI changes slow the work down?
Less than approving every step. An assistant that works in a sandbox can act freely there and ask once, for the finished change. Sudo in Curiosity Studio works that way: one review of one diff.
Can an AI assistant approve its own changes?
It should not be able to. In Curiosity Studio, Sudo can stage a commit but cannot apply it. An administrator approves it. For an administrator who may only read, Sudo drafts the change and cannot stage it.
Articles
Read next
What is an AI factory?
AI factories
The two meanings of the term, the six stations a request passes through, and what a factory needs underneath before it ships anything.
ReadWhat is a knowledge graph?
Knowledge graphs
Entities, typed relationships and a schema. How a knowledge graph differs from a table and a search index, and how to tell a useful one from a diagram.
ReadWhat is a context graph?
Context graphs
Two meanings of a new term, decision traces and a permission-aware graph of records, where they meet, and where a knowledge graph ends.
ReadYour data. Your infrastructure.