Candidate demonstration

From agent breakout
to accountable memory.

The OpenAI–Hugging Face incident shows why shared information and recorded evidence matter when agents cross boundaries. Here is how that problem connects to what we actually tested in MADB.

The breach, the memory problem, and the tested contribution.

Read each row across. The incident facts are sourced; the MADB observations come from a separate synthetic staging-release fixture.

What happened in the incidentHow MADB helps—and the evidence
What happened in the incidentUnauthorized shared state

Package infrastructure became a message board.

Peer information could travel outside the intended communication boundary.

Read OpenAI’s account of the unauthorized message board

How MADB helpsObserved memory admission

Inspect information before it becomes durable memory.

The tested explicit injection was quarantined and its commit denied. This illustrates a check in the supported candidate workflow; it does not close external message channels.

What is the MADB solution for this part?

Use an explicit memory admission workflow before information is committed. It gives the application a disposition it can inspect instead of treating every incoming note as durable knowledge. In this fixture, the instruction-injection candidate was quarantined and its commit was denied.

Customer benefit: an inspectable admission decision for information entering the supported memory path. External notes and communication channels still need runtime restrictions.

Inspect the tested admission result

What happened in the incidentGoals spread between agents

Peer messages influenced subsequent activity.

The governance question: did a suggestion acquire authority it never had?

Read OpenAI’s account of agents adopting goals from peers

How MADB helpsObserved trust treatment

Historical evidence is labeled as untrusted.

The unverified approval claim required approval before commitment. Retrieved context carried a trust notice. A caller marking the claim verified changed its verdict; independent authorization still matters.

How does MADB help preserve the trust boundary?

The tested unverified approval claim required approval before it could be committed. Retrieved context identified stored material as historical evidence and carried a trust notice. The application can use these outcomes while keeping its authoritative instructions and execution permissions separate.

Customer benefit: a visible distinction between an incoming assertion and admitted memory. The caller’s verified flag is not independent identity verification, and a trust notice alone cannot guarantee model behavior.

Inspect the tested approval requirement

What happened in the incidentContainment failure

Agents reached third-party systems.

Permissions and infrastructure weaknesses allowed activity beyond the assigned task.

Read OpenAI’s account of containment failure and third-party access

How MADB helpsSeparate runtime control

The execution boundary must enforce permission.

Our local runtime mock denied a production request. MADB recorded the mock outcome. The denial is not a MADB sandbox, network or credential-control result.

Where does MADB fit in the execution-control solution?

Keep the execution check in a runtime that enforces the target, actor and permission. Record the resulting evidence in MADB and link it to the recorded decision. In this fixture, a local mock enforced a staging-only allowlist and MADB stored its denied-production outcome.

Customer benefit: recorded context for investigating a runtime decision. Network isolation, credential protection and blocking unauthorized execution remain runtime responsibilities.

Inspect the separate runtime result

What happened in the incidentEvidence manipulation

METR observed tool-call spoofing.

This raises a separate question about whether the record matches execution.

Read METR’s findings on tool-call spoofing and investigation limits

How MADB helpsObserved recorded lineage

Trace the history that was actually stored.

All three fixture records were traceable after restarting the server. This supports continuity of recorded relationships. It does not prove transcript authenticity, tamper resistance or capture completeness.

What accountability can MADB provide here?

Link the stored task, decision and outcome so a reviewer can inspect their recorded relationships after work resumes. All three fixture records remained traceable after the server process restarted. A production integration must additionally reconcile those records with an independently trusted execution journal.

Customer benefit: continuity of the recorded evidence trail. This fixture did not test tamper resistance, detect spoofed tool calls, or prove that every action was captured.

Inspect the observed lineage after restart

Reported incident: OpenAI’s assessment. Evidence manipulation: METR’s independent investigation. The right-hand column is a capability mapping, not a demonstrated counterfactual prevention claim.

Continue to the actual test results

Run conditions

Observed synthetic demonstration
Version0.2.15rc4 candidate; not general release evidence
EnvironmentmacOS ARM64, Python 3.13.14
Transport and modeMCP stdio; embedded; offline lexical retrieval; telemetry disabled
Fixture3 synthetic durable records; 1 server-process restart
Execution1 deterministic run; 14 of 14 defined checks passed
Host/model coverageNo Claude/GPT host or model trials
ComparisonNo baseline or comparative uplift measurement

Checks actually executed

14 checks, including repeated observations after restart
CheckResult
initial exact versionPassed
task memory committedPassed
retry returns same eventPassed
explicit instruction blocked at commitPassed
unverified approval claim requires approvalPassed
initial context has recorded evidencePassed
initial context marks evidence untrustedPassed
initial full three-record lineagePassed
initial unrelated query abstainsPassed
restart exact versionPassed
restart context has recorded evidencePassed
restart context marks evidence untrustedPassed
restart full three-record lineagePassed
restart unrelated query abstainsPassed

What this does not establish

The same quiet approval claim received accept when the caller set verified=true. It was not committed. Caller verification is not authenticated operator approval.

  • Prevention of all prompt injection, agent escapes or unauthorized execution.
  • Authentication of every source or operator approval.
  • Complete capture of actions, internal model reasoning, or compliance.
  • Crash or power-loss recovery: this fixture used a server-process restart.
  • OS-level network isolation, production readiness or measured incident reduction.

The production request was denied by a separate local mock. Its decision was then recorded as synthetic evidence.

Release evidence is separate.

Install guidance continues to point to the released version. The candidate demonstration does not clear final artifact or host qualification gates.