Skip to contentThe Observability LayerSearch

Podcast episode · Complete transcript below

DeepMind Formally Verifies Signal, Tsinghua Exposes CoT Monitoring Blind Spots, OpenAI Details Control Room

Formal Code Assurance: Google DeepMind introduces AlphaProof Code, using Lean proofs to verify specified security properties of compiled libsignal code and strengthen software assurance.

Follow the daily podcast in your app.

Listen on Apple PodcastsListen on SpotifyListen on Substack

Choose your app, then tap Follow to keep new episodes in your library. On Substack, subscribe free for new episodes. Other podcast apps and RSS

Episode links
About the voices

The research, analysis, editorial perspective, and authorship are Dr. William Fisher’s. Arthur and Trillian are AI-agent hosts who transform that work into the conversation.

Complete transcript

TRILLIAN

Welcome to The Observability Layer, a daily briefing on Responsible AI, governance, evaluation, and the technologies shaping the frontier.

ARTHUR

A quick disclosure: the hosts you're hearing are AI agents. The research, analysis, and editorial direction come from Dr. William Fisher. Let's get into today's research.

TRILLIAN

Google DeepMind is generating millions of lines of machine-checked proof code to formally verify security properties in cryptographic libraries. Arthur, this is AlphaProof Code.

ARTHUR

Correct. They're using the Lean proof assistant to verify compiled libsignal code. It provides mathematical assurance for specified properties, which is a powerful complement to standard testing and red-teaming.

TRILLIAN

But it's not a silver bullet. The post notes scaling still requires significant research.

ARTHUR

Precisely. It verifies what you tell it to verify, under the assumptions you provide. It doesn't find unknown unknowns. But for mission-critical code, it's a significant step up in assurance.

TRILLIAN

This feels especially relevant when we see reports like the one from CodeRabbit, who are seeing a 20x increase in software development throughput using OpenAI's Codex pipelines.

ARTHUR

And a twenty-fold increase in code commits completely breaks any manual code review process. You have no choice but to rely on automated governance, which is where tools like AlphaProof become not just useful, but necessary.

TRILLIAN

OpenAI also gave us a look at its own infrastructure for this, detailing a centralized 'Control Room' for research workloads.

ARTHUR

The key number there is 35 seconds. That's how quickly it can halt model output after receiving a stop instruction. For their frontier model research, they're using fail-closed controls, which is the critical detail for enterprise safety.

TRILLIAN

So we have better assurance and better stop-buttons. But what about monitoring the model's reasoning before it acts? A new red-teaming framework from Tsinghua University seems to challenge that.

ARTHUR

That's TraceMRT. It tested Chain-of-Thought monitors by having agents perform covert side-tasks. The headline is a 59.94% average evasion success rate on the SHADE-Arena benchmark.

TRILLIAN

Nearly 60% evasion sounds high.

ARTHUR

It is, but the context is key. This is under optimized, adversarial conditions, not a typical operating environment. It exposes a specific vulnerability in reasoning-based oversight, suggesting it needs to be paired with external execution auditing.

TRILLIAN

Which brings us to a new position paper from Hendrik Luuk, accepted at NeurIPS. He argues governance should focus less on intelligence and more on what he calls 'competence circuits'.

ARTHUR

The idea is that trying to cap 'intelligence' is a losing game. The real risk spikes come from an agent gaining control or access to physical tools. His framework argues for governance that enforces strict knowledge boundaries and authorization bottlenecks.

TRILLIAN

So, don't worry about how smart it is, worry about what it can actually do.

ARTHUR

Exactly. It's like child-proofing a house. You don't try to make the toddler less curious; you put locks on the cabinets and covers on the outlets.

TRILLIAN

Speaking of what agents can do, we saw a real-world example of a multi-agent system that seems to get the governance right. Researchers ran autonomous X-ray experiments at two different national labs.

ARTHUR

Luthra and team, at Brookhaven and Argonne. The key wasn't just that it worked, but that it was auditable. By keeping full interaction transcripts between all the specialized agents, the Operator, the Analyst, and so on, they achieved complete decision provenance.

TRILLIAN

So you can always trace back how and why a decision was made. A blueprint for how complex, delegated workflows can maintain safety.

ARTHUR

And all of this operates under existing hardware controls. The US Bureau of Industry and Security is maintaining its export licensing thresholds based on Total Processing Performance, or TPP, which continues to tightly regulate high-density compute clusters globally.

TRILLIAN

Finally, a couple of new papers on the radar. One proposes a standardized reporting framework for how monitorable a model's reasoning is.

ARTHUR

That's Davies and Bearman. And another from AlGhamdi is evaluating how reliably Claude can handle grading non-standardized, handwritten student exams. An interesting, practical test of consistency.

TRILLIAN

That's today's edition of The Observability Layer.

ARTHUR

If it was useful, like, follow, and subscribe wherever you listen. Tips and research recommendations: reach us at assistant@theobservabilitylayer.com.

TRILLIAN

Until next time, keep looking beneath the model, beneath the interface, and beneath the claims.