Talk Session 2: Frameworks & Dev Platforms
OpenSage: Next Generation of Agentic AI
Wenbo Guo — Assistant Professor, UCSB
Every agent framework today makes a human pre-specify topology, toolset, and memory structure — which is exactly the "feature engineering" deep learning made obsolete a decade ago. OpenSage ships only a minimal scaffold and lets the agent spawn its own sub-agents, write its own tools, and design its own memory: what the speaker calls agent 2.0.
TL;DR
- The problem: today you design the whole system before you build the agent — topology, toolset, and memory structure are all pre-specified. But on complex long-horizon jobs an agent needs to spawn sub-agents mid-run and often discovers its given tools aren't enough. Freezing all of that upfront caps generalizability.
- The analogy: this is feature engineering circa 2006–2016 — injecting human inductive bias and shrinking the model's search space. Deep learning's answer was to feed raw data and let the model figure it out. OpenSage does the same for agents: ship a minimal scaffold and let AI build the agent.
- Results: at release (~February 2026) OpenSage beat Claude Code and Codex on coding and security benchmarks; more striking, it was run against the DEF CON 2026 qualifiers — 7 of 15 non-interactive challenges solved, 8 flags total, good enough for a top-five finish among all teams that ever played, and it beat every team claiming no or low AI use.
- What's next: building the agent is step one; the model has to co-evolve with it. Even the latest models haven't fully learned to build their own agents (they try to spawn sub-agents and fail), so the work now spans the framework, model training, and an inference stack designed for agent trajectories.
Key Points
The ceiling of agent 1.0: everything is decided upfront (~00:04–00:06)
Guo opened with how agents get built today: the agent structure, topology, toolset, and memory structure are all fixed before any code runs — "it's like you build a software, you know exactly what you want to build, you have a clear system design, and then we let the agent run the job."
That breaks down on long-horizon work. Mid-execution an agent may need to spawn its own sub-agent, or realize the tools it was handed aren't sufficient and that it needs to invent new ones. If all of that is pre-specified, you have constrained the agent's capability and generalizability.
From feature engineering to agent 2.0 (~00:06–00:08)
The framing comes from ML history. Ten or twenty years ago, step one in building a model was feature engineering — extracting features from raw inputs, which really means baking human knowledge, or inductive bias, into the model. Then the field discovered that step was unnecessary: train a deep network on raw data and it figures the features out itself, and without the inductive-bias constraint it searches a much larger space for better solutions.
OpenSage asks the same question about agents. Skip the manual feature engineering — the pre-specified workflow, topology, and toolset — and instead build a minimal scaffold that lets the agent build its own agent: give it some initial tools, and let it spawn sub-agents, design its own workflow topology, write its own tools, and even design its own memory along the way.
Concretely, they redesigned the whole ADK (agent development kit) so the agent can explore its own topology and author its own tools during execution. A comparison slide put OpenSage against Google's and other frontier ADKs on exactly these capabilities — and because no existing ADK offers that freedom, they call it agent 2.0, with today's frameworks as agent 1.0.
Evidence: benchmarks and DEF CON (~00:09–00:12)
- Benchmarks: evaluated mainly on coding plus several security benchmarks. At release (~February this year) it outperformed all existing agent frameworks against Claude Code and Codex on SWE-bench, SWE-bench Pro, and others. He noted the numbers are already dated — OpenSage keeps evolving.
- DEF CON 2026 qualifiers: he described it as the Olympics of offensive security, normally requiring a team of professional hackers working 48 hours, sometimes hundreds of them. Since the organizers don't allow AI submissions, the team ran in parallel with the live competition. Of 15 non-interactive challenges, it solved 7; post-hoc analysis showed 4 more were close enough that another hour might have cracked them. 8 flags total — enough for a top-five placing among all teams that have ever competed, and enough to beat every team that claimed no or low AI usage.
- The behavior in the traces is the real point: OpenSage ran five to six hours continuously and spawned thousands of sub-agents to get there, demonstrating that it genuinely scales its own topology to task difficulty.
Closing: the model has to co-evolve (~00:12–00:13)
The agent is only the first step; the brain matters too. Their observation running OpenSage on the latest models is that the model hasn't fully figured out how to build its own agent — it tries to spawn a new agent and the attempt fails.
That pushes them toward an end-to-end picture: use new agents to train the model, train the model to spawn its own agents and write its own tools better, and — because agent trajectories look nothing like pure QA tasks — build new agent inference frameworks as well.
The closing message: the future of AI agents is about opening up the freedom for AI to explore everything that ultimately constitutes the agent. What humans should supply is meaningful scaffolding, a powerful model, and the most efficient inference framework.
Quotes
"What about we just build a minimal set of scaffold that enable the agent to build its own agent?" (~00:07)
The whole design philosophy in one sentence.
"We want something like AI build AI — agent build agents." (~00:07)
"This is the AI-only agent that's able to beat a team of professional hackers that didn't use AI in their competition." (~00:11)
The DEF CON headline.
提到的專案與資源 / Projects & Resources
| 名稱 Name | 說明 | Description | 備註 Notes |
|---|---|---|---|
| OpenSage | 讓 LLM 自行生成 agent topology、工具集與階層式記憶的 ADK | ADK that lets an LLM self-generate agent topology, toolsets, and hierarchical memory | 論文 OpenSage: Self-programming Agent Generation Engine(arXiv 2602.16891);GitHub opensage-agent/opensage-adk;官網 opensage-agent.ai |
| DEF CON 2026 CTF Qualifiers | 攻擊性資安領域最具指標性的 CTF 資格賽 | The flagship qualifier CTF in offensive security | 演講中 OpenSage 與正賽同步平行跑,取得 8 flags |
| SWE-bench / SWE-bench Pro | Coding agent 標準 benchmark | Standard coding-agent benchmarks | 字幕聽成 "several bench" / "swen pro" |
逐字稿勘誤 / Transcript Corrections
| 字幕原文 Heard as | 應為 Should be |
|---|---|
| Wimbleu / Wimbo | Wenbo (Guo) |
| UCS Barbara | UCSB (UC Santa Barbara) |
| open sage / open s / open stage | OpenSage |
| a genti / aentic | agentic |
| agent design cookie | agent development kit (ADK) |
| cloud code / codeex | Claude Code / Codex |
| several bench / swen pro | SWE-bench / SWE-bench Pro |
| Defcon 2026 qualification game | DEF CON 2026 CTF Qualifiers |
| industrial bias | inductive bias |
| span (its own agent) | spawn |
待確認 / To Verify
- 講者自述除 UCSB 外還是某處的 research scientist,字幕作 "Met Times SL",聽起來像 Meta Superintelligence Labs (MSL),需確認。frontmatter 依官網議程僅列 UCSB。/ He mentioned a second affiliation transcribed as "Met Times SL", plausibly Meta Superintelligence Labs — needs confirmation; the frontmatter follows the official agenda (UCSB only).
- 第三個 benchmark 字幕作 "dialops gym",拼法與正確名稱待確認(可能是某個 security/DevOps 類 gym benchmark)。/ A third benchmark was transcribed as "dialops gym" — correct name unknown.
- 「解出 7 題」與「取得 8 個 flag」數字不一致,講者未說明,照原話記錄。/ "Solved seven" vs "retrieved eight flags" is inconsistent in the talk itself; recorded as spoken.
- OpenSage 發布時間他說「about February this year」,對照 arXiv 編號 2602 相符,但正式發布日期待查。/ He dated the release to "about February this year", consistent with the arXiv ID (2602); exact release date unverified.