Talk Session 3: Enterprise AI
Building the Software Factory
Eno Reyes — Co-Founder / CTO, Factory AI
Every software company already runs an implicit loop — signals in, triage, plan, code, validate, ship, new signals out — but almost nobody models it explicitly; the "software factory" makes that loop explicit so signals can flow to deployed software without human intervention, and the new human job is to build, govern, and refine the factory.
TL;DR
- Coding isn't the hard part — it's the easiest part. Companies don't feel the promised 100x because they've only applied AI to one narrow slice of the loop while everything around it stays a human-driven synchronous workflow.
- Three design commitments for a software factory: stay model-independent (commoditize the model layer to reach the real cost/quality Pareto frontier); own and govern your own factory (on-prem and airgapped options matter); and run every surface off a shared agent core rather than hyper-specializing a separate architecture per workflow.
- The environment, not the model, is the binding constraint. The highest-leverage investment is dev reproducibility, environment cleanliness, linting, type checking, and test quality — i.e., enough deterministic, verifiable feedback loops that agents can converge without consulting a human.
- Govern before you scale. Agents will get dangerous access — "not a matter of if, but when." Build layered controls at the level an organization 10x your size would need: a 5-person startup should run 50-person controls.
- Measure outcomes, not tokens: cycle time, code shelf life, incident time, bug counts; treat cost as cost-per-change or cost-per-loop, roughly the way you'd think about salary.
Key Points
The software factory: making the implicit loop explicit (~00:53–00:57)
Three and a half years of evolution: autocomplete → chatbots → agents → software factories. A software factory is simply the loop that already exists inside every software company, drawn explicitly: signals flow in (customer feedback, internal telemetry, an executive announcing a pivot), get triaged, feed planning, then coding, validation, shipping, deployment — and the deployed, monitored software generates fresh signals.
The trouble is that triage happens inside people's heads and is almost never explicitly represented in any real system, and planning is scattered and unstructured across Jira, Notion, or Confluence. As he put it, this implicit feedback loop exists at almost every company building software, and yet an explicit model of it does not really exist anywhere.
That explains the gap between "AGI is six months away, expect 100x" and what teams actually experience: you've only AI-ified one narrow slice, and the rest remains a synchronous, autocomplete-shaped interaction. The real design question is how to build a system where signals flow all the way to deployed software without human intervention — which he's careful to distinguish from without humans.
How the system should be designed (~00:57–01:01)
- Model independence. Model vendors will argue you must verticalize aggressively and couple the agent harness to the model; empirically he finds that clearly untrue. Aggregate and commoditize the model layer to actually reach the cost/quality frontier.
- You are the sovereign of your factory. Even when buying SaaS, you should control it — hence on-prem and airgapped deployments. The reasoning: your software factory is your company, so it has to keep running regardless of which vendors come and go.
- A shared agent core. The factory should span every action in the product and engineering org — code review, security analysis, testing, documentation, incident response. But specializing a distinct agent architecture per surface lands you in an odd microservices trap; at a high level all these workflows are the same thing: gather information, act on computer systems, keep the user informed. What changes is context and workflow, not the agent.
Larger organizations then need governance — consistency, preventing an agent from dropping a bunch of tables, IT ops. He argues that's the agent platform's job, and offers a concrete vendor test: look for a page listing enterprise or organizational controls, and count them. If it doesn't cover hundreds of scenarios, keep shopping. He cited Docker's recent vendor-neutral agent control set (~35 controls) as a nice way to present this.
The environment is the bottleneck (~01:02–01:04)
His analogy: humans 200,000 years ago were roughly the same animal we are; what changed is that we completely rebuilt the environment around us. Likewise, you can wait for models to improve — they probably will — but updating the codebase and engineering system around the factory is by far the highest-leverage move.
The real test: does your organization have enough deterministic, verifiable feedback loops for agents to succeed without needing to consult a human? Waiting for code review to say the code is poorly organized is one thing; a deterministic signal saying so lets the agent loop and validate its own work until it passes.
On access: agents will end up with dangerous privileges, and it's not a matter of if but when — so treat them like people and build layered systems of control. Anyone who has built an org past 50–75 people knows that even 75 extremely competent people will eventually include someone who drops the database. Introducing agents is like scaling to an organization 10x larger, so the guardrails need to scale accordingly: a 5-person startup needs 50-person controls, a 50-person company needs 500-person controls. None of this requires reinventing the wheel — it's established software development best practice, now enforced on agents.
The new human role, and what to measure (~01:04–01:08)
The human job becomes observe → intervene → iteratively refine the factory: spot a missing guardrail and implement it, see where agents fail and add context, update the workflows agents follow. He recommends listening to talks about chip fabs or real Industry 4.0 factories, where dedicated process-control and loop-management roles exist purely to say "we lost 10% of resources to this inefficiency, go fix that part of the factory," then iterate. Software is about to do the same.
Code review is the natural first case study: build a system that makes you confident merging 5%, then 10%, 50%, 100% of PRs without human review. What does that system look like? He borrows the self-driving analogy — somewhat dark, but everyone recognizes the moment road fatalities drop to human parity or an order of magnitude below, and we let the thing drive. Validation needs the same: define up front which metrics (bugs, incidents, MTTR) would justify taking the human out of the review step, and have engineers thinking about that inside your company.
What to measure: cycle time, code shelf life, incident time, bug counts. Do not measure tokens — it gives you very little information or value. If you want cost, use cost per code change or per loop or per week, treating it roughly the way you treat salary.
Three takeaways: (1) invest in agent readiness; (2) govern before you scale; (3) decide in advance which outcomes you'll measure — you can't optimize against something you aren't measuring.
Quotes
"Coding is just not the hard part. It's basically in fact the easiest part of this problem." (~00:56)
Everything around writing code is where the mess lives.
"Your software factory is your company. If you build software, you're basically describing the new version of your business." (~00:59)
The argument for sovereignty over your own agent platform.
"It's not really a matter of if, but just when." (~01:03)
On agents getting dangerous access — build the guardrails now, sized for an org 10x larger.
提到的專案與資源 / Projects & Resources
| 名稱 Name | 說明 | Description | 備註 Notes |
|---|---|---|---|
| Factory AI | 講者共同創辦的公司,提供建構「軟體工廠」的平台,支援 SaaS / on-prem / airgapped | The speaker's company; platform for building software factories, offered as SaaS, on-prem, or airgapped | 講者為 Co-Founder / CTO |
| Docker 的 agent 控制項清單 / Docker agent controls | 約 35 條、vendor-neutral 的 agent 平台控制項 | A vendor-neutral set of ~35 agent-platform controls | 條目數與正式名稱待確認 / exact name and count to verify |
逐字稿勘誤 / Transcript Corrections
| 字幕原文 Heard as | 應為 Should be |
|---|---|
| Anna Reus | Eno Reyes |
| MTR | MTTR(mean time to recovery/resolution) |
| code reveal | code review |
| "you have an AI CEO or saying like oh AGI's here" | 語意為「聽到 AI 公司 CEO 說 AGI 快來了」/ paraphrase: hearing an AI-company CEO claim AGI is months away |
待確認 / To Verify
- Docker 那套「35 個 agent 控制項」的正式名稱與確切條目數:Docker 確有 AI agent runtime governance 框架,但搜尋未能對上「35」這個數字。/ Docker does publish an AI-agent runtime governance framework, but the "35 controls" figure could not be matched to a published document.
- 投影片上「laundry list of controls(security / governance / enablement)」的完整內容——講者明說可以拍照,逐字稿無法還原。/ The full controls checklist on the slide (security / governance / enablement) — he told the audience to photograph it; not recoverable from the transcript.
- 講者提到「上一場的 talk」談 specialized agents 與「上一份 deck 說 you can't optimize what you can't measure」,指的應是同場次前面的講者,未指名。/ He references "the talk just a bit ago" and "the last deck" without naming them.