Tratopedia
Side N繁中
Settings

Text size

Language

Theme

High contrast

Version

v1.184.0

The release this page was built from. It is what the service worker caches under.

Terminology · LLM Engineering · AI Agents · Benchmarking · AI · ExplainerThe term and its practice, October 2022 to August 2026

Fourth of five · the one that never settled

Everyone Agrees You Should Write Loops. Nobody Agrees What One Is.

In the spring and early summer of 2026 some of the best-known engineers working with coding agents said the same thing: stop prompting the agent, and write loops that prompt it. Boris Cherny, who created Claude Code, said it on stage in San Francisco on 15 April; Peter Steinberger's post of 7 June made it travel, and Addy Osmani named it loop engineering the same day. Six accounts of what a loop is followed, and they describe loops of very different sizes — from a single prompt to a product cycle that runs for weeks with customers inside it. Anthropic's own explainer opens by conceding that X gives “multiple different answers”. What nobody disputes is the mechanism: something outside the agent that will not take “I am done” for an answer. And in August the first benchmark to hold the agent fixed and vary what steers it found the best steering finishing 24.69% of full tasks, against 18.52% with none.

  • 53days between Cherny's remarks on stage, 15 Apr 2026, and the post that made the idea travel, 7 Jun
  • 6accounts of what a loop is, from Cherny's in April to Ng's and Anthropic's on 30 June — at sizes from one prompt to weeks
  • 24.69%of full coding tasks finished by the best loop controller in the first benchmark to hold the agent fixed, against 18.52% with none
  • 9.4×that controller's estimated cost per run, against the agent left to work alone

Two sayings, one concession, one distinction None of the four is a definition, and that is the point.

  • Boris Cherny · 15 Apr 2026

    “My job is to write loops”

    A report of his own practice, not a definition.

    • Said on stage at an evening event run by WorkOS in San Francisco, and published as a video on 2 June. The fullest quotation: “I don't prompt Claude anymore. I have loops that are running. They're the ones that are prompting Claude and figuring out what to do.”
    • His words reach print in two slightly different wordings, and Business Insider reports a third line, given to CNBC: “Claude writes the prompt, and now I'm talking to that new Claude that is kind of coordinating.”
    • The event's host summarises his setup as hundreds of Claude instances reading Twitter, GitHub issues and Slack for product ideas — and adds that most of those ideas are bad today.
  • Peter Steinberger · 7 Jun 2026

    “You should be designing loops that prompt your agents”

    The post that made the phrase travel: more than 8.5 million views by September.

    • It opens “here's your monthly reminder” — so by its own account it was not the first time he said it, only the time it caught.
    • Four days later he posted his own loop: tell Codex to maintain your repositories, “wake up every 5 minutes and direct work to threads”.
    • Business Insider describes him as an OpenAI engineer. The post is an instruction, not a definition: it says what to stop doing, and never what a loop is.
  • The Claude Code team · 30 Jun 2026

    “You'll come across multiple different answers”

    The vendor concedes the problem, then gives its own answer.

    • Delba de Oliveira and Michael Segner, writing for Anthropic: “If you spend some time on X trying to pin down what a loop actually is, you'll come across multiple different answers.”
    • Their definition: agents repeating cycles of work until a stop condition is met, in four kinds — turn-based, goal-based, time-based and proactive — sorted by what starts a loop and what stops it.
    • And advice against their own enthusiasm: “Not all tasks require complex loops; start with the simplest solution.”
  • Armin Ronacher · 23 Jun 2026

    There are two loops

    The distinction that dissolves most of the confusion.

    • “There is already an agent loop inside every coding agent.” The other is “the harness level loop: the loop outside the agent loop” — and “that loop is also not new”.
    • What the outer loop does: it catches the agent as it stops and decides whether that was really the end. The task stays alive past the point where the model by itself would have said “I am done”.
    • His own verdict is uneasy: he has “not had much success with this way of working for code I deeply care about”.

How firm is each of these? Graded first, then told — the standing is in the first column.

How firmWhatOn what
Documented at sourceThe dates: Cherny on stage in San Francisco on 15 Apr 2026; the video on 2 Jun; Steinberger's post at 18:58 UTC on 7 JunThe event's own listing and Cherny's post that evening; WorkOS's video page; the post itself
Documented at sourceOsmani's name for it, his definition, and “I'm skeptical” in the same paragraphAddy Osmani, addyosmani.com, 7 Jun 2026
Documented at sourceThe two loops, and “that loop is also not new”Armin Ronacher, lucumr.pocoo.org, 23 Jun 2026
Documented at sourceThe four kinds of loop; “multiple different answers”; “start with the simplest solution”Delba de Oliveira and Michael Segner, Claude blog, 30 Jun 2026
Documented at sourceNg's three loops, how long each runs, and “context advantage”Andrew Ng's own letter, 30 Jun 2026
Documented at sourceThe inner loop, described by a team that ships one, four and a half months before the phraseMichael Bolin, OpenAI, 23 Jan 2026
Measured, not yet peer reviewedThe best loop controller finished 24.69% of full tasks; the agent alone, 18.52%LoopArena, an arXiv preprint, 28 Aug 2026
Second-handCherny's exact words. The recording exists; the quotations here come through three write-ups, in two wordingsEzekiel Njuguna on Medium, 8 Jun 2026; Osmani; Ronacher
Second-handCherny's “Claude writes the prompt” lineBusiness Insider's report of a CNBC interview, 20 Jun 2026
Machine summaryWhat Steinberger said on stage at Microsoft Build on 2 Jun 2026The session page's own summary, which it labels as machine-generated
This page's readingThat the six accounts describe loops of different sizes rather than competing to define one thingAssembled from the six; no source says it — the nearest concedes only that answers differ

An old mechanism, a new name Every dated item, oldest first. Only the last is a measurement.

  1. 6 Oct 2022The inner loop, as a paper. ReAct has a language model interleave reasoning with actions, so that solving a task becomes a run of thought-action-observation steps. Every coding agent since runs a version of that cycle.
  2. 14 Jul 2025An outer loop in one line of shell. Geoffrey Huntley publishes “Ralph”: while :; do cat PROMPT.md | claude-code ; done — the same prompt fed to an agent over and over, one task per pass.
  3. late 2025“Closing the loop” catches on, in Andrew Ng's later dating: give an agent a specification and tests and let it iterate. He calls it “a game changer in enabling coding agents to work longer productively without human intervention”.
  4. 23 Jan 2026The inner loop, from inside a product. OpenAI's Michael Bolin describes the Codex agent loop, “the core logic… responsible for orchestrating the interaction between the user, the model, and the tools”. A turn ends when the model stops calling tools and answers.
  5. 14 Apr 2026Most of the code is around the loop. A study of Claude Code's public source finds its core is “a simple while-loop that calls the model, runs tools, and repeats”, and that most of the code lives in the systems around it: permissions, context management, extensions, sub-agents.
  6. 15 Apr 2026The first utterance. At an evening event run by WorkOS in San Francisco, Cherny tells the hosts of the Acquired podcast that he no longer prompts Claude: he writes loops that do. He posts his thanks to the hosts the same night.
  7. 2 Jun 2026The recording goes public, with a recap from WorkOS. The same day Steinberger gives a Microsoft Build session, “Build the thing that builds the thing”, on the tools he built to build OpenClaw faster.
  8. 7 Jun 2026The post that travels, and the name. Steinberger: “Here's your monthly reminder that you shouldn't be prompting coding agents anymore. You should be designing loops that prompt your agents.” The same day Osmani titles a post “Loop Engineering” — and writes, in its first paragraph, “I'm skeptical”.
  9. 8 Jun 2026A plain-language account. A Medium write-up of Cherny's remarks gives the most concrete definition collected: a program that prompts the agent, reads what it produced, decides whether the task is done, and prompts again. It dates the remarks to 2 June, the day the video was published.
  10. 11 Jun 2026A loop, as its author uses it. Steinberger: tell Codex to maintain your repositories, “wake up every 5 minutes and direct work to threads”, with his own triage and review skills so that “some work can land autonomously”.
  11. 20 Jun 2026The mainstream picks it up. Business Insider: “‘Loop engineering’ is all the rage now” — and “the biggest concern cited about loops is, by far, cost.”
  12. 23 Jun 2026The two-loop distinction. Armin Ronacher separates the loop inside every agent from the harness loop outside it, and says where he has seen the outer one work: porting code, performance experiments, security scanning, research.
  13. 30 Jun 2026Two definitions in one day. The Claude Code team's four kinds of loop; and Andrew Ng's three loops for building products — an agentic coding loop running every few minutes, a developer feedback loop over tens of minutes to hours, and an external feedback loop of users and tests over hours to weeks.
  14. 1 Jul 2026The trade press hedges. ADTmag: the term “may prove to be more of a developer shorthand than a formal discipline”.
  15. 28 Aug 2026The first measurement. LoopArena, a preprint, holds one coding agent fixed and compares models steering it. On full tasks the best finished 24.69%; the agent left alone, 18.52%; simply restating the goal every round, also 18.52%.

Six answers, six sizes They are not competing descriptions of one thing.

Line the six accounts up and the trouble is not that they disagree. It is that they describe loops of different sizes.

Cherny's loop is a fact about a person's working day: he stopped prompting and started writing the things that prompt. Osmani's is a system on a timer — “a recursive goal where you define a purpose and the AI iterates until complete”, built from automations, worktrees, skills, connectors and sub-agents, with a file on disk as its memory; he places it “one floor above the harness”. The Medium write-up's is a program: prompt, read, judge, prompt again, until the model is a subroutine your code calls. Ronacher's is two machines, one nested in the other. Anthropic's is a taxonomy, sorted by what starts a loop and what stops it. And Ng's is an organisation: three loops, the outermost running for days or weeks with alpha testers and A/B tests inside it.

Hold the two ends together. Anthropic's turn-based loop is one prompt and its reply — “every prompt you send starts a manual loop with you directing each turn”. Ng's external loop is a product vision reshaped by users over weeks. Both are, in June 2026, “a loop”. Read carefully, they do not reduce to one object, and this page will not write the definition that pretends they do: nobody published it.

The distinction that dissolves most of the confusion is Ronacher's. A coding agent already contains a loop: the model calls a tool, reads the result, edits a file, runs the tests. That inner loop goes back to ReAct in 2022, and OpenAI described its own in January. What people started talking about in the spring is the loop outside that one — the thing that catches the agent as it stops and decides the job is not finished. Much of the arguing is people naming different loops and assuming they are naming the same one.

Which points at what the term actually contains. Nothing mechanical in it is new, and the sources say so: Ronacher's “that loop is also not new”; Ng dating closed loops to late 2025; a one-line shell loop in July 2025. What changed is who does the prompting. That is a change of job, not of technology — and each account describes the part of the job its author can see.

One more thing is worth saying plainly, because it is a disclosure rather than an argument. The loudest voices build the products that loops run on. Cherny is head of Claude Code at Anthropic; Business Insider describes Steinberger as an OpenAI engineer; Osmani, described in June as a director at Google Cloud, now lists himself on his own site as a member of Anthropic's technical staff working on Claude Code. And the most careful words come from the same people — Osmani's “I'm skeptical”, Anthropic's “start with the simplest solution”. Their advice is worth weighing on what it says, which is more cautious than the enthusiasm around it.

  • 2loops in the account that separates them: the agent's own, and the harness loop around it
  • minutes → weeksthe span of Ng's three loops, from a coding agent's cycle to users and A/B tests

What a loop actually does On the mechanism, unlike the definition, the sources agree.

  1. 1Put the work where something else can pick it upNot a prompt you type, but a queue, a schedule or an event. Steinberger's own: an agent that wakes every five minutes and directs work to threads. Anthropic's proactive loop runs from an event or a schedule, with no person watching in real time.
  2. 2Let the agent attempt it, and stopThis is the inner loop, and it needs no help: the model calls a tool, reads the result, edits a file, runs the tests, and eventually says it is done. Everything that makes it a loop happens after that sentence.
  3. 3Disagree with “I am done”The harness decides whether that was really the end. Ronacher's list of what it can do next: continue the same session, inject another message, start a fresh session with modified context, or send the task to another machine. Anthropic's /goal does it with a second model that “checks your condition and sends it back to work”.
  4. 4Make the check quantitative, and keep the checker separateAnthropic: “the more quantitative the checks are, the easier it is for Claude to self-verify.” Osmani: split the agent that writes from the one that checks, because “the model that wrote the code is way too nice grading its own homework.”
  5. 5Then use the smallest loop that worksFrom the vendor with most to gain from the opposite advice: “not all tasks require complex loops.” And the cost is real: in Business Insider's survey of the discussion, “the biggest concern cited about loops is, by far, cost.”

The first measurement One preprint, one fixed agent, 27 tasks run three times each.

What steered the agentFull tasks finishedEstimated cost per run
Nothing — the agent works alone18.52%$2.01
The goal restated at every hand-off, modelled on /goal18.52%$5.58
The best steering model24.69%$18.84
The weakest steering model16.05%$4.86

Until late August nothing held the agent still and varied the loop. LoopArena, a preprint published on 28 August 2026, does it for the part of a loop that decides what happens next. One coding agent does all the work; after each round a separate model reads a summary of the run and either sets the next assignment or stops. Five models were tried in that seat, against two fixed policies.

The result is sobering rather than triumphant. The best steering model finished 24.69% of full tasks against 18.52% for the agent left alone — by this page's arithmetic from the paper's 81 runs per policy, 20 runs against 15 — at an estimated 9.4 times the cost per run. One model steered the agent to fewer successes than no steering at all. And the policy closest to the simplest loop in use, restating the goal every time the agent stops, finished exactly as many full tasks as doing nothing, at 2.8 times the cost. On shorter slices of the same tasks it did help, from 39.51% to 46.91%. The authors' conclusion: useful loop control “must adapt to the evolving run, not just persist a goal.”

Hold it loosely, and for what it is. It is one preprint, not yet peer reviewed, with one worker model and 27 tasks, and its costs are list-price estimates that assume no caching. It does not compare a loop with a person prompting by hand — its baseline is the agent working alone. It measures which model steers best, and finds steering hard.

Where loops already work, in the account of someone who distrusts them, is narrower than the enthusiasm. Ronacher names porting code, performance experiments, security scanning and research: work that transforms code that already exists, or produces code “that intentionally does not have a long shelf life”. For lasting code he is blunt. Loops amplify a model's habit of adding local defences, so the system “slowly becomes less understandable while appearing more robust.” The one large number in circulation for a working loop, thousands of GitHub issues closed, rests on a machine summary of a talk, and is listed below among what could not be verified.

  • 24.69%best full-task success of five steering models in the first loop benchmark, 28 Aug 2026
  • 18.52%the same agent with no steering at all — and with the goal simply restated every round
  • 9.4×estimated cost per run of the best steering model, against the agent alone

What to take from this Four things, in the order they matter.

Ask which loop, and you have understood most of it

A coding agent already contains a loop — reason, act, observe — and the idea dates from 2022. What 2026 was about is the loop outside that one: the thing that catches the agent when it says it is finished and decides it is not. Ronacher draws the line most clearly, and many muddled conversations about the subject are two people naming different loops.

The word names a change of job, not a technology

Nothing mechanical is new: ReAct in 2022, a one-line shell loop in 2025, OpenAI describing its agent loop in January 2026. What changed is that the person stops being the one who writes each prompt. That is why the definitions scatter — each describes the part of the job its author can see, at its own size.

The first measurement says steering is hard

The one benchmark that holds the agent fixed found the best steering model finishing 24.69% of full tasks against 18.52% for the agent alone, at about nine times the cost, and restating the goal gained nothing on full tasks. It is one preprint, and it never compares a person prompting by hand. “Loops beat prompting” is still an expectation, not a finding.

Weigh the advocates by their caution

The people most associated with loops build the agents they run on, and they are also the ones urging care: Osmani calls himself sceptical in the post that named it, Anthropic says to start with the simplest solution, and Ronacher says the approach has not yet worked for code he cares about. Start small, keep the check separate from the worker, and watch the cost.

What could not be verified

Unconfirmed report — that a tool Steinberger built closed around 15,000 GitHub issues on its own, after the project's backlog passed 10,000. The figures appear only in the machine-generated summary of his Microsoft Build session of 2 June 2026, which also misspells the project's name; no independent account was found.

Unconfirmed report — that Steinberger had given the same reminder in earlier months, as his own words “monthly reminder” imply. No earlier post was found.

Take-home and sources

  • Yao et al., ReAct, arXiv (6 Oct 2022)
  • Geoffrey Huntley (14 Jul 2025)
  • Michael Bolin, OpenAI (23 Jan 2026)
  • Liu et al., arXiv (14 Apr 2026)
  • WorkOS, Acquired Unplugged event page (15 Apr 2026)
  • Boris Cherny on X (16 Apr 2026, UTC)
  • WorkOS, video of the conversation (2 Jun 2026)
  • Noelle Festa, WorkOS (2 Jun 2026)
  • Microsoft Build, session BRK245 (2 Jun 2026)
  • Peter Steinberger on X (7 Jun and 11 Jun 2026)
  • Addy Osmani (7 Jun 2026)
  • Ezekiel Njuguna, Medium (8 Jun 2026)
  • Brent D. Griffiths, Business Insider (20 Jun 2026)
  • Armin Ronacher (23 Jun 2026)
  • Andrew Ng on X, from The Batch (30 Jun 2026)
  • Delba de Oliveira and Michael Segner, Claude blog (30 Jun 2026)
  • John K. Waters, ADTmag (1 Jul 2026)
  • Wang et al., LoopArena, arXiv (28 Aug 2026). All read 28 Sep 2026. This term is one of five covered by the standing topic LLM engineering, which sets it beside the other four.

Reliable

Reliable, but with an interestWorth believing and reliableWeak on both, and used with careHonest, but thin

Worth believing

Each point is one source used, placed by two judgements on a six-step scale. Points carry no names: the chart shows the shape of the evidence, not a verdict on any publisher.

Versions

This document is rewritten when what it says has to change. Every version stays published at its own address.

  1. v0002 current
  2. v0001 superseded

The current version is also at latest/.