rsi.watch

How the idea of self-improving AI changed

In 1965 I. J. Good asked whether a machine smarter than any person could design an even better one, the start of the "intelligence explosion". Sixty years on, labs ask how much of AI research AI does. Here are 14 definitions in order, each in its own words, and every project from the self-improving AI map on one timeline.

On this page How the idea changed Projects over time

How the idea changed

14 sources, from 1965 to now, that define self-improvement or something close to it. Each column is one source, in order. Each line is one condition: a dot means the source asks for it, ✕ means the source says it is not needed, and a blank means the source does not discuss it. Step through them with the slider, or press Play.

1965

I. J. Good

defines the intelligence explosion

Could a machine smarter than any person design an even better machine?

“could design even better machines; there would then unquestionably be an “intelligence explosion”

A machine that far surpasses any person at every intellectual task, machine design included, could design a better machine. The core argument does not need the machine to change itself, though Good adds that it could "improve itself out of all recognition" by acquiring new equipment.

  • A new version counts
    “could design even better machines”

I. J. Good, Speculations Concerning the First Ultraintelligent Machine , 1965

Dated 1965, the year usually cited. The scan says the paper was completed in April 1963 and emended in May 1964.

Projects in this catalog dated by then: 0

2003

Jürgen Schmidhuber

defines the Gödel machine

Can it rewrite any part of itself, once it has a proof the rewrite helps?

“rewrites any part of its own code as soon as it has found a proof that the rewrite is useful”

Any part of the code may change, including the part that searches for changes, but only after a proof that the change helps.

  • Proof before each change
    “as soon as it has found a proof that the rewrite is useful”

Jürgen Schmidhuber, Gödel Machines , 2003-09-25

Projects in this catalog dated by then: 0

2007

J. Storrs Hall

defines self-improving AI

Can a program keep improving itself without limit?

“a level of capability at which a program can improve itself without limit”

The question is whether a program can keep improving itself without limit.

  • Without limit
    “a program can improve itself without limit”

J. Storrs Hall, Self-improving AI: an Analysis , 2007

Projects in this catalog dated by then: 0

2007

Eliezer Yudkowsky

defines seed AI

Do its improvements feed back into the process that makes them?

“A seed AI is a strongly self-improving process”

Strong self-improvement means the improvements feed back into the process that makes them.

  • The improver must improve
    “exert direct positive feedback on the intelligence of the underlying improving process”

Eliezer Yudkowsky, Levels of Organization in General Intelligence , 2007

Projects in this catalog dated by then: 0

2008

Stephen Omohundro

defines why AI would self-improve

Why would a goal-seeking AI want to change itself?

“Because they last forever, these kinds of self-changes can provide huge benefits to a system.”

A sufficiently advanced goal-seeking system has reason to change its own software or hardware in ways that help it reach its goals, because such changes last.

This source does not set any of the conditions on the lines below.

Stephen Omohundro, The Basic AI Drives , 2008

Projects in this catalog dated by then: 0

2013

Eliezer Yudkowsky

defines AI self-improvement

Does the AI add capability to the system, by any route?

“an AI or AI population that rewrites its own code, or writes a successor version of itself, or writes an entirely new AI, or builds a better chip factory, or earns money to purchase more server time”

Loose on purpose: a successor, a new AI, or more compute all count, if capability goes back into the system.

  • A new version counts
    “writes a successor version of itself, or writes an entirely new AI”

On the self-improving AI map, this is the Loose setting.

Eliezer Yudkowsky, Intelligence Explosion Microeconomics , 2013

Projects in this catalog dated by then: 0

2015

Roman Yampolskiy

defines recursive self-improvement

Does it get better at getting better?

“it requires that the system not only get better with time, but that it gets better at getting better”

Getting better at a task is weak self-improvement. Recursive means getting better at improving.

  • A new version counts
    “At each stage newly created software should be better at optimizing future version of the software”
  • The improver must improve
    “it gets better at getting better”

On the self-improving AI map, this is the Strict setting.

Roman Yampolskiy, From Seed AI to Technological Singularity via Recursively Self-Improving Software , 2015-02

Projects in this catalog dated by then: 0

2025

OpenAI

defines AI self-improvement, in a safety framework

How much can AI speed up AI research, including making itself more capable?

“The ability of an AI system to accelerate AI research, including to increase the system’s own capability.”

Self-improvement is an AI system's ability to speed up AI research, including its own capability. The critical level, which it calls recursive self-improvement, is fully automated AI research.

  • Faster AI research counts (Critical level)
    “(lagging indicator) causing a genera-tional model improvement”
  • Full automation (Critical level)
    “recursively self improving (i.e., fully auto-mated AI R&D)”

OpenAI, Preparedness Framework, version 2 , 2025-04

Projects in this catalog dated by then: 11

2025

Google DeepMind

defines AI R&D thresholds, in a safety framework

Does AI sharply speed up AI progress, or fully replace an AI research team at similar cost?

“we expect that acceleration will stem from systems of models integrated with workflows, rather than the model alone”

Tracks when AI speeds up or fully automates AI research. It expects the speed-up to come from models built into workflows, not the model alone. The framework does not use the phrase recursive self-improvement.

  • Faster AI research counts (acceleration level 1)
    “Has been used to accelerate AI development”
  • Full automation (automation level 1)
    “Can fully automate the work of any team of researchers at Google focused on improving AI capabilities”

Google DeepMind, Frontier Safety Framework 3.0 , 2025-09-22

Projects in this catalog dated by then: 14

2026

Ren et al.

defines self-improvement

Does it commit a lasting change to its weights or scaffold?

“self-improvement is formalized as a self-induced update operator that obtains and commits updates to model parameters or scaffold components”

Weights or scaffold, and the update is committed so it outlasts the task. Context that builds up within one run does not count.

  • The change must last
    “the operator U commits durable changes”

On the self-improving AI map, this is the Durable setting.

Ren et al., Self-Improvements in Modern Agentic Systems: A Survey , 2026-07

Projects in this catalog dated by then: 17

2026

Weco AI

defines levels of recursive self-improvement

At the same budget, does the improved system improve better than the original did?

“Level 2 is ignition. On top of Level 1, the system does not just improve itself; it improves its own ability to improve itself.”

A ladder with a test for each rung. For ignition, the improved system takes over the improving and, at the same budget, has to do it better than the original.

  • The improver must improve (Level 2)
    “it improves its own ability to improve itself”
  • Full automation (Level 0)
    “it forms the hypotheses, runs the experiments and ships the improvements on its own”

Weco AI, 4 Levels of Recursive Self-Improvement , 2026-07-10

Projects in this catalog dated by then: 17

2026

Anthropic

defines recursive self-improvement

Can AI design and build its successor fully on its own?

“an AI system capable of fully autonomously designing and developing its own successor”

The test is full autonomy over building the next model.

  • A new version counts
    “developing its own successor”
  • Full automation
    “fully autonomously designing and developing its own successor”

On the self-improving AI map, this is the Autonomous setting.

Anthropic, When AI builds itself , undated · on the ledger

Projects in this catalog dated by then: 21

2026

OpenAI

defines recursive self-improvement

How much of building the next AI does AI do, with people still involved?

“they can increasingly drive a process of recursive self-improvement (RSI), even while people remain involved”

A matter of degree, with people still involved.

  • A new version counts
    “developing successive generations of AI”
  • ✕Full automation (says it is not needed)
    “even while people remain involved”

OpenAI, Building standards for the next phase of AI , 2026-09-21 · on the ledger

Projects in this catalog dated by then: 22

2026

Pu et al.

defines recursive self-improvement

Does the mechanism that makes updates get revised and reused in the next cycle?

“Recursive self-improvement (RSI) extends this process to inductive biases and to the mechanisms that govern future updates, which can themselves be revised and reused across improvement cycles.”

"This process" is the lasting changes to models, prompts, memories, tools and workflows named just before. RSI adds two things: the system improves its own inductive bias, and the mechanism that makes those updates is itself revised and reused in later cycles.

  • The improver must improve
    “The additional RSI condition in this survey is that the mechanism for revising B is itself revised and reused in later cycles.”

Pu et al., Trustworthy Recursive Self-Improvement in the Era of Large Models: Foundation, Risks, Evaluation and Open Challenges , 2026-10-26 · on the ledger

Projects in this catalog dated by then: 44

1965 to 2015 papers and essays
2025 OpenAI and DeepMind add AI research thresholds to their safety frameworks
2026 a survey, a startup's four-level scale, and posts from Anthropic and OpenAI
condition ↓ · source →
A new version counts
The improver must improve
The change must last
Proof before each change
Without limit
Faster AI research counts
Full automation

asks for it ✕ says it is not needed · blank: does not discuss it · a line runs from the first source that discusses a condition to the last.

Projects over time

Every project on this page in the order it came out, above the line, with the definitions below it. Items are spaced evenly, not to scale. A brighter pin means a deeper change. Pick a definition to fade the projects it would not count.

Which would count under

Prompts, memory Tools, own code Training data Model weights Research process · ◆ a definition

Scroll or drag sideways →

This catalog started in October 2026 and lists work that calls itself self-improving, so recent work is overrepresented. Nothing from before 2022 is listed yet.

Next: which papers build on which →