The Limits of AI: Induction, Deduction, and Why Models Can't Jump

Every week brings another breathless proclamation that Artificial General Intelligence (AGI) is just a few trillion tokens, a bigger datacenter cluster, or another reinforcement learning run away. The prevailing industry dogma assumes that intelligence is a single scalar curve: if you scale compute hard enough, everything—from writing bash scripts to inventing new branches of physics—will fall out of the loss function.

Yet in 2026, a thought-provoking position paper from Google DeepMind titled LLMs Can’t Jump, authored by research scientist Tom Zahavy (a key contributor to DeepMind’s AlphaProof system), planted a sharp flag in the ground. Zahavy made a precise, mathematically and epistemologically grounded argument that cuts through the marketing noise: today’s foundation models have mastered induction and deduction, but they are structurally incapable of abduction.

This is not a temporary bug that a larger context window or a cleaner pre-training dataset will fix. It defines the fundamental ceiling of current architectures. An AI can spot statistical regularities across trillions of words (induction). An AI can chain thousands of logical derivation steps within an established rulebook like Lean 4 or Python (deduction).What an AI cannot do is invent a brand-new axiom out of thin air when the rulebook itself is broken.

Below, we dissect the classical triad of reasoning first formulated by philosopher Charles Sanders Peirce, examine why LLMs excel at induction and deduction, explore the psychology of the abductive “aha!” moment through historic breakthroughs (Einstein, Kepler, Semmelweis), and define the true computational upper bound of machine intelligence.

1. The Triad of Inference: Peirce’s Epistemology

More than a century before the first neural network was conceived, American philosopher and logician Charles Sanders Peirce (1839–1914) demonstrated that all human reasoning collapses into three distinct, non-interchangeable modes of inference:

Notice the profound asymmetry between these three modes:

• Deduction is truth-preserving: If your premises are sound and your logic is valid, your conclusion is guaranteed to be true. It is the language of mathematics, formal compilers, and logic verifiers. However, deduction cannot generate new premises; it can only unpack what was already latent in the starting axioms.
• Induction is probability-increasing: As you observe more white swans, your confidence that all swans are white rises. It is the language of statistics, empiricism, and modern machine learning. However, induction is forever trapped in the distribution of what has already been observed.
• Abduction is the only mode that introduces new ideas: It is the creative leap that posits an unobservable mechanism, a hidden variable, or an entirely new conceptual framework to explain why reality is behaving unexpectedly.

2. Why LLMs Mastered Induction and Deduction

To appreciate why current AI hits a wall at abduction, we must first understand why it has been so spectacularly successful at the first two modes:

Induction: The Trillion-Parameter Pattern Compressor

Pre-training on the public web using the autoregressive cross-entropy loss is the most colossal inductive exercise in the history of science:

By minimizing this loss over 15 trillion tokens, the model compresses the statistical regularities of human syntax, code patterns, common sense, and semantic associations into its weight matrices. When you give an LLM three few-shot examples and ask it to complete the fourth, you are watching pure statistical induction at work. It has mapped the empirical distribution of language better than any human ever could.

Deduction: Chain-of-Thought and Verifiable Reasoning

Over the past two years, reinforcement learning with verifiable rewards (RLVR) and test-time search (DeepSeek-R1, OpenAI o1/o3, AlphaProof) unlocked deep deductive mastery.

When you place a reasoning model inside a formal axiomatic system—such as Python syntax, Lean 4 type theory, or the rules of chess—the model does not need to invent new rules. The rules (the axioms) are fixed. The model uses Monte Carlo tree search, beam search, and policy gradients to explore branching deductive chains:

In formal theorem proving, DeepMind’s AlphaProof achieved silver-medal level performance at the International Mathematical Olympiad by chaining thousands of deductive tactic steps in Lean. A model can search millions of deductive paths per second without fatigue. Within a closed system with verified rules, AI is superhuman.

3. What Abduction Truly Is: The Leap Beyond the Box

If induction finds patterns within existing data, and deduction computes consequences within existing axioms, what is abduction?

Abduction is the invention of a new conceptual ontology when the existing rulebook cannot explain reality.

It is often called the “Aha!” moment or insight reasoning. Crucially, abductive leaps possess three characteristics that make them mathematically hostile to standard gradient descent and next-token prediction:

1. Non-Intuitive or Counter-Intuitive Connections: Abduction does not follow the path of highest probability. It frequently connects two domains that appear completely unrelated or contradictory under the current paradigm.
2. Inventing New Axioms, Not Solving Within Them: It does not adjust the weights of existing variables; it defines an entirely new variable or throws out a foundational assumption that everyone assumed was sacred.
3. Born from Sparse or Zero Evidence: An abductive leap usually occurs before the validating data exists. It is not an empirical summary of thousands of data points; it is a creative hypothesis designed to explain a singular, nagging anomaly.

4. Historic Breakthroughs: Connecting the Counter-Intuitive Dots

To see why statistical transformers cannot “jump,” look at how humanity’s greatest intellectual leaps actually occurred:

Case 1: Albert Einstein and the Falling Elevator (1907)

In 1907, Isaac Newton’s laws of gravitation had reigned supreme for more than two centuries. They predicted the orbits of planets, the tides of oceans, and the trajectory of cannonballs with staggering precision. There was no raging experimental crisis. The slight discrepancy in the perihelion precession of Mercury (a microscopic 43 arcseconds per century) was considered a minor observational nuisance to be absorbed by an undiscovered asteroid.

A pattern-matching language model in 1907 trained on the entire corpus of physics would have assigned a 99.999% probability to the proposition: “Gravity is an attractive force proportional to mass and inverse-square distance.”

Then Einstein had what he called “the happiest thought of my life” (glücklichste Gedanke meines Lebens):“If a person falls freely, he will not feel his own weight.”

Through an embodied, physical thought experiment (a Gedankenexperiment of an elevator falling in a vacuum), Einstein made a wildly counter-intuitive abductive leap:gravity is not an attractive force at all. It is the geometric curvature of four-dimensional spacetime caused by mass and energy.

Notice: the empirical data required to validate General Relativity did not exist when Einstein formulated it. Arthur Eddington did not photograph the bending of starlight around the sun during a solar eclipse until 1919—twelve years later. Einstein didn’t perform induction on existing data. He invented a new axiom that told scientists what data to look for.

Case 2: Johannes Kepler and the Heresy of the Ellipse (1609)

For two thousand years—from Aristotle and Ptolemy through Nicolaus Copernicus and Tycho Brahe—astronomy rested on an unshakeable aesthetic and theological axiom:celestial bodies must move in perfect circles at uniform speeds.

When Copernicus placed the Sun at the center of the solar system, he did not abandon circles; in fact, he had to introduce more complex mathematical epicycles (circles rolling upon circles) than Ptolemy just to make circular orbits fit the sky.

When Johannes Kepler inherited Tycho Brahe’s peerless observational dataset on the orbit of Mars, he spent years trying to fit the data into combinations of circular epicycles. He managed to get the model to agree with observations across almost the entire orbit—except for a tiny discrepancy of 8 arcminutes (less than one-third the diameter of the full moon).

An optimizer would have treated 8 arcminutes as sensor noise or added another small epicycle. Instead, Kepler made the jarring abductive leap: nature does not care about our aesthetic preference for circles. Planets move in ellipses, with the Sun sitting at one focal point.

To 17th-century astronomers, an ellipse was an ugly, asymmetric, defective circle. It was completely counter-intuitive. Yet by shattering the circular axiom, Kepler collapsed decades of complex epicyclic math into three simple, elegant laws.

Case 3: Ignaz Semmelweis and the Invisible Poison (1847)

In the 1840s at the Vienna General Hospital, young mothers were dying of puerperal (childbed) fever at an apocalyptic rate of 10% to 18% in the First Obstetric Clinic (run by doctors and medical students), compared to only 2% in the Second Clinic (run by midwives).

The medical establishment dogmatically blamed the discrepancy on “atmospheric-cosmic-telluric influences” or “miasma” (bad air). When doctors tried to explain why the midwives’ ward had lower mortality, they suggested that the midwife clinic was less crowded, or that mothers in the first clinic suffered psychological trauma from hearing the priest’s bell during last rites.

Then, Semmelweis’s close friend, pathologist Jakob Kolletschka, died of identical symptoms after accidentally being pricked by a student’s scalpel during a post-mortem autopsy.

Semmelweis connected two completely disparate dots: medical students were walking directly from the autopsy room (dissecting rotting cadavers) into the maternity ward to examine laboring mothers without washing their hands. He posited an unheard-of hypothesis: invisible “cadaveric particles” were being transferred from dead bodies into living patients.

He ordered doctors to wash their hands with chlorinated lime before examinations. Maternal mortality plummeted from 18% to under 1.2% almost overnight. Yet because bacteria had not yet been formally identified under microscopes, the medical establishment mocked and ostracized him. Semmelweis had invented the germ theory of disease decades before Louis Pasteur and Robert Koch.

5. The Computational Ceiling: Why Scaling Won’t Produce Abduction

Why can’t we simply train a 10-trillion parameter model with reinforcement learning until it starts discovering new physics?

The answer lies in the mathematical constraints of the optimization loop itself:

1. The Verifier Paradox

In RLVR (reinforcement learning with verifiable rewards), a policy improves because an external verifier grades its outputs. But a verifier can only grade what its author already understands how to check.

2. The Closed Symbolic Hull

An LLM operates within a discrete vocabulary embedding space (V ≈ 150,000). Every sentence it generates is an interpolation across the convex hull of human language. It is fundamentally a closed formal system.

As Tom Zahavy points out in LLMs Can’t Jump, human abductive leaps are deeply grounded in embodied physical sensation. Einstein didn’t manipulate symbols in an algebraic solver; he imagined the visceral sensation of falling in an elevator. Kekulé didn’t run an exhaustive combinatorial graph search over carbon bonds; he had a reverie of an ouroboros—a snake biting its own tail—and made the leap to the benzene ring.

Without physical grounding in a multi-modal world model governed by the invariant laws of matter and energy, pure statistical language models remain trapped in the “Chinese Room” of symbolic recombination.

6. The Division of Labor: What AI Does Best vs. What Humans Must Do

Recognizing the limits of AI is not pessimism—it is the hallmark of serious engineering.

We do not need language models to be Albert Einstein to unlock trillions of dollars in economic value. In modern civilization, 99.9% of real-world productivity is induction and deduction:

• Synthesizing 50,000 lines of bug-free Verilog RTL from an architectural specification (Deduction).
• Mining petabytes of genomics data for candidate oncology biomarkers (Induction).
• Auditing multi-hundred-page commercial contracts against regulatory statutes (Deduction).
• Compiling, testing, and optimizing high-throughput GPU kernels (Deduction & Empirical Induction).

These are the exact enterprise domains where platforms like g factor operate: giving organizations the power to post-train open models on their own proprietary workflows, equipping them with deterministic verification gyms (RLVR), and serving them with zero data leakage.

The division of labor for the next century of science and industry is crystal clear:

1. The Human Role: Identify the anomaly. Notice the 8-arcminute discrepancy that everyone else ignored. Wonder why doctors’ patients die while midwives’ patients live. Formulate the bold, counter-intuitive hypothesis. Make the abductive jump.
2. The AI Role: Take the new axiom and unpack its consequences across a million permutations. Verify the theorems, run the numerical simulations, test every corner case, and write the code.Execute the deductive and inductive marathon with superhuman speed.

AI will not replace the spark of human genius. It will give that spark a multi-million-node engine to reshape reality.