JOVANA
Explore Library Glossary Getting Started Three Levels Fields How it works Mission
Join the mission
All guides

Many Tapes, Many Models, Same Power

You met the basic Turing machine and felt its one-tape clumsiness. Now watch the astonishing twist: bolt on extra tapes, let it guess, or swap it for a totally different model, and the set of solvable problems never grows. That stubborn sameness is the deepest fact in the subject.

The worry the basic machine left you with

By now the Turing machine feels almost too crude to trust. It owns a single endless tape, one head that shuffles left and right one cell at a time, and to compare two halves of its input it must trudge back and forth across the whole tape like someone with only one sheet of paper checking a long sum by walking the length of it again and again. A natural fear creeps in: maybe this thing is just too weak. Maybe a smarter design — more tapes, the ability to guess, a different gadget entirely — could solve problems this poor machine never could.

This guide answers that fear, and the answer is the headline of the whole rung: it does not matter. You can pile on tapes, hand the machine the power to guess, or throw the tape away and use a wildly different formalism, and the family of problems it can solve stays exactly the same. The machines get faster or more convenient, never more capable. That surprising immovability has a name — the robustness of the Turing machine — and earning it honestly is what the next several guides are about.

More tapes: a faster machine, not a stronger one

Start with the friendliest upgrade. A multitape Turing machine has some fixed number k of tapes, each with its own independent head, and in one step it reads all k cells under the heads at once, then writes and moves each head separately. This is a huge convenience: to check whether the left half of the input equals the right half, you copy one half onto a second tape and then walk the two heads in lockstep, comparing cell by cell — no more exhausting round trips across a single tape.

Now the key claim: every multitape machine can be simulated by an ordinary single-tape one. The trick is to lay all k tapes side by side on the single tape, interleaved track by track, and mark each head's current cell with a dot. To mimic one step of the multitape machine, the single-tape simulator sweeps once across the whole written region to read all k marked cells, then sweeps back to update each one and shift the dots. The single-tape machine ends up doing exactly what the multitape machine did — same inputs accepted, same outputs produced.

What does the simulation cost? Each simulated step makes the single-tape head sweep a region that can be as long as the number of steps so far, so simulating t steps takes on the order of t^2 steps — a polynomial blow-up (here O(t^2)). And that is the whole moral: extra tapes buy speed, at most a polynomial factor, and never new solving power. A one-tape machine is slower at sorting and matching, but there is no problem the k-tape machine can decide that the one-tape machine cannot.

Multitape machine, 2 tapes:           Encoded onto ONE tape (interleaved):

  tape 1:  a a b a
               ^                         a . a a b a # b . a c #
  tape 2:  b a c                         |   ^             ^
               ^                         (dot = where each head sits)

One simulated step  =  sweep right to read both dotted cells,
                       sweep left to rewrite + move both dots.
Simulating t steps  ~  O(t^2) steps on the single tape.
Two tapes folded onto one: a dot marks each virtual head. The cost of folding is only polynomial (about O(t^2)), so power is unchanged.

Guessing for free? Nondeterminism costs only time

The next upgrade is bolder. Recall from the finite-automaton rungs how an NFA could split into many copies and explore every path at once — pure magic for conciseness, but a mathematical device, never random and never free. A nondeterministic Turing machine does the same on the tape: at some steps its transition rule offers several possible moves, and the machine accepts if ANY sequence of choices leads to an accept state. Picture it as the machine sprouting a branching tree of possible computations and succeeding if even one branch shouts yes.

Does this lucky guessing let it decide anything new? No. A deterministic machine can simulate the nondeterministic one by systematically exploring that whole tree of choices — crucially by breadth-first search, not depth-first. Why breadth-first matters: one branch might run forever, so if you dived all the way down it you would get stuck and never try the others; instead you explore all branches one extra step at a time, like timesharing among them, guaranteeing that any finite accepting path is eventually found.

Here is the honest price tag. A computation tree of depth t can have on the order of b^t nodes, where b is the maximum number of choices at a step, so the deterministic simulation can take exponential time — roughly 2^(O(t)). So nondeterminism on a Turing machine costs an exponential slowdown to simulate, yet it decides not one extra language. Contrast this sharply with the finite-automaton story, where the subset construction flattened an NFA into a DFA with only an exponential blow-up in the number of states but no change in expressive power either — same lesson, told twice: nondeterminism is convenience, not capability.

Why does that exponential matter so little here but obsess everyone in complexity? Because for computability we only ask whether a halting accepting computation exists at all, and exponential time still halts. The instant we demand the simulation stay polynomial, that same exponential gap becomes the celebrated P versus NP question — still wide open. Same nondeterminism, two utterly different stakes depending on whether you count time.

Throw the tape away: rival models that tie

So far we have only stretched the Turing machine. The deeper shock is that completely unrelated formalisms, invented by different people for different reasons, all reach exactly the same set of computable problems. These are the equivalent models of computation, and they look nothing like a tape with a head. Church's lambda calculus reduces everything to building and applying nameless functions; Gödel and Kleene's recursive functions build computation from a few base functions plus composition, primitive recursion, and an unbounded search operator; a register machine (or counter machine) is closer to real assembly, just incrementing, decrementing, and jumping; and one-dimensional cellular automata compute by updating a row of cells from a fixed local rule.

How do we know they tie? By exhausting, concrete simulation in both directions. You write a Turing machine that, step by step, carries out lambda-calculus reductions; and you write lambda terms that encode a tape, a head, and a transition table and grind through a Turing computation. Each such pair of translations proves the two models recognize exactly the same languages. Do this for every pair and the whole zoo collapses into a single notion of computability — which is precisely why your favorite real programming language belongs on the list too.

The thesis, the encoding, and the universal machine

All this convergence emboldens a famous claim: the Church–Turing thesis, which says that anything we would intuitively call 'effectively computable by a mechanical procedure' is exactly what a Turing machine can compute. Notice carefully what kind of statement this is. It bridges an informal, intuitive notion ('algorithm', 'mechanical procedure') to a precise mathematical one (Turing machine), so it cannot be proved like a theorem — there is no formal definition of the intuitive side to prove it against. It is a thesis: overwhelmingly well-supported by decades of every proposed model tying, but a claim about reality, not a deduction. A future model that beat the Turing machine would refute it, and nothing in ninety years has come close.

Believing the thesis pays an immediate dividend: a Turing machine is itself a finite object — a finite list of states and transition rules — so we can write that description down as a plain string over a fixed alphabet. This is the encoding of a machine as a string: pick a scheme, number the states, spell out every rule like 'delta(q1, a) = (q2, b, R)', and concatenate. Now a machine M has a textual name, written <M>, that can be fed as input to another machine — the same move that let us treat a problem as a set of strings now lets a program be data. That single idea gives us the crown jewel: the universal Turing machine U. Feed U the pair (<M>, w) — the encoded description of any machine M followed by an input w — and U simulates M running on w, accepting exactly when M would accept w. The steps are intuitive once the encoding is in place.

  1. On its tapes, U keeps three things: the rulebook <M>, the contents of M's simulated tape, and a marker holding M's current state and head position.
  2. To simulate one step, U reads the symbol under M's marked head, then scans <M> to find the matching rule delta(current state, that symbol).
  3. U carries out that rule on the simulated tape: write the new symbol, move the marked head left or right, and update the stored state.
  4. U repeats until the simulated M halts; if M would loop forever on w, U dutifully loops forever too — it can only mirror M, not foresee it.

Pause on what U is. It is one fixed machine that runs any other machine handed to it as data — a single piece of hardware whose behavior is set by a program stored on its tape. That is precisely the stored-program idea at the heart of every real computer: your phone is one device that becomes a calculator, a camera, or a game depending only on the bytes loaded into it. The universal machine is the direct mathematical ancestor of that design. And there is a sting in the tail: because U can simulate any machine including itself, it is exactly the lever the next rung uses to build self-reference and prove the halting problem undecidable — the same robustness that makes computers universal is what makes some questions about them permanently unanswerable.