Reversibility and machine
intelligence
This essay is about the intersection of computational
reversibility and machine
intelligence.
It argues that reversibility is important for intelligent systems, and
that this association impacts on the probability of the hypothesis that we exist inside a computer simulation.
The benefits of reversibility
Computational
reversibility
has well-known benefits relating to minimizing power consumption and
heat generation.
These are a consequence of the thermodynamic cost of erasing
bits - an idea known as Landauer's
principle
However there are also some times when reversibility helps with actually
running a system in reverse - for example when providing 'undo' functionality or
when backtracking. The need for backtracking is common when performing
a tree search -
and tree searches are used ubiquitously in the forecasting component of machine
intelligence systems.
When performing a tree search it is common to want to go back and reconsider
a previous node.
For example, in a game of go if you play A, your opponent plays B, you play
C and your opponent plays D - and then your position evaluation tells you
that you are going to lose the game after this, you may want to back track
and reconsider your move at C. If no move at C seems any good you may want
to back track further to reconsider your move at A. This process involves
running your simulation of the game both forwards and backwards.
This example involves an adversary and a series of branching points
corresponding to agent actions, but the same situation applies to
practically any forecasting problem involving uncertainty. What
makes the tree of future possibilities branch is not necessarily a
choice between possible actions, but any form of uncertainty
which could potentially lead to multiple possible outcomes. This
makes the need for reversibility very widespread in forecasting
systems.
Another thing to mention is that forecasting systems are a central
and ubiquitous component of machine intelligence systems.
Forecasting the possible consequences of actions to allow an agent
to choose between the resulting outcomes is a the primary function
of animal brains. Machine intelligence works on the same principle.
For more on this topic, see my essay titled:
The
broad scope of inductive inference.
The simplest way to run a system backwards is to store a complete
history of previously-considered nodes in the tree. However, that is
often very inefficient. More often, you want to do something like store
a diff. That's where reversible logic comes in. Reversible logic lets
you efficiently run any computation in reverse. It uses
Toffoli gates,
the Margolous
neighbourhood, or
other
techniques
to run
the system backwards.
Computational
universality allows a reversible computer to
simulate any irreversible computation. A classic text about
egnineering reversibile systems is the book
Cellular
Automata Machines by Tommaso Toffoli and Norman Margolus.
Reversibility and simulism
It has been widely speculated that we may be
living inside a computer simulation.
The possibility has long been a staple of science fiction with early
examples including:
The
Tunnel under the World (1955),
Time Out of Joint (1959) and
(1964). Modern
treatments include
The_Matrix (1999),
Total
Recall (1990),
The
Thirteenth Floor (1999)
The
Lawnmower Man (1992)
Dark
City (1998)
Strange
Days (1995) and
eXistenZ (1999).
The topic has become of interest to scientists and philosophers.
Frank Tipler's (1997) book,
The
Physics of Immortality: Modern Cosmology, God and the Resurrection of
the Dead speculated that modern humans might be resurrected n
future computer simulations. Hans Moravec's (1998) paper
Simulation,
Consciousness, Existence was another early contribution to the
topic. Nick Bostrom's 2003
paper Are
You Living In a Computer Simulation? also went on to address the
subject.
The laws of physics appear to exhibit microscopic
reversibility. They are time symmetric
invariant.
This observation was contested in the 20th century by quantum physics
pioneers who claimed that a hypothetical irreversible process known as
"wave function collapse" might play a significant role in physics. However,
there is no evidence that wavefunction collapse is a real phenomenon.
As it turns out, quantum physics does not depend on the idea in any
way. The best evidence we have is consistent with exact microscopic
reversibility.
Not all possible laws of physics exhibit reversibility. For example,
irreversible rules massively outnumber reversible ones in cellular
automata. Of the 256 Wolfram rules, only 6 are reversible. The
proportion of reversible rules goes down rapidly as the complexity of
the rule increases. In one of the next simplest one dimensional systems, 62 rules out of 4 billion are reversible.
One possible explanation of reversibility invokes observation selection effects.
Maybe mature living systems can only exist in universes with reversible physical
laws - since in irreversible universe the information in them is
gradually erased
and before intelligent life has time to evolve, it is all gone. However, this
possibility doesn't seem sufficient to explain the observations. Life
can certainly
exist in irreversible universes - and it may also be able to persist
for billions of
years - provided that the degree of irreversibility is not so great
that the universe
rapidly leaks away all the information inside it. Exact physical
reversibility appears
to be not fully explained by this idea.
One possible explanation for physical reversibility is that the
universe is the product of
intelligent
design. Reversibility
helps to minimize power requirements and heat generation. The link
between machine
intelligence and reversibility described in this essay provides some
more possibilities.
Reversibility could be important to function in other ways.
Reversibility allows the
implementation of a "rewind" function - allowing the simulation to be
examined at any point in time.
Also, reversibility is a likely property of world simulations that
exist inside advanced minds.
These are likely to be engineered using reversibility to allow for
efficient backtracking.
Some critics have suggested that advanced machine intelligences would
not squander resources
on detailed ancestor simulations. However, we are quite interested in
our history and origins.
Understanding the past is key to predicting the future. Major
evolutionary transitions are
likely to be of particular interest to our descendants. In particular, in
the alien race,
it could be important to understand how the transition to an
engineered future turns out,
because that might be our best clue about the possible forms of aliens
we might meet. Understanding
the forms aliens could take could be key strategic information -
should we ever meet them.
Physical reversibility thus appears to be a piece of evidence that
favors simulism over other
possibilities. If our universe is the product of intelligent design
that makes sense of our
reversible laws of physics. Otherwise, we seem faced with a massive
coincidence - physical law is
reversible - although the odds of it being reversible would seem to be
miniscule.
Tim Tyler |
Contact |
http://matchingpennies.com/
|