Philosophers
Mortimer Adler Rogers Albritton Alexander of Aphrodisias Samuel Alexander William Alston Anaximander G.E.M.Anscombe Anselm Louise Antony Thomas Aquinas Aristotle David Armstrong Harald Atmanspacher Robert Audi Augustine J.L.Austin A.J.Ayer Alexander Bain Mark Balaguer Jeffrey Barrett William Barrett William Belsham Henri Bergson George Berkeley Isaiah Berlin Richard J. Bernstein Bernard Berofsky Robert Bishop Max Black Susanne Bobzien Emil du Bois-Reymond Hilary Bok Laurence BonJour George Boole Émile Boutroux Daniel Boyd F.H.Bradley C.D.Broad Michael Burke Lawrence Cahoone C.A.Campbell Joseph Keim Campbell Rudolf Carnap Carneades Nancy Cartwright Gregg Caruso Ernst Cassirer David Chalmers Roderick Chisholm Chrysippus Cicero Tom Clark Randolph Clarke Samuel Clarke Anthony Collins Antonella Corradini Diodorus Cronus Jonathan Dancy Donald Davidson Mario De Caro Democritus Daniel Dennett Jacques Derrida René Descartes Richard Double Fred Dretske John Dupré John Earman Laura Waddell Ekstrom Epictetus Epicurus Austin Farrer Herbert Feigl Arthur Fine John Martin Fischer Frederic Fitch Owen Flanagan Luciano Floridi Philippa Foot Alfred Fouilleé Harry Frankfurt Richard L. Franklin Bas van Fraassen Michael Frede Gottlob Frege Peter Geach Edmund Gettier Carl Ginet Alvin Goldman Gorgias Nicholas St. John Green H.Paul Grice Ian Hacking Ishtiyaque Haji Stuart Hampshire W.F.R.Hardie Sam Harris William Hasker R.M.Hare Georg W.F. Hegel Martin Heidegger Heraclitus R.E.Hobart Thomas Hobbes David Hodgson Shadsworth Hodgson Baron d'Holbach Ted Honderich Pamela Huby David Hume Ferenc Huoranszki Frank Jackson William James Lord Kames Robert Kane Immanuel Kant Tomis Kapitan Walter Kaufmann Jaegwon Kim William King Hilary Kornblith Christine Korsgaard Saul Kripke Thomas Kuhn Andrea Lavazza Christoph Lehner Keith Lehrer Gottfried Leibniz Jules Lequyer Leucippus Michael Levin Joseph Levine George Henry Lewes C.I.Lewis David Lewis Peter Lipton C. Lloyd Morgan John Locke Michael Lockwood Arthur O. Lovejoy E. Jonathan Lowe John R. Lucas Lucretius Alasdair MacIntyre Ruth Barcan Marcus Tim Maudlin James Martineau Nicholas Maxwell Storrs McCall Hugh McCann Colin McGinn Michael McKenna Brian McLaughlin John McTaggart Paul E. Meehl Uwe Meixner Alfred Mele Trenton Merricks John Stuart Mill Dickinson Miller G.E.Moore Thomas Nagel Otto Neurath Friedrich Nietzsche John Norton P.H.Nowell-Smith Robert Nozick William of Ockham Timothy O'Connor Parmenides David F. Pears Charles Sanders Peirce Derk Pereboom Steven Pinker U.T.Place Plato Karl Popper Porphyry Huw Price H.A.Prichard Protagoras Hilary Putnam Willard van Orman Quine Frank Ramsey Ayn Rand Michael Rea Thomas Reid Charles Renouvier Nicholas Rescher C.W.Rietdijk Richard Rorty Josiah Royce Bertrand Russell Paul Russell Gilbert Ryle Jean-Paul Sartre Kenneth Sayre T.M.Scanlon Moritz Schlick John Duns Scotus Arthur Schopenhauer John Searle Wilfrid Sellars David Shiang Alan Sidelle Ted Sider Henry Sidgwick Walter Sinnott-Armstrong Peter Slezak J.J.C.Smart Saul Smilansky Michael Smith Baruch Spinoza L. Susan Stebbing Isabelle Stengers George F. Stout Galen Strawson Peter Strawson Eleonore Stump Francisco Suárez Richard Taylor Kevin Timpe Mark Twain Peter Unger Peter van Inwagen Manuel Vargas John Venn Kadri Vihvelin Voltaire G.H. von Wright David Foster Wallace R. Jay Wallace W.G.Ward Ted Warfield Roy Weatherford C.F. von Weizsäcker William Whewell Alfred North Whitehead David Widerker David Wiggins Bernard Williams Timothy Williamson Ludwig Wittgenstein Susan Wolf Scientists David Albert Michael Arbib Walter Baade Bernard Baars Jeffrey Bada Leslie Ballentine Marcello Barbieri Gregory Bateson Horace Barlow John S. Bell Mara Beller Charles Bennett Ludwig von Bertalanffy Susan Blackmore Margaret Boden David Bohm Niels Bohr Ludwig Boltzmann Emile Borel Max Born Satyendra Nath Bose Walther Bothe Jean Bricmont Hans Briegel Leon Brillouin Stephen Brush Henry Thomas Buckle S. H. Burbury Melvin Calvin Donald Campbell Sadi Carnot Anthony Cashmore Eric Chaisson Gregory Chaitin Jean-Pierre Changeux Rudolf Clausius Arthur Holly Compton John Conway Jerry Coyne John Cramer Francis Crick E. P. Culverwell Antonio Damasio Olivier Darrigol Charles Darwin Richard Dawkins Terrence Deacon Lüder Deecke Richard Dedekind Louis de Broglie Stanislas Dehaene Max Delbrück Abraham de Moivre Bernard d'Espagnat Paul Dirac Hans Driesch John Eccles Arthur Stanley Eddington Gerald Edelman Paul Ehrenfest Manfred Eigen Albert Einstein George F. R. Ellis Hugh Everett, III Franz Exner Richard Feynman R. A. Fisher David Foster Joseph Fourier Philipp Frank Steven Frautschi Edward Fredkin Benjamin Gal-Or Howard Gardner Lila Gatlin Michael Gazzaniga Nicholas Georgescu-Roegen GianCarlo Ghirardi J. Willard Gibbs James J. Gibson Nicolas Gisin Paul Glimcher Thomas Gold A. O. Gomes Brian Goodwin Joshua Greene Dirk ter Haar Jacques Hadamard Mark Hadley Patrick Haggard J. B. S. Haldane Stuart Hameroff Augustin Hamon Sam Harris Ralph Hartley Hyman Hartman Jeff Hawkins John-Dylan Haynes Donald Hebb Martin Heisenberg Werner Heisenberg John Herschel Basil Hiley Art Hobson Jesper Hoffmeyer Don Howard John H. Jackson William Stanley Jevons Roman Jakobson E. T. Jaynes Pascual Jordan Eric Kandel Ruth E. Kastner Stuart Kauffman Martin J. Klein William R. Klemm Christof Koch Simon Kochen Hans Kornhuber Stephen Kosslyn Daniel Koshland Ladislav Kovàč Leopold Kronecker Rolf Landauer Alfred Landé Pierre-Simon Laplace Karl Lashley David Layzer Joseph LeDoux Gerald Lettvin Gilbert Lewis Benjamin Libet David Lindley Seth Lloyd Werner Loewenstein Hendrik Lorentz Josef Loschmidt Alfred Lotka Ernst Mach Donald MacKay Henry Margenau Owen Maroney David Marr Humberto Maturana James Clerk Maxwell Ernst Mayr John McCarthy Warren McCulloch N. David Mermin George Miller Stanley Miller Ulrich Mohrhoff Jacques Monod Vernon Mountcastle Emmy Noether Donald Norman Alexander Oparin Abraham Pais Howard Pattee Wolfgang Pauli Massimo Pauri Wilder Penfield Roger Penrose Steven Pinker Colin Pittendrigh Walter Pitts Max Planck Susan Pockett Henri Poincaré Daniel Pollen Ilya Prigogine Hans Primas Zenon Pylyshyn Henry Quastler Adolphe Quételet Pasco Rakic Nicolas Rashevsky Lord Rayleigh Frederick Reif Jürgen Renn Giacomo Rizzolati A.A. Roback Emil Roduner Juan Roederer Jerome Rothstein David Ruelle David Rumelhart Robert Sapolsky Tilman Sauer Ferdinand de Saussure Jürgen Schmidhuber Erwin Schrödinger Aaron Schurger Sebastian Seung Thomas Sebeok Franco Selleri Claude Shannon Charles Sherrington Abner Shimony Herbert Simon Dean Keith Simonton Edmund Sinnott B. F. Skinner Lee Smolin Ray Solomonoff Roger Sperry John Stachel Henry Stapp Tom Stonier Antoine Suarez Leo Szilard Max Tegmark Teilhard de Chardin Libb Thims William Thomson (Kelvin) Richard Tolman Giulio Tononi Peter Tse Alan Turing C. S. Unnikrishnan Francisco Varela Vlatko Vedral Vladimir Vernadsky Mikhail Volkenstein Heinz von Foerster Richard von Mises John von Neumann Jakob von Uexküll C. H. Waddington John B. Watson Daniel Wegner Steven Weinberg Paul A. Weiss Herman Weyl John Wheeler Jeffrey Wicken Wilhelm Wien Norbert Wiener Eugene Wigner E. O. Wilson Günther Witzany Stephen Wolfram H. Dieter Zeh Semir Zeki Ernst Zermelo Wojciech Zurek Konrad Zuse Fritz Zwicky Presentations Biosemiotics Free Will Mental Causation James Symposium |
The Problem of Induction
Francis Bacon described "genuine Induction" as the new method of science. Opposing his new idea to what he thought Aristotle's approach had been in his Organon (as misinterpreted by the medieval Scholastics), Bacon proposed that science builds up knowledge by the accumulation of data (information), which is of course correct. This is simply the empirical method of collecting piece by piece the (statistical) evidence to support a theory.
The "problem of induction" arises when we ask whether this form of reasoning can lead to apodeictic or "metaphysical" certainty about knowledge, as the Scholastics thought. Thomas Aquinas especially thought that certain knowledge can be built upon first principles, axioms, and deductive or logical reasoning. This certain knowledge does indeed exist, within a system of thought such as logic or mathematics. But it can prove nothing about the natural world.
Bacon understood logical deduction, but like some proto-empiricists among the Scholastics (notably John Duns Scotus and William of Ockham), Bacon argued in his Novum Organum that knowledge of nature comes from studying nature, not from reasoning in the ivory tower.
Bacon likely did not believe certainty can result from inductive reasoning, but his great contribution was to see that (empirical) knowledge gives us power over nature, by discovering what he called the form nature, the real causes underlying events.
It was of course David Hume who pointed out the lack of certainty or logical necessity in the method of inferring causality from observations of the regular succession of "causes and events." His great model of scientific thinking, Isaac Newton, had championed induction as the source of his ideas. As if his laws of motion were simply there in the data from Tycho Brahe's extensive observations and Johannes Kepler's orbital ellipses.
"Hypotheses non fingo," Newton famously said, denying the laws were his own ideas. Although since Newton it is obvious that the gravitational influence of the Sun causes the Earth and other planets to move around their orbits, Hume's skepticism led him to question whether we could really know, with certainty, anything about causality, when all we ever see in our inductive study is the regular succession of events.
Thus it was Hume who put forward the "problem of induction" that has bothered philosophers for centuries, spilling a great deal of philosophical ink. Hume's skepticism told him induction could never yield a logical proof. But Hume's mitigated skepticism saw a great deal of practical value gained by inferring a general rule from multiple occurrences, on the basis of what he saw as the uniformity of nature. What we have seen repeatedly in the past is likely to continue in the future.
While Hume was interested in causal sequences in time, his justification of induction also applies to modern statistical thinking. We infer the frequency of some property of an entire population from the statistics of an adequately large sample of that population.
The Information Philosopher's solution to this problem (more properly a "pseudo-problem," to use the terminology of twentieth-century logical positivists, logical empiricists, and linguistic analysts) is easily seen by examining the information involved in the three (or four) methods of reasoning - logical deduction, empirical induction, mathematical induction (actually a form of deduction), and what Charles Sanders Peirce called "abduction," to complete one of his many philosophical triads.
Mathematical induction is a method of proving some property of all the natural numbers by proving it for one number, then showing that if it is true for the number n, it must also be true for n + 1. In both deduction and mathematical induction, the information content of the conclusion is often no more than that already in the premises. To be sure, the growth of our systems of thought such as logic, mathematics, and perhaps especially geometry, has generated vast amounts of new knowledge, new information, when surprising new theorems are proved within the system. And much of this information has turned out to be isomorphic with information structures in the universe. But the existence of an isomorphism is an empirical, not a logical, finding.
The principal role of deduction in science is to derive, logically or mathematically, predictable consequences of the new theory that might be tested by suitable experiments. This step simply draws out information already present in the hypothesis. Theory, including deductions and predictions, is all done in the realm of ideas, pure information.
Abduction is the formation of new hypotheses, one step (rarely the first) in what some philosophers of science in the twentieth century described as the scientific method - the hypothetico-deductive-observational method. It can be described more simply as the combination of theories and experiments. Observations are very often the spur to theory formation, as the old inductive method emphasized. A scientist forms a hypothesis about possible causes for what is observed.
Although the hypothesis is an immaterial idea, pure information, the abduction of a hypothesis creates new information in the universe, albeit in the minds of the scientists.
By contrast, an experiment is a material and energetic interaction with the world that produces new information structures to be compared with theoretical predictions. Experiments are Baconian accumulations of data that can never "prove" a theory (or hypothesis). But confirmation of any theory consists entirely of finding that the statistical outcomes of experiments match the theory's predictions, within reasonable experimental "error bars." The best confirmation of any scientific theory is when it predicts a phenomenon never before seen, such that when an experiment looks, that phenomenon is found to exist.
These "surprising" results of great theories shows the extent to which science is not a mere "economic summary of the facts," as claimed by Ernst Mach, the primary creator of logical positivism in science.
Mach had a great influence on the young Albert Einstein, who employed Mach's idea in discovering his special theory of relativity. The positivists insisted on limiting science to "observable" facts. Atoms were not (yet) observable, so despite the great chemical theories of Dalton explaining molecules, the great statistical mechanical work of James Clerk Maxwell and Ludwig Boltzmann explaining thermodynamics, it remained for Einstein to predict the observable effects of atomic and molecular motions on the motions of visible particles like pollen seeds in a liquid.
The experimental measurements of those visible motions, with exactly the extent of motion predicted by Einstein, confirmed the reality of atoms. The motions had been observed, almost eighty years earlier, by Robert Brown. Einstein's 1905 hypothesis - a "free creation of the human mind," as he called it and his other extraordinary theories, together with the deduction of mathematically exact predictions from the theory, and followed by the 1908 experiments by Jean Perrin, gives us a paradigmatic example of the scientific method.
In information philosophy terms, the abstract immaterial information in the Einstein theory of Brownian motion, was found to be isomorphic to material and energetic information structures in the universe.
In his early years, Einstein thought himself a disciple of Mach, a positivist. He limited his theories to observable facts. Special relativity grew from the fact that absolute motions are not observable.
But later when he realized the source of his greatest works were his own mental inventions, he changed his views. Here is Einstein in 1936,
We now realize, with special clarity, how much in error are those theorists who believe that theory comes inductively from experience. Even the great Newton could not free himself from this error ("Hypotheses non fingo")... There is no inductive method which could lead to the fundamental concepts of physics. Failure to understand this fact constituted the basic philosophical error of so many investigators of the nineteenth century. It was probably the reason why the molecular theory and Maxwell's theory were able to establish themselves only at a relatively late date. Logical thinking is necessarily deductive; it is based upon hypothetical concepts and axioms. How can we expect to choose the latter so that we might hope for a confirmation of the consequences derived from them? The most satisfactory situation is evidently to be found in cases where the new fundamental hypotheses are suggested by the world of experience itself. The hypothesis of the non-existence of perpetual motion as a basis for thermodynamics affords such an example of a fundamental hypothesis suggested by experience; the same holds for Galileo's principle of inertia. In the same category, moreover, we find the fundamental hypotheses of the theory of relativity, which theory has led to an unexpected expansion and broadening of the field theory, and to the superseding of the foundations of classical mechanics.And here, Einstein wrote in his 1949 autobiography, I have learned something else from the theory of gravitation: No ever so inclusive collection of empirical facts can ever lead to the setting up of such complicated equations. A theory can be tested by experience, but there is no way from experience to the setting up of a theory. Equations of such complexity as are the equations of the gravitational field can be found only through the discovery of a logically simple mathematical condition which determines the equations completely or [at least] almost completely.Werner Heisenberg told Einstein in 1926 that his new quantum mechanics was based only on "observables," following the example of Einstein's relativity theory that was based on the fact that absolute motion is not observable. For Heisenberg, the orbital path of an electron in an atom is not an observable. Heisenberg said of his first meeting with Einstein, Since philosophy has made the "linguistic turn" to abstract propositions, the problem of induction for today's philosophers is subtly different from the one faced by David Hume. It has become an epistemological problem of "justifying true beliefs" about propositions and thus lost the connection to "natural philosophy" it had in Hume's day. Information philosophy hopes to restore at least the "metaphysical" elements of natural philosophy to the domain of philosophy proper. In contemporary logic, epistemology, and the philosophy of science, there is now the problem of "enumerative induction" or universal inference, an inference from particular statements to general statements. For example, the inference from propositions
p1, p2,... pn, which are all F's that are G's
to the general inference that
all F's are G's.
This is clearly a purely linguistic version of the original problem. Divorcing the problem of induction from nature empties it of the great underlying principle in Hume, Mill, and other philosophers, namely the assumption of the uniformity of nature, which alone can justify our "true?" belief that the sun will come up tomorrow.
In information terms, the problem of induction has been reduced, even impoverished, to become only relations between ideas. Perhaps "ideas" is too strong, much of philosophy has become merely logical relations between statements or propositions. Because of the inherent ambiguity of language, sometimes philosophy appears to have become merely a game played using our ability to make arbitrary meaningless statements, then critically analyze the resulting conceptual paradoxes.
Karl Popper famously reprimanded Ludwig Wittgenstein's claim that there are no real philosophical problems, only puzzles and language games.
On a close examination, it appears current philosophical practice has reduced the problem of induction to one of permissible linguistic deductions.
Consider these examples from the Stanford Encyclopedia of Philosophy:
|