• John
  • Felde
  • University of Maryland
  • USA

Latest Posts

  • James
  • Doherty
  • Open University
  • United Kingdom

Latest Posts

  • Andrea
  • Signori
  • Nikhef
  • Netherlands

Latest Posts

  • CERN
  • Geneva
  • Switzerland

Latest Posts

  • Aidan
  • Randle-Conde
  • Université Libre de Bruxelles
  • Belgium

Latest Posts

  • Vancouver, BC
  • Canada

Latest Posts

  • Laura
  • Gladstone
  • MIT
  • USA

Latest Posts

  • Steven
  • Goldfarb
  • University of Michigan

Latest Posts

  • Fermilab
  • Batavia, IL
  • USA

Latest Posts

  • Seth
  • Zenz
  • Imperial College London
  • UK

Latest Posts

  • Nhan
  • Tran
  • Fermilab
  • USA

Latest Posts

  • Alex
  • Millar
  • University of Melbourne
  • Australia

Latest Posts

  • Ken
  • Bloom
  • USA

Latest Posts

Byron Jennings | TRIUMF | Canada

View Blog | Read Bio

Simplicity: The Secret Sauce in the Scientific Method

Simplicity plays a crucial, but frequently overlooked, role in the scientific method (see the posters in my previous post). Considering how complicated science can be, simplicity may seem to be far from a driving source in science. Is string theory really simple? If scientists need at least six, seven or more years of training past high school, how can we consider science to be anything but antithetical to simplicity?

Good questions, but simple is relative. Consider the standard model of particle physics. First, it is widely agreed upon what the standard model is. Second, there are many alternatives to the standard model that agree with the standard model where there is experimental data but disagree elsewhere. One can name many[1]: Little Higgs, Technicolor, Grand Unified Models (in many varieties), and Super Symmetric Grand Unified Models (also in many varieties). I have even attended a seminar where the speaker gave a general technique to generate extensions to the standard model that also have a dark matter candidate. So why do we prefer the standard model? It is not elegance. Very few people consider the Standard Model more elegant than its competitors. Indeed, elegance is one of the main motivations driving the generation of alternate models. The competitors also keep all the phenomenological success of the standard model. So, to repeat the question, why do we prefer the standard model to the competitors? Simplicity and only simplicity. All the pretenders have additional assumptions or ingredients that are not required by the current experimental data. At some point they may be required as more data is made available but not now.  Thus we go with the simplest model that describes the data.

This is true across all disciplines and over time. The elliptic orbits of Kepler (1571–1630) where simpler than the epicycles of Ptolemy random graph(c. 90 – c. 168) or the epicyclets of Copernicus (1473–1543). There it is. We draw straight lines through the data rather than 29th order polynomials. If the data has bumps and wiggles, we frequently assume they are experimental error as in the randomly[2] chosen graph to the left where the theory lines do not go through all the data points. No one would take me seriously if I fit every single bump and wiggle. Simplicity is more important than religiously fitting each data point.

Going from the sublime to the ridiculous consider Russell’s teapot.  Bertrand Russell (1872–1970) argued as follows: If I were to suggest that between the Earth and Mars there is a china teapot revolving about the sun in an elliptical orbit, nobody would be able to disprove my assertion provided I were careful to add that the teapot is too small to be revealed even by our most powerful telescopes. But if I were to go on to say that, since my assertion cannot be disproved, it is intolerable presumption on the part of human reason to doubt it, I should rightly be thought to be talking nonsense. But what feature of the scientific method rules out the orbiting teapot? Or invisible pink unicorns? Or anyone of a thousand different mythical beings? Not observation! But they fail the simplicity test. Like the various extensions to the standard model, they are discounted because there are extra assumptions that are not required by the observational data.  This is otherwise known as Occam’s razor.

The argument for simplicity is rather straight forward. Models are judged by their ability to describe past observations and make correct predictions for future ones. As a matter of practical consideration, one should drop all features of a model that are not conducive to that end. While the next batch of data may force one to a more complicated model, there is no way to judge in advance which direction the complication will take. Hence we have all the extensions of the standard model waiting in the wings to see which, if any, the next batch of data will prefer – or rule out.

The crucial role of simplicity in choosing one model from among the many solves one of the enduring problems in the philosophy of science. Consider the following quote from Imre Lakatos (1922 – 1974) a leading philosopher of science from the last century: But, as many skeptics pointed out, rival theories are always indefinitely many and therefore the proving power of experiment vanishes.  One cannot learn from experience about the truth of any scientific theory, only at best about its falsehood: confirming instances have no epistemic value whatsoever (emphasis in the original). Note the premise of the argument: rival theories are always indefinitely many. While rival theories may be infinitely many, one or at most a very few are always chosen by the criteria of simplicity.  We have the one standard model of particle physics not an infinite many and his argument fails at the first step. Confirming instances, like finding the Higgs boson, do have epistemic value.

[1] This list is time dependent and may be out of date.

[2] Chosen randomly from one of my papers.


Tags: ,

  • Laurence Cox

    Surely, this is just Lakatos repeating Karl Popper’s original criticism in “Logic of Scientific Discovery”. If you haven’t already already seen it I recommend Jim Baggott’s “Farewell to reality” ISBN 978-1-78033-492-9. Although I think he goes overboard in the later part of the book and I didn’t find it as convincing as Lee Smolin’s “The Trouble with Physics”, the first chapter does introduce six principles that I think encapsulate science and which fit well will the ideas in your blog postings.

  • The Pioneer anomaly: arxiv:/gr-qc/0205059, /gr-qc/0307042, /gr-qc/9810085, /gr-qc/gr-qc/0310088, /gr-qc/0411020, /physics/0502123, /gr-qc/0506139, 0710.2656 (solved), 1107.2886 (validated). Bizarre theories curve-fit “anomalous acceleration.” Bizarre theories curve-fit superluminal neutrinos in Italy, empirically a loose fiberoptic connection.

    Russell’s teapots are unphysical outputs: string/brane exotica, sparticles, leptoquarks, lazy photons, WIMPs, supersymmetry exotica, extra-dimensions, mini-black holes, Randall-Sundrum 5-D phenomena (gravitons, K-K gluons, etc.), ADS/CFT duality evidence, colorons; dark matter, string/M-theory, quantum gravitation; SUSY, solar axions, proton decay. Bizarre theories curve-fit…

    …rival theories…are always chosen by the criteria of simplicity” Massless boson photons detect perfectly mirror-symmetric vacuum. Theory assumes this is exactly true for fermionic matter. If faintly untrue, then parity violations, chiral anomalies, symmetry breakings; Chern-Simons parity repair of Einstein-Hilbert action, and Milgrom acceleration (Noetherian failure of vacuum isotropy demanding angular momentum conservation). Any of five classes of empirical tests can decide. Look.

  • I am not a great fan of Smolin’s book. His arrogance in equating particle physics with physics in general is appalling. Also, he misidentifies the problem with particle physics. It is not a lack of people thinking deep thoughts but the lack of new challenging data. The LHC results so far look a lot like the doomsday scenario of just the standard model Higgs and nothing else. But there is still hope as they go to higher energy.

    I am not as negative on string theory as some people but it would be good to see it make some definite predictions.

    Lakatos was a follower of Popper but he unfortunately died relatively young.

  • Lukas

    What is your view on the difference between simplicity, parsimony and elegance?

  • Simplicity and parsimony are essentially synonyms while elegance has more to do with beauty and is more subjective.

  • Lukas

    Okay, interesting.

    I interpreted the terms differently:

    – elegance = mathematical complexity: how many axioms and formulas, how hard is the maths to understand/use*
    – parsimony = ontological/metaphysical complexity: how many entities and metaphysical constructs*
    – simplicity = human/psychological complexity: how difficult is it to perform the corroborating experiments, or to make clear predictions*

    The reason I make this distinction has to do with how most theories of theory-choice are too theoretically focused, while in real life theory choice tends to focus both on theoretical complexity and experimental complexity.

    It also seems to help in some cases: God is an easy concept to grasp, and (tentatively) a parsimonious theory: one entity as a foundation for everything. Yet the theory is not very predictive and definitely not easily proven. The same goes for psycho-analysis: easy in theory, complex in experiments. String theory suffers a similar problem: elegant, parsimonious, but a b**** to (in)validate.

    Either way I would appreciate your input on this 🙂

    * these are just some top-of-the-head examples for the complexities. They are not exhaustive, nor do I think that all the measures are quantifiable.