Follow the data, not the conclusion.

Students often encounter the scientific method as a list: question, research, hypothesis, materials, procedure, experiment, analysis, conclusion. That list can help organize an investigation. It can also make science look more linear than it is.

Scientific work often returns to an earlier question. An unexpected result may require another measurement, a better comparison, or a revised explanation. The cycle below illustrates that process without treating it as the only way science proceeds.

The diagram below shows a model called the Cycle of Scientific Enterprise, which I came across years ago in an undergraduate science-methodology textbook and have used ever since to walk students through how scientific knowledge actually accumulates.1 The four-bubble cycle on the inside is the part most students get. The amber loop on the outside is the part most students miss.

How scientific knowledge actually accumulates: a four-stage loop (teal) plus a falsification path (amber) that sends a failed experiment back to question its own assumptions.

The four moves of the cycle

Working clockwise from the top:

• Hypothesis. An informed prediction, based on the current theory. Not a hunch, not a wish, not what the teacher said the answer was. A specific, testable statement: “If theory X is right, then in this setup I should observe Y.”
• Experiment. Set the prediction up so it can actually fail. A real experiment must be capable of challenging the hypothesis. It needs controlled variables, a clear outcome measure, and methods that someone else could repeat.
• Analysis. Compare what you actually observed to what the theory said you would observe. Not what you hoped you would observe. Not what would get the prettier grade. What the data actually shows.
• Theory. If the data confirms the prediction, the existing theory survives a test, and the result becomes a new scientific fact, another data point in the growing collection that the theory has to keep accounting for. The theory is the “best explanation at present,” and the word present is doing real work in that phrase.

That’s the inner loop, and it’s the one most kids can recite. The hard part, the part that makes this actually science instead of just confirmation, is the amber loop on the outside.

The “No” branch is the entire point

Look at the Analysis bubble again. There are two arrows out of it: Yes and No. The Yes arrow is comfortable. The No arrow is where science lives.

When the data doesn’t agree with the prediction, an honest scientist doesn’t quietly massage the data, fudge the measurement, or rewrite the conclusion to match the theory. They takes the No arrow into the Review step and asks three uncomfortable questions, in order: Did I run the experiment well? Was my hypothesis well-formed? If both of those are sound, is the theory itself wrong?

That last question is the one that makes science a self-correcting enterprise rather than a religion. Karl Popper’s 1934 insight, still the cleanest one-line definition of science we have, is that a claim is scientific only if it could in principle be shown to be false.2 A theory that survives an honest, well-run experiment that could have killed it is a stronger theory than it was yesterday. A theory that can’t be killed by any conceivable observation isn’t a theory at all.

A real scientist designs experiments that could prove them wrong and then carries them out.

Don’t fool yourself

The single most-quoted line in modern science teaching comes from Richard Feynman’s 1974 Caltech commencement address, “Cargo Cult Science.” It’s worth typing out in full because no paraphrase improves it:

“The first principle is that you must not fool yourself — and you are the easiest person to fool. So you have to be very careful about that. After you’ve not fooled yourself, it’s easy not to fool other scientists. You just have to be honest in a conventional way after that.”3

The whole essay is about a particular problem: following the outward procedures of science without genuinely trying to challenge your own conclusions. Feynman’s name for it, “cargo-cult science,” has stuck for fifty years for a reason. It is exactly what happens in the kind of classroom science fair where the conclusion is decided in advance and the experiment is reverse-engineered to produce it.

That is not what we are training. We are training the opposite.

Why the honest scientist is a-political

When I tell a student that real scientists are a-political, I don’t mean scientists don’t vote, or don’t care about the world, or don’t have opinions. They do. I mean something narrower and more important: the method itself is indifferent to your opinions.

The cycle in the diagram doesn’t care which side of an argument you started on. It doesn’t care what your parents believe, what your professor believes, what your peer group believes, or what is currently fashionable to believe. It only asks one question, over and over: does the data agree with the prediction? A scientist who lets the answer to that question depend on a political affiliation has stopped doing science and started doing advocacy. The two activities are both legitimate. They are not the same activity. Confusing them is how public trust in science gets eroded, and it is one of the quietest, most preventable failures of high-school science education.4

The student who leaves Bright Minds knowing the difference is better-prepared for college, better-prepared for a career, and frankly better-prepared for a healthy adult civic life than one who doesn’t.

What this looks like at our bench

These ideas become useful when students practice them:

• Draw what you see, not what you remembered. On microscope slides, students sketch the actual field of view, including the parts that don’t match the textbook. Record the observation before trying to explain a difference. It may reflect variation, preparation, or a mistake that needs checking.
• “I don’t know yet” is a complete answer. Maybe my favorite phrase to hear in the lab. It means the student has stopped pattern-matching to a memorized conclusion and is actually looking. The next move is another observation, or a check experiment, rather than a confident but incorrect guess.
• Mistakes stay in the notebook. Single-line cross-out, initialled, dated, original entry still legible. That isn’t bookkeeping; it’s the falsification loop made visible. The notebook is supposed to show where the prediction was wrong, because that’s where the actual learning happened.
• The capstone defends a finding, not a position. Every cohort student finishes by presenting what they observed, what they think it means, and where they could be wrong. That last clause is non-optional. A capstone that does not acknowledge uncertainty is a speech rather than a scientific defense.

The habit we’re actually trying to build

The aim is a habit students can use beyond this lesson: state a question, examine the evidence, and explain how it supports a conclusion. Applying that habit in a new subject also requires knowledge of that subject and further practice.

Ask students which observations support an explanation, which could challenge it, and what they would investigate next. Confidence should come from examining the evidence, not from dismissing a conclusion simply because someone else accepts it.

The diagram is a teaching aid. Repeated, thoughtful use is what makes the method useful.

Sources & further reading

1. The “Cycle of Scientific Enterprise” diagram in this essay is adapted from a model widely used in undergraduate science-methodology textbooks as a more honest replacement for the linear “eight-step scientific method” taught in K–12 classrooms. [Leslie may add the specific textbook citation she used with her BSU students.]
2. Popper, K. R. (1959 [1934]). The Logic of Scientific Discovery. London: Hutchinson. The original argument that falsifiability, the ability of a claim to be shown wrong by some conceivable observation, is the line between science and non-science. See also the encyclopedia summary at Stanford Encyclopedia of Philosophy: “Karl Popper”.
3. Feynman, R. P. (1974). “Cargo Cult Science.” Caltech commencement address, reprinted in Surely You’re Joking, Mr. Feynman! (W. W. Norton, 1985). The canonical short statement of intellectual honesty in scientific work, including the line about not fooling yourself.
4. On the corrosive effect of treating disputed empirical questions as identity markers rather than as testable claims, see Naomi Oreskes, Why Trust Science? (Princeton University Press, 2019), and the broader public-understanding-of-science literature on the difference between the institutional consensus around a finding and the methodological grounds for that consensus.

Posted Apr 30, 2026.