- Epistemological anarchism to anarchism Bill Rein, NOL
- There’s good BS and bad BS Rick Weber, NOL
- Authority as a useful guidepost Rick Weber, NOL
- Federalizing the social sciences Michelangelo Landgrave, NOL
Imre Lakatos
Thoughts on ‘For Method’
Our project hasn’t seen much public-facing action, but it’s still happening. For my part, I have (so far) read Lakatos’s lectures that were meant to form the basis for his joint project with Feyerabend.
Before I jump into it, let me start with my favorite quote:
The social sciences are on a par with astrology, it is no use beating about the bush. (Funny that I should be teaching at the London School of Economics!)
Imre Lakatos, p. 107 For and Against Method
These lectures were an entertaining evisceration of some old (and still prevalent) superstitions about the functioning of science, plus Lakatos’s own view on how science actually works. I think his picture (which I’ll describe below) is a pretty good one, but doesn’t actually solve the demarcation problem.
The Big Question (TBQ) is this: how do we separate good science from bad? Lakatos presents three main schools of thought (besides his own):
- Demarcationism — a set of schools of thought that share a belief in something like an objective answer to TBQ.
- Authoritarianism — the belief that there are some people who can identify good science, but can’t necessarily enunciate their positions.
- Anarchism — which argues (according to Lakatos) that there is no good or bad science.
He quickly rejects the various flavors of Demarcationism. These schools of thought are either logically impossible (e.g. inductivism), inconsistent with the history of science, and/or too subjective. They’re popular caricatures of science–cartoons with heroic scientists battling ignorance, limited only by funding. But they aren’t true.
For example, Falsificationism (which is alive and well, half a century later, in the minds of many practicing scientists) tells us that scientists are only swayed by disconfirmatory evidence. But in practice scientists tend to ignore anamolies (i.e. disconfirmatory evidence) with the hope that they’ll be explained away later–and they tend to be swayed by confirmatory evidence in spite of Falsificationist priors.
All told, Demarcationists run into the problem of not being able to come up with a theory that doesn’t make significant errors such as classifying Newton as bad science.
On the far side of the spectrum are anarchists. Far from believing in any formula, criteria, or line in the sand, they say TBQ misses the point entirely. There isn’t such thing as “good” science or “bad” except from the perspective of whatever the current orthodoxy says. For the objective-truth-seeking philosopher, science ultimately boils down to “anything goes!”
For Lakatos, the anarchists have basically surrendered in the face of the demarcation problem. But it’s not clear to me that Lakatos hasn’t joined them. He’s got his progression criterion (more on that later), but can we really pin that down in any objective way? Motterlini seems to think Feyerabend thought Lakatos was really an anarchist after all, and I’m inclined to agree based on what (little) I’ve seen. Lakatos offers heuristics, but makes no guarantees that any formula will work reliably.
Let me come back to Authoritarianism after describing Lakatos’s theory of research programs.
A research program is (if I’m understanding this correctly) basically a mix of scientific framework and community. Austrian Economics is a research program comprised of a common theoretical view (with some disagreements), a network of citations, and a social network across space and backwards through time. Austrian Econ contains smaller programs within it: entrepreneurship, political economy, history of thought, capital theory, etc.
Any given research program (RP) may look relatively “good”(ish) or “bad” at any given time, but the future is always uncertain. I wouldn’t bet money on it, but how am I to prove that astrology won’t turn out to be true at some point? It’s the Grue problem writ large.
What we can evaluate is whether an RP is “progressing” or “degenerating.” In the former case it’s gaining predictive power. In the latter case it’s turning into an ad hoc mess in the face of evidence.
It’s up to individual scientists to make the entrepreneurial [my word, not his] decision to invest some effort in whichever program they think is promising. The natural move would be to join a progressing RP. But there might be an opportunity to save a degenerating RP.
In other words, Lakatos wants to describe what science is doing, but he wants to avoid making value judgements about unknown futures. Rather than draw a demarcation line he instead offers a way to ask if a RP is going in the right direction (right now or retrospectively).
Let’s digress a minute and consider objective reality. Putting aside Cartesian skepticism, it seems reasonable to take the existence of an objective universe as a basic axiom. But just as surely, that objective universe has far more complications than humanity will ever be able to fully account for. The universe has more dimensions than us; what did you expect? In considering science’s ability to grasp objective reality, we have to understand that there’s always going to be some degree of (radical) uncertainty, even at the best of times.
“Good” science is that science that gets us closer to capital-T Truth. But we’ll never be in the omniscient position necessary to conclusively judge a bit of science as actually being good or not.
I think Lakatos and I share a sense that there is this objective reality that we can move towards. I think we also share an understanding that this objective reality is fundamentally inaccessible. I also share his position that the demarcationists are wrong. But I’m not ready to give up on the anarchists or the authoritarians.
Authoritarians basically argue that although there is good and bad science and that they can identify them even if they can’t explain how. Lakatos deals mostly with the uglier side of this school of thought, but misses a nicer side. That nicer version, ironically, includes him telling us things like astronomy is more valid than astronomy. To be fair, he hedges by acknowledging that the future is always uncertain… maybe in 1000 years astrology switches from a degenerating body of knowledge to a progressive one.
Hayek’s notion of tacit knowledge applies to scientific knowledge. The tacit knowledge of scientists allows them to tell future scientists things like “don’t even bother with alchemy.”
Still, just because you know something, doesn’t mean it’s right. We all “know” that Roman soldiers spoke with English accents because that’s how they’ve always been portrayed in movies. Try imagining Gladiator with Italian accents; it doesn’t work!
Sometimes authorities give us useful advice like distinguishing between astronomy and astrology. But sometimes they turn out to be wrong (after encouraging us to pursue eugenics in the meantime).
Authority is a useful guidepost, and represents the (current) structure of knowledge. I am not willing to give up my own authority because when it comes to economics, I know it’s not a matter of “anything goes!”
Reading Lakatos, I can’t quite settle on a camp between the anarchists and authoritarians. The anarchists are literally correct, but the authoritarians are able to actually make bets on a reality I think exists.
We’re all in the position of the blind men and the elephant. When someone tells me an elephant is like a tree, I think it behooves me to a) accept that as evidence about what the world is like, and b) take it with a grain of salt. The bumper sticker version of my stance might be “the Truth is out there… and its bigger than you think.”
So what about Lakatos? It’s all a bit rusty at this point so please push back in the comments. But here’s my tl;dr:
- Don’t trust anyone who tells you they’ve got the formula for “good science.”
- The way science actually works (as opposed to the mythology we’re taught in high school science) is that RP’s build up complex bodies of knowledge around a few core postulates. Normal science is concerned with attacking the knowledge that isn’t in that core.
- Scientific progress (e.g. the shift from Newtonian to Einsteinian physics) isn’t an Occam process… we’re not eliminating anomalies, but changing the set of anomalies we deal with.
- The mark of bad science is adding ad hoc theory that hand-waves away anomalies but doesn’t generalize to describing novel facts (if Nasim Taleb were in the audience, he’d be shouting via negativa! right now)
For and/or Against Method, initial miscellany
The past couple weeks I’ve been accumulating material related to our fledgling summer reading group. First I got For and Against Method, realized it was more for than against so I ordered the third edition of Against Method and also found the (apparently much shorter) first edition online.
I’m currently dipping my toes into For and Against, reading Lakatos’s lectures at LSE on the scientific method. I was expecting to be more interested in Feyerabend’s perspective, but so far I’m pleasantly surprised. Lakatos is an interesting guy, and the conversational tone of the (transcribed) lectures is delightful.
I’m not sure how we plan to do this reading group, so, anarchist that I am, I’m going to randomly lash out until something sticks! Here are some initial thoughts from Lakatos’s first two lectures:
- Around pp. 24-25 he lays out the demarcation problem: we want a (set of) method(s) to separate good and bad science. Presumably, our method should stand up to its own scrutiny. If our method is L(t), taking theory t and returning “good” or “bad”, then L(L) should return “good”. To me, this looks Gödelian.
- p. 26: “I remember when back in my Popperian days I used to put this question to Marxists and Freudians: ‘Tell me, what specific historical or social events would have to occur tin order for you to give up your Marxism?’ I remember that this was usually accompanied by either stunned silence or confusion. But I was very pleased with the effect.
“Much later I put the same question to a prominent scientist, who could not give any answer because, he said, ‘of course anomalies always spring up, but somehow sooner or later we always solve them.’ This is why, according to Feyerabend, who follows in Popper’s footsteps, all these criteria for intellectual honesty have one and the same function: they are empty rhetoric to frighten school children.” [emphasis my own]- Anyone here know something about rhetoric and the Greeks? Personally, I’m drawn to the notion that it’s all basically rhetoric. The term I prefer, though, is bullshit. Don’t get me wrong, by BS I don’t mean “wrong” or “bad” (per se). And for that matter, I don’t quite mean rhetoric either. It’s something like the sort of communication that goes on during a poker game.
- You might be able to see that I’m going to be naturally sympathetic to Feyerabend who, apparently, preferred to think of himself as an entertainer than an academic philosopher. That’s part of the reason I’m reading Lakatos first. But I’m happy to see that a) Lakatos has a sense of humor, and b) He’s got a character endorsement from Feyerabend.
- There’s good BS and bad BS. Bad BS leads to things like advertising campaigns and college accreditation schemes. Good BS leads to open minded learning. Good BS is what happens between grad students in a good program after midnight.
- Good BS isn’t arbitrary, but it isn’t too tightly bound to reality either. You can’t send an astronaut to space on good BS, but you probably need good BS to come up with the idea in the first place.
- I’m a materialist at the end of the day, and I believe in an objective external universe (though I can’t reject a Cartesian evil genius). But my map of that universe is highly impressionistic. I think anyone who’s map is more precise is either fooling themselves, or highly specific (i.e. they’re missing out on something).
- Currently, I’m thinking rhetoric is for strangers and BS is for friends.
- Anyone here know something about rhetoric and the Greeks? Personally, I’m drawn to the notion that it’s all basically rhetoric. The term I prefer, though, is bullshit. Don’t get me wrong, by BS I don’t mean “wrong” or “bad” (per se). And for that matter, I don’t quite mean rhetoric either. It’s something like the sort of communication that goes on during a poker game.
- Lakatos talks about three basic groups: Militant positivists, anarchists, and elitist authoritarianism.
- The positivists would be right if they were omniscient. In principle we could come up with theories that perfectly aligned with reality. And we could come up with a theory of theories that neatly separated the good from the bad. But the universe is more complex than our finite minds can handle.
- Did you hear the one about the economist who was told about the latest brilliant new business? His response: “sure it works in practice, but does it work in theory?”
- Lakatos’s view of the anarchists is that different theories are essentially all at the same level, but some get more support and others get less.
- According to the elitists “there is a demarcation, but there are no demarcation criteria.”
- I’m basically an elitist-anarchist with a heavy dose (I hope) of humility. There are better and worse theories (it’s not quite “anything goes”), and often (but not always) the elite are in the right position to pass (fallible) judgement. If a professional economist (ahem) says “Theory X is stupid”, then odds are good they’re correct. But it’s not guaranteed. Not even if all economists agree.
- The positivists would be right if they were omniscient. In principle we could come up with theories that perfectly aligned with reality. And we could come up with a theory of theories that neatly separated the good from the bad. But the universe is more complex than our finite minds can handle.
- There’s no easy way out. Some science is good and some is bad, and there’s no algorithmic way to distinguish them.
- It’s like the historians’ joke: “What was the outcome of WWII? Too soon to say.” We can extend the metaphor all the way back. It’s too soon to declare any specific outcome to the Big Bang. It’s surely the case that there will be some outcome (according to my materialist, even LaPlacian, priors), but predicting that outcome would require a computer bigger and more powerful than the universe.
- Fundamentally, distinguishing good and bad science requires going out on a limb, taking a risk, making a judgment. All theories will ultimately be tested against objective reality, but nature isn’t always great about sharing her data and our methods (especially our language, which places the ultimate constraints on our ability to share and accumulate knowledge) prevent us from getting to 100%.
My understanding is that Lakatos will be building up to some notion of a more-or-less objective way to demarcate good and bad science. I believe there is good and bad science, but I’m skeptical of humanity’s ability to draw any sort of hard line separating the two. I think the evaluation of science is more like the evaluation of art than the evaluation of competing answers to a well defined mathematical question.
Tying this in to my wheelhouse: science (as LaVoie has repeatedly told us) is in a similar position to market enterpreneurship (and also ants, which are amazing) and the Austrian insights apply: this is the sort of stuff that fundamentally only works in a decentralized, anarchic fashion. The ant queen is not actually a central planner. Entrepreneurship is decentralized social learning that central planning is no substitute for. And science is not so comprehensible that we’ll ever find some way to automate approval of grant proposals.
Learning is hard because we’re finite beings staring into an infinite abyss.