After all of my years in science, I still find myself surprised by a central tension in the field. On paper, every single researcher and theorist is looking for the idea that is going to overturn decades of consensus - but the emergent phenomenon of the "field" as a whole is, largely, dead set against this being possible.
The heroes of every scientific story have done just that - Newton, Copernicus, Galileo, Darwin, Planck, Young, Curie, the guy who discovered Troy - are people who have managed to see something that everyone else had missed. In so doing, they have single-handedly, radically changed the way that everyone else see the world.
Technically, practicing scientists are dimly aware of the fact that, occasionally, some outrageous insight that everyone else has missed turns the course of history. A single, visionary mind is enough to wipe away the flawed and faulty stories that we tell ourselves about the nature of the universe.
Despite this, most academics are deeply conservative when it comes to ideas. They have a relatively narrow frame through which they can view the world. Challenging ideas that come from the outside, or even ideas from the inside the house, so to speak, are treated with suspicion - if not with outright derision.
How does one square these two facts inside of one human psyche? How does one survive the tension that comes from knowing that sometimes radical revisions have to be made, with the utter conviction that if it comes, it won't be for you and your discipline?
Sometimes I think that it's some kind of professional jealousy, where it's just too hard to accept that someone else could be the one to see an idea hidden in plain sight. As if there is some sense of "that should have been me!" that prevents the diehard from opening their mind to a different way of seeing.
Other times, it seems like self-preservation. In my years trawling the fringes of science, I can count on the fingers of one hand how many times a heterodox theorist manages to talk about their work without kicking the machine, without talking about all the fools that prevent their idea from the starring role that it deserves.
Then, there's the fact that so many theorists outside of the academy are willing to twist the facts in their favor. I read books about heterodox theories for the arc of civilization, and am struck at how often authors misrepresent basic facts so that they can actively mislead the reader into believing their argument has more heft that it really does. Conveniently, misrepresenting the truth also spares the theorist the burden of actually arguing for their point of view
Obviously, the same thing happens inside of academic science, but it's far more obscured. It's much harder to tell when an entire field has misrepresented some finding, like that guy who just faked a bunch of alzheimer's research for years. Thousands of researchers cited him and even followed in his footsteps, without even considering that he could have been leading them down a sucker trail. Were they all fudging the numbers? Was it just a communal hallucination?
It feels reasonable that, if the academics are doing it, that the heterodox theorists feel justified in doing the same thing. Look at them, they think. They do it. Why shouldn't I? The ring of power whispers to them, and they fudge a fact, misrepresent a connection, say something that looks true but in their hearts they know can't possibly be.
The only solution I can see to this is some kind of internal moral alignment - a commitment to the high road that requires us to accept that we cannot prove a theory. There are no words put in just the right order that will suddenly convince everyone that our ideas are correct. Only thing we can do is commit ourselves to being reliable narrators, trustworthy guides to what is actually apparent, rather than lawyers trying to prove a murderous client innocent in court.
In some ways, this seems like the reason that Newton said he had given up on hypotheses. He knew that to prove the cause of gravity would require him to say things beyond what he could prove, to paint the cosmos with his preferred mediator. It's also why the positivists rejected all attempts at mechanizing the invisible. Forces and fields are all that we can see - the rest will have to wait for later. All of it, a bare attempt at controlling the human tendency to say what we want so badly to be true, rather than acknowledge the limits of our abilities.
I'd like to imagine that a different world is possible - where theorists bind themselves to some internal responsibility of reliability. Like all cases of "wouldn't it be nice if...", I have a feeling this is never going to happen.
But wouldn't it be nice if it did?