Science writer John Horgan recently belittled his beat:
I’m struck … by all the “breakthroughs” and “revolutions” that have failed to live up to their hype: string theory and other supposed “theories of everything,” self-organized criticality and other theories of complexity, anti-angiogenesis drugs and other potential “cures” for cancer, drugs that can make depressed patients “better than well,” “genes for” alcoholism, homosexuality, high IQ and schizophrenia.
Gary Marcus takes offense, writing, “The problem with some of these punches is not that they are wrong, but that they are one-sided”:
When Horgan writes that “the biggest meta-story in science over the last few years—and one that caught me by surprise—is that much of the peer-reviewed scientific literature is rotten,” it’s not just that he is arguably overstating things, it’s that he’s missing half the story.
There is a crisis in replicability, as both Horgan and The Economist suggest (and as I noted last December). But there is also a huge, rapidly growing movement to address it. When I revisited the topic a few months later, I reported at least five new efforts focussed on increasing replicability. Since then, the list has continued to grow. … The wholesale shift in the culture of how scientists think about their craft is at least as significant a meta-story as the replicability crisis itself. But the prophets of doom never let their readers in on this happy secret.
His conclusion:
The most careful scientists, and the best science journalists, realize that all science is provisional. There will always be things that we haven’t figured out yet, and even some that we get wrong. But science is not just about conclusions, which are occasionally incorrect. It’s about a methodology for investigation, which includes, at its core, a relentless drive towards questioning that which came before. You can both love science and question it.
Recent Dish on the subject here.