Science Has Lost Its Way, At a Big Cost to Humanity
October 27th, 2013I’ve posted about this before, but it’s worth repeating.
Via: Los Angeles Times:
In today’s world, brimful as it is with opinion and falsehoods masquerading as facts, you’d think the one place you can depend on for verifiable facts is science.
You’d be wrong. Many billions of dollars’ worth of wrong.
A few years ago, scientists at the Thousand Oaks biotech firm Amgen set out to double-check the results of 53 landmark papers in their fields of cancer research and blood biology.
The idea was to make sure that research on which Amgen was spending millions of development dollars still held up. They figured that a few of the studies would fail the test — that the original results couldn’t be reproduced because the findings were especially novel or described fresh therapeutic approaches.
But what they found was startling: Of the 53 landmark papers, only six could be proved valid.
“Even knowing the limitations of preclinical research,” observed C. Glenn Begley, then Amgen’s head of global cancer research, “this was a shocking result.”
Unfortunately, it wasn’t unique. A group at Bayer HealthCare in Germany similarly found that only 25% of published papers on which it was basing R&D projects could be validated, suggesting that projects in which the firm had sunk huge resources should be abandoned. Whole fields of research, including some in which patients were already participating in clinical trials, are based on science that hasn’t been, and possibly can’t be, validated.
“The thing that should scare people is that so many of these important published studies turn out to be wrong when they’re investigated further,” says Michael Eisen, a biologist at UC Berkeley and the Howard Hughes Medical Institute. The Economist recently estimated spending on biomedical R&D in industrialized countries at $59 billion a year. That’s how much could be at risk from faulty fundamental research.
Eisen says the more important flaw in the publication model is that the drive to land a paper in a top journal — Nature and Science lead the list — encourages researchers to hype their results, especially in the life sciences. Peer review, in which a paper is checked out by eminent scientists before publication, isn’t a safeguard. Eisen says the unpaid reviewers seldom have the time or inclination to examine a study enough to unearth errors or flaws.
“The journals want the papers that make the sexiest claims,” he says. “And scientists believe that the way you succeed is having splashy papers in Science or Nature — it’s not bad for them if a paper turns out to be wrong, if it’s gotten a lot of attention.”
