r/ReproducibilityCrisis • u/zyxzevn • Dec 15 '22
r/ReproducibilityCrisis • u/ExcaliBabbler • Sep 27 '22
216,000 studies in doubt as popular genetic analysis method found to be flawed
r/ReproducibilityCrisis • u/1913intel • Jul 05 '21
Nutrition Science Is Broken. This New Egg Study Shows Why.
r/ReproducibilityCrisis • u/1913intel • Jul 04 '21
Former CDC director says he got death threats from scientists after expressing support for Covid ‘lab leak’ theory
r/ReproducibilityCrisis • u/vteead • Jun 28 '21
Science has been in a “replication crisis” for a decade. Have we learned anything?
r/ReproducibilityCrisis • u/1913intel • Jul 21 '21
Why Bad Science Is Sometimes More Appealing Than Good Science
r/ReproducibilityCrisis • u/1913intel • Jul 10 '21
How Much Scientific Research Is Actually Fraudulent?
r/ReproducibilityCrisis • u/[deleted] • Jun 22 '21
On the subject of peer review:
On the subject of peer review:
The case against science is straightforward: much of the scientific literature, perhaps half, may simply be untrue. Afflicted by studies with small sample sizes, tiny effects, invalid exploratory analyses, and flagrant conflicts of interest, together with an obsession for pursuing fashionable trends of dubious importance, science has taken a turn towards darkness. As one participant put it, “poor methods get results”.
-Richard Horton, Editor of the Lancet.
https://www.thelancet.com/journals/lancet/article/PIIS0140-6736(15)60696-1/fulltext
This isn’t so much a problem with peer review itself as a recognition that peer review can only be as unbiased as the aggregate body of peers being called upon to participate. The skeptical checks and balances that should characterize the scholarly process have been replaced with a steady breeze of confirmation bias that blows grievance studies scholarship ever further off course. This isn’t how research is supposed to work.
Though it doesn’t immediately seem obvious—because financial incentives for the researchers, for the most part, aren’t directly involved (although the publishing houses are definitely raking it in)—this is a kind of blatant corruption. In this way, politically biased research that rests on highly questionable premises gets legitimized as though it is verifiable knowledge. It then goes on to permeate our culture because professors, activists, and others cite and teach this ever-growing body of ideologically skewed and fallacious scholarship.
This matters because even though most people will never read a single scholarly paper in their lifetimes, peer-reviewed journals are the absolute gold standard of knowledge production. And these concepts leak into culture.
https://areomagazine.com/2018/10/02/academic-grievance-studies-and-the-corruption-of-scholarship/
After a 14-month investigation, JVC determined the ring involved “aliases” and fake e-mail addresses of reviewers — up to 130 of them — in an apparently successful effort to get friendly reviews of submissions and as many articles published as possible by Chen and his friends. “On at least one occasion, the author Peter Chen reviewed his own paper under one of the aliases he created,” according to the SAGE announcement.
Michael Eisen, a biologist at UC Berkeley, is a co-founder of the Public Library of Science, one of the world’s largest nonprofit science publishers. He told me in an email that, “We need to get away from the notion, proven wrong on a daily basis, that peer review of any kind at any journal means that a work of science is correct. What it means is that a few (1-4) people read it over and didn’t see any major problems. That’s a very low bar in even the best of circumstances.”
According to a 2011 report in the monthly journal Nature Reviews Drug Discovery, the results of two-thirds of 67 key studies analyzed by Bayer researchers from 2008-2010 couldn't be reproduced.
Testimony of Gerald Rogan, M.D., before California Senate Committee on the failings of peer review in the medical field. He reviewed Dr. Moon, the highest paid cardiologist in California and didn't realize that Dr. Moon was operating on healthy patients. 600 operations where medical officials at multiple agencies were aware of the scam and keeping quiet for their financial gain and this isn't a one-off situation. Skipped or sham peer review of elective medical procedures is a widespread problem.
Full report.
http://www.allianceforpatientsafety.org/redding-failure.pdf
https://en.wikipedia.org/wiki/Sham_peer_review
In a new trend, increasing numbers of scientific articles are being retracted because of fake peer reviews — a type of fraud made possible by electronic manuscript submission systems and inspired by academia's publish-or-perish ethos
https://www.nejm.org/doi/full/10.1056/NEJMp1512330
Moon's was not an isolated case. In the past 2 years, journals have been forced to retract more than 110 papers in at least 6 instances of peer-review rigging. What all these cases had in common was that researchers exploited vulnerabilities in the publishers' computerized systems to dupe editors into accepting manuscripts, often by doing their own reviews. The cases involved publishing behemoths Elsevier, Springer, Taylor & Francis, SAGE and Wiley, as well as Informa, and they exploited security flaws that — in at least one of the systems — could make researchers vulnerable to even more serious identity theft.
https://www.nature.com/articles/515480a
In 2013 science journalist John Bohannon created a biomedical equivalent of SCIgen and submitted more than 300 obviously bogus papers to publishers around the world. More than half were accepted. Though Bohannon’s sting was mostly aimed at predatory publishers, some reputable houses were caught in the dragnet, such as Dove, Sage, and Elsevier. More recently I exposed more than 100 journal articles that looked like they were products of a scientific version of Mad Libs; they tended to have obvious signs of plagiarism or poor scholarship of various sorts. A rigorous peer-review process should have caught these problems. Yet these papers appeared in journals published by PLoS, Nature Publishing Group, Wiley, Taylor & Francis, BioMed Central, and other publishing powerhouses. On top of that, a number of publishers have had to admit that they were tricked into using nonexistent peers to conduct the reviews.
r/ReproducibilityCrisis • u/terrelli • Oct 15 '21
Slowed canonical progress in large fields of science
r/ReproducibilityCrisis • u/vteead • Jul 10 '21
The 7 biggest problems facing science, according to 270 scientists
r/ReproducibilityCrisis • u/vteead • Jun 26 '21
Is Theoretical Physics Wasting Our Best Living Minds On Nonsense?
r/ReproducibilityCrisis • u/zyxzevn • Mar 17 '22
The illusion of evidence based medicine - BMJ (pdf) (corporate interests, failed regulation, and commercialisation of academia)
bmj.comr/ReproducibilityCrisis • u/[deleted] • Dec 03 '21
Scientific knowledge is drowning in a flood of research
r/ReproducibilityCrisis • u/zyxzevn • Jul 20 '21
Time to assume that health research is fraudulent until proven otherwise? [BMJ]
r/ReproducibilityCrisis • u/madcowga • Apr 29 '22
humor We think this cool study we found is flawed. Help us reproduce it.
r/ReproducibilityCrisis • u/vteead • Apr 03 '22
False-Positive Psychology: Undisclosed Flexibility in Data Collection and Analysis Allows Presenting Anything as Significant
journals.sagepub.comr/ReproducibilityCrisis • u/rhyparographe • Jul 27 '21
Reproducibility of Scientific Results (Stanford Encyclopedia of Philosophy)
r/ReproducibilityCrisis • u/vteead • Nov 30 '21
Science Is Not “Self-Correcting.” Science Is Broken.
r/ReproducibilityCrisis • u/terrelli • Oct 13 '21
Non-financial conflicts of interest in peer-review
r/ReproducibilityCrisis • u/1913intel • Aug 19 '21
Many Mouse Studies Happen at the Wrong Time of Day [Mice are nocturnal.]
r/ReproducibilityCrisis • u/1913intel • Aug 14 '21
Psychology is in a crisis. But not the one you're thinking of
r/ReproducibilityCrisis • u/1913intel • Jul 26 '21
Most research on clinical decision support tools is never replicated
r/ReproducibilityCrisis • u/1913intel • Jul 04 '21