r/ReproducibilityCrisis • • Dec 15 '22

"We are going to kill ourselves", because of the peer-review system

26 Upvotes

r/ReproducibilityCrisis • • Dec 11 '21

Reproducibility memes

Post image
23 Upvotes

r/ReproducibilityCrisis • • Sep 27 '22

216,000 studies in doubt as popular genetic analysis method found to be flawed

Thumbnail
scitechdaily.com
19 Upvotes

r/ReproducibilityCrisis • • Jul 05 '21

Nutrition Science Is Broken. This New Egg Study Shows Why.

Thumbnail
undark.org
17 Upvotes

r/ReproducibilityCrisis • • Jul 04 '21

Former CDC director says he got death threats from scientists after expressing support for Covid ‘lab leak’ theory

Thumbnail
independent.co.uk
17 Upvotes

r/ReproducibilityCrisis • • Jun 28 '21

Science has been in a “replication crisis” for a decade. Have we learned anything?

Thumbnail
vox.com
16 Upvotes

r/ReproducibilityCrisis • • Jul 21 '21

Why Bad Science Is Sometimes More Appealing Than Good Science

Thumbnail
scientificamerican.com
13 Upvotes

r/ReproducibilityCrisis • • Jul 10 '21

How Much Scientific Research Is Actually Fraudulent?

Thumbnail
reason.com
12 Upvotes

r/ReproducibilityCrisis • • Jun 22 '21

On the subject of peer review:

12 Upvotes

On the subject of peer review:

The case against science is straightforward: much of the scientific literature, perhaps half, may simply be untrue. Afflicted by studies with small sample sizes, tiny effects, invalid exploratory analyses, and flagrant conflicts of interest, together with an obsession for pursuing fashionable trends of dubious importance, science has taken a turn towards darkness. As one participant put it, “poor methods get results”.

-Richard Horton, Editor of the Lancet.

https://www.thelancet.com/journals/lancet/article/PIIS0140-6736(15)60696-1/fulltext

This isn’t so much a problem with peer review itself as a recognition that peer review can only be as unbiased as the aggregate body of peers being called upon to participate. The skeptical checks and balances that should characterize the scholarly process have been replaced with a steady breeze of confirmation bias that blows grievance studies scholarship ever further off course. This isn’t how research is supposed to work.

Though it doesn’t immediately seem obvious—because financial incentives for the researchers, for the most part, aren’t directly involved (although the publishing houses are definitely raking it in)—this is a kind of blatant corruption. In this way, politically biased research that rests on highly questionable premises gets legitimized as though it is verifiable knowledge. It then goes on to permeate our culture because professors, activists, and others cite and teach this ever-growing body of ideologically skewed and fallacious scholarship.

This matters because even though most people will never read a single scholarly paper in their lifetimes, peer-reviewed journals are the absolute gold standard of knowledge production. And these concepts leak into culture.

https://areomagazine.com/2018/10/02/academic-grievance-studies-and-the-corruption-of-scholarship/

After a 14-month investigation, JVC determined the ring involved “aliases” and fake e-mail addresses of reviewers — up to 130 of them — in an apparently successful effort to get friendly reviews of submissions and as many articles published as possible by Chen and his friends. “On at least one occasion, the author Peter Chen reviewed his own paper under one of the aliases he created,” according to the SAGE announcement.

https://www.washingtonpost.com/news/morning-mix/wp/2014/07/10/scholarly-journal-retracts-60-articles-smashes-peer-review-ring/

Michael Eisen, a biologist at UC Berkeley, is a co-founder of the Public Library of Science, one of the world’s largest nonprofit science publishers. He told me in an email that, “We need to get away from the notion, proven wrong on a daily basis, that peer review of any kind at any journal means that a work of science is correct. What it means is that a few (1-4) people read it over and didn’t see any major problems. That’s a very low bar in even the best of circumstances.”

According to a 2011 report in the monthly journal Nature Reviews Drug Discovery, the results of two-thirds of 67 key studies analyzed by Bayer researchers from 2008-2010 couldn't be reproduced.

https://www.wsj.com/articles/hank-campbell-the-corruption-of-peer-review-is-harming-scientific-credibility-1405290747

Testimony of Gerald Rogan, M.D., before California Senate Committee on the failings of peer review in the medical field. He reviewed Dr. Moon, the highest paid cardiologist in California and didn't realize that Dr. Moon was operating on healthy patients. 600 operations where medical officials at multiple agencies were aware of the scam and keeping quiet for their financial gain and this isn't a one-off situation. Skipped or sham peer review of elective medical procedures is a widespread problem.

https://youtu.be/5MquLfLJ9BQ

Full report.

http://www.allianceforpatientsafety.org/redding-failure.pdf

https://en.wikipedia.org/wiki/Sham_peer_review

In a new trend, increasing numbers of scientific articles are being retracted because of fake peer reviews — a type of fraud made possible by electronic manuscript submission systems and inspired by academia's publish-or-perish ethos

https://www.nejm.org/doi/full/10.1056/NEJMp1512330

Moon's was not an isolated case. In the past 2 years, journals have been forced to retract more than 110 papers in at least 6 instances of peer-review rigging. What all these cases had in common was that researchers exploited vulnerabilities in the publishers' computerized systems to dupe editors into accepting manuscripts, often by doing their own reviews. The cases involved publishing behemoths Elsevier, Springer, Taylor & Francis, SAGE and Wiley, as well as Informa, and they exploited security flaws that — in at least one of the systems — could make researchers vulnerable to even more serious identity theft.

https://www.nature.com/articles/515480a

In 2013 science journalist John Bohannon created a biomedical equivalent of SCIgen and submitted more than 300 obviously bogus papers to publishers around the world. More than half were accepted. Though Bohannon’s sting was mostly aimed at predatory publishers, some reputable houses were caught in the dragnet, such as Dove, Sage, and Elsevier. More recently I exposed more than 100 journal articles that looked like they were products of a scientific version of Mad Libs; they tended to have obvious signs of plagiarism or poor scholarship of various sorts. A rigorous peer-review process should have caught these problems. Yet these papers appeared in journals published by PLoS, Nature Publishing Group, Wiley, Taylor & Francis, BioMed Central, and other publishing powerhouses. On top of that, a number of publishers have had to admit that they were tricked into using nonexistent peers to conduct the reviews.

https://slate.com/technology/2015/04/fake-peer-review-scientific-journals-publish-fraudulent-plagiarized-or-nonsense-papers.html


r/ReproducibilityCrisis • • Oct 15 '21

Slowed canonical progress in large fields of science

Thumbnail
pnas.org
11 Upvotes

r/ReproducibilityCrisis • • Jul 10 '21

The 7 biggest problems facing science, according to 270 scientists

Thumbnail
vox.com
11 Upvotes

r/ReproducibilityCrisis • • Jun 26 '21

Is Theoretical Physics Wasting Our Best Living Minds On Nonsense?

Thumbnail
forbes.com
11 Upvotes

r/ReproducibilityCrisis • • Mar 17 '22

The illusion of evidence based medicine - BMJ (pdf) (corporate interests, failed regulation, and commercialisation of academia)

Thumbnail bmj.com
10 Upvotes

r/ReproducibilityCrisis • • Dec 03 '21

Scientific knowledge is drowning in a flood of research

Thumbnail
massivesci.com
10 Upvotes

r/ReproducibilityCrisis • • Jul 20 '21

Time to assume that health research is fraudulent until proven otherwise? [BMJ]

Thumbnail
blogs.bmj.com
10 Upvotes

r/ReproducibilityCrisis • • Apr 29 '22

humor We think this cool study we found is flawed. Help us reproduce it.

Thumbnail
pudding.cool
9 Upvotes

r/ReproducibilityCrisis • • Apr 03 '22

False-Positive Psychology: Undisclosed Flexibility in Data Collection and Analysis Allows Presenting Anything as Significant

Thumbnail journals.sagepub.com
9 Upvotes

r/ReproducibilityCrisis • • Jul 27 '21

Reproducibility of Scientific Results (Stanford Encyclopedia of Philosophy)

Thumbnail
plato.stanford.edu
9 Upvotes

r/ReproducibilityCrisis • • Nov 30 '21

Science Is Not “Self-Correcting.” Science Is Broken.

Thumbnail
slate.com
8 Upvotes

r/ReproducibilityCrisis • • Oct 13 '21

Non-financial conflicts of interest in peer-review

Thumbnail
tandfonline.com
8 Upvotes

r/ReproducibilityCrisis • • Aug 19 '21

Many Mouse Studies Happen at the Wrong Time of Day [Mice are nocturnal.]

Thumbnail
scientificamerican.com
8 Upvotes

r/ReproducibilityCrisis • • Aug 14 '21

Psychology is in a crisis. But not the one you're thinking of

Thumbnail
sciencefocus.com
8 Upvotes

r/ReproducibilityCrisis • • Jul 26 '21

Most research on clinical decision support tools is never replicated

Thumbnail
statnews.com
8 Upvotes

r/ReproducibilityCrisis • • Jul 04 '21

Covid-19: politicisation, “corruption,” and suppression of science

Thumbnail
bmj.com
8 Upvotes