Grilled Cheese

ExploreLog inSign up

Jamie Cummins

@jamiecummins.bsky.social

816 Following3k Followers

Advanced postdoc at University of Bern.
Also sometimes @bennettoxford.bsky.social.
Metascience stuff.
Creator and developer of RegCheck (https://regcheck.app). STAR Editor at Psych Science.
@error.reviews
🇮🇪

PostsRepliesMedia
@neuroskeptic.bsky.socialOct 12, 2026, 10:16 AMReposted by @jamiecummins.bsky.social

This is an astonishing @pubpeer.com post: pubpeer.com/publications... The author compares data points from a figure against random numbers produced with a certain seed, finding r > 0.999999996! 🫠

Could there be any possible innocent explanation?

The paper: www.nature.com/articles/s41...

@lhdjung.bsky.socialOct 12, 2026, 9:21 AMReposted by @jamiecummins.bsky.social

Many new forensic meta-science tools aim to detect trustworthiness problems in published research at scale.

Yet how trustworthy are these tools themselves? We – @ianhussey.mmmdata.io, @jamiecummins.bsky.social, and I – have some concerns.

@lakens.bsky.socialOct 7, 2026, 3:20 AMReposted by @jamiecummins.bsky.social

9 days left to submit an abstract to the 9th edition of the Perspectives on Scientific Error conference that will take place in Copenhagen, Denmark, 27–29 January 2027, errorsin.science. It's my favorite conference combining philosophy of science, metascience, and statistics.

@ianhussey.mmmdata.ioOct 9, 2026, 11:00 AMReposted by @jamiecummins.bsky.social

Our reflections on the recent "AI and Research Integrity" meeting in Montreal:

We are somewhat worried that many AI trustworthiness assessment tools are not trustworthy.

@lhdjung.bsky.social
@jamiecummins.bsky.social
trustworthy.scientific.claims/posts/trustw...

@jamiecummins.bsky.socialOct 9, 2026, 11:29 AM

If (forensic) metascientists want to hold others to certain standards of rigor based on the tools they build, then we must also hold ourselves to these same standards, as we (@ianhussey.mmmdata.io, @lhdjung.bsky.social, and I) argue in this blog post.

@simine.comOct 7, 2026, 2:07 PMReposted by @jamiecummins.bsky.social

Another special issue at Psych Science!

We invite “submissions that advance the field through critical appraisal of articles previously published by Psychological Science”

Please share!

www.psychologicalscience.org/publications...

@ploederl.bsky.socialOct 1, 2026, 9:46 AMReposted by @jamiecummins.bsky.social

🚨 Paper Alert 🚨
Our new study on the impact of a single small zombie trial on fluoxetine's overall efficacy estimation is out.
With great colleagues @floriannaudet.bsky.social @richlyus.bsky.social and Gert van Valkenhoef
🧟‍♂️🧟‍♀️🧟

A longer 🧵

(1/n)

@richvn.bsky.socialOct 2, 2026, 2:39 PMReposted by @jamiecummins.bsky.social

NEW: researchers say one 'zombie' study in Iran, 20 years ago, has skewed the world's medical evidence base for using Prozac to treat depression in children.

They stop short of saying don't use Prozac this way, but want clinical guidelines revised.

@nature.com
www.nature.com/articles/d41...

@bennettoxford.bsky.socialOct 2, 2026, 9:40 AMReposted by @jamiecummins.bsky.social

📣Cory Doctorow will deliver the closing keynote at the 2026 Bennett Oxford Symposium!

Open to the public. Already attending? No need to register again.

🔗 https://www.eventbrite.co.uk/e/cory-doctorows-closing-keynote-lecture-2026-bennett-oxford-symposium-tickets-1998889208431

📸 Anna Olthoff

@hencarnell.bsky.socialOct 1, 2026, 4:10 PMReposted by @jamiecummins.bsky.social

New research: “AI-generated survey results consistently differ from human surveys“

@jamiecummins.bsky.socialOct 1, 2026, 9:18 AM

Looking sharp (the building too!). Congrats Dirk!

@dirkwulff.bsky.socialOct 1, 2026, 9:15 AMReposted by @jamiecummins.bsky.social

📣 Delighted to share that I have joined WU (Vienna University of Economics and Business) as Professor of Artificial Intelligence and Behavioral Science. Announcements for at least one postdoc-level position will follow soon. Please reach out if you are interested.

@ianhussey.mmmdata.ioSep 29, 2026, 11:00 AMReposted by @jamiecummins.bsky.social

Hayes has been banging this drum about idionomic analyses for 6+ years, with folk like @jamiecummins.bsky.social pointing out that its reinventing-the-wheel-but-worse for just as long.

My experience is that the ACT community is insufficiently interested and aware of existing methods+stats work.

@jamiecummins.bsky.socialSep 28, 2026, 9:26 PM

My lukewarm take is that when people disagree about whether LLMs can do X (be it reasoning, creativity, etc), the substantive disagreement is really about what X means, rather than about LLMs themselves. Aka Wittgenstein was right

@pgmj.bsky.socialSep 28, 2026, 2:38 PMReposted by @jamiecummins.bsky.social

Our commentary "A Revolution in Search of an Estimand: On the Idionomic Proposal of Hayes et al. (2026)" is now available as a preprint: osf.io/preprints/ps...
With @rpsychologist.com, @matti.vuorre.com, and Nils Hentati Isacsson.

@i4replication.bsky.socialSep 25, 2026, 2:15 PMReposted by @jamiecummins.bsky.social

Over the past two years, I4R partnered with Psychological Science (@psychscience.bsky.social) on a large reproducibility project.

67 independent teams reproduced 64 articles published in 2024–2025, about 44% of eligible papers.

Paper: www.econstor.eu/bitstream/10...

Here's what we learned 🧵

@jamiecummins.bsky.socialSep 25, 2026, 11:58 AM

Right side of the photo - the middle finger has clear morphing on it. Definitely AI-generated/manipulated.

@scientificdiscovery.devSep 25, 2026, 11:42 AMReposted by @jamiecummins.bsky.social

Happy Friday! Iʼve created a game for you to play!

Will AI cure all diseases in 10 years? Inspired by bottlenecks discourse, I created a game to help build your intuitions. Play it here: game.clinicaltrialsabundance.blog

Naturally, it’s bottle-themed with bubbles and there are leaderboards too.

@jamiecummins.bsky.socialSep 24, 2026, 1:54 PM

I sincerely hope this paper will be seen as a turning point in how the medical sciences think and approach the issue of trustworthiness assessment (and I hope the social sciences follow suit!).

Congrats to @jdwilko.bsky.social and colleagues (incl. @ianhussey.mmmdata.io and @lhdjung.bsky.social)!

@cochrane.orgSep 24, 2026, 10:24 AMReposted by @jamiecummins.bsky.social

INSPECT-SR – a tool for assessing the trustworthiness of randomized controlled trials – has been published today in @bmj.com, giving researchers a structured way to identify problematic studies before they're included in systematic reviews.

🔗 www.cochrane.org/about-us/new...

#ResearchIntegrity

“Systematic reviews are only as credible as the studies they include.” — phrased as a Cochrane senior research integrity editor; a magnifying glass rests on stacked papers in the background to emphasize careful scrutiny of research.
Older posts
Terms of UsePrivacy PolicyCommunity StandardsHelpGet the app

Grilled Cheese is a product of Village Compute

Version devBuilt at: 2026-10-12 04:31:30 EDT