Grilled Cheese

ExploreLog inSign up

Mor Naaman

@informor.bsky.social

1k Following8.8k Followers

Cornell Tech professor (information science, AI-mediated Communication, trustworthiness of our information ecosystem). New York City. Taller in person. Opinions my own.

mornaaman.com

PostsRepliesMedia
@informor.bsky.socialOct 12, 2026, 2:10 AM

Wedding in Philly. "Dearly beloved, we are gathered here today 9 days before the opening of the season 11 days before the Sixers' first home game To witness the joining in the holy matrimony of..." True story.

@informor.bsky.socialOct 9, 2026, 11:33 PM

Weirdly, same trend and similar takeaways (and methods!) in the research summarized here:

AI coding agents generate more code, but not more software - Ars Technica share.google/tqH0TzAJJpeR...

@informor.bsky.socialOct 9, 2026, 10:57 AM

Very cool idea! I am not sure we looked at that but @isabelcorpus.bsky.social knows better. I would guess that the signal is too sparse, with a large majority of petitions not getting self-follow-up comments.

@informor.bsky.socialOct 8, 2026, 6:03 PM

Dang it here's a better link (without the ref to the paper section included in the previous one).

www.nature.com/articles/s41...

Also, my website now linked from my profile.

@informor.bsky.socialOct 8, 2026, 6:00 PM

Recent papers from @dgrand.bsky.social and others show that the persuasive power of AI comes from providing a high rate of facts/claims (true/not); this is unlikely to have diminished effect over time. On the other hand, AI language is likely to encounter more resistance IMO, but no evidence yet

@informor.bsky.socialOct 8, 2026, 5:41 PM

I think we did; @isabelcorpus.bsky.social can remind us... But as you point out, the potential general trend is exactly what we are controlling against (somewhat related: growth in participation resumed post Trump II).

@informor.bsky.socialOct 8, 2026, 4:01 PM

An inexcusable omission, now fixed! Thanks.

@informor.bsky.socialOct 8, 2026, 4:00 PM

Yes! Regression to the mean. Who returns for a second petition? Mostly those who had a successful first one.

@informor.bsky.socialOct 8, 2026, 3:57 PM

This too is an interesting hypothesis; from research that I have seen (and done) so far this is not yet the case. Maybe in the future...

@informor.bsky.socialOct 8, 2026, 3:53 PM

Yes very valid hypothesis. We don't *think* that this is what's happening here because the period we studied was not yet widespread in AI use or suspicion, but we definitely mention that as a possibility in the article. No good way (that we could think about) to find out.

@informor.bsky.socialOct 8, 2026, 3:02 PM

Paper and materials here; if you don't have access, you can find the unofficial pre-print version on my website.

www.nature.com/articles/s41...

Happy to hear feedback and ideas!

@informor.bsky.socialOct 8, 2026, 3:02 PM

Why was the AI not helpful? See the paper for more discussion, but some possible reasons (we are looking at now) include decreased specificity of petitions and (I think, more significantly) reduced effort by the petition writers, who were less committed after AI wrote for them.

@informor.bsky.socialOct 8, 2026, 3:02 PM

Isabel came up w/ another analysis, looking at repeat petition writers who returned to write a 2nd petition. We compared people who wrote 2 petitions before the AI launch w/ those who wrote 1 before and 1 after AI feature access, confirming our results: AI access changed the text, not the outcomes.

@informor.bsky.socialOct 8, 2026, 3:02 PM

One could ask whether these diminished outcomes are due to new authors joining the platform with the increased access that writing with AI enables (which is one of the reasons the feature was launched in the first place). We saw no evidence of a widespread increase in participation. Further...

@informor.bsky.socialOct 8, 2026, 3:02 PM

Was the AI assistance helpful? In general, petitions were NOT more successful with access to AI -- if anything, our results show that petitions may have been less successful in hitting signature and comment thresholds (see the end of this thread for speculation as to why this was the case).

@informor.bsky.socialOct 8, 2026, 3:02 PM

(In the supplementary materials, you can also see an increase, post-AI, in the use of words such as "implement", "urge", and "mandate" in the post-AI petitions' titles).

@informor.bsky.socialOct 8, 2026, 3:02 PM

As you can imagine, the petitions' textual/lexical aspects shifted with access to the AI feature: they were, on average, 50 words longer with access to "write with AI"; the sentences were longer, and the words were more complex. At the same time, the petitions became more similar to each other.

@informor.bsky.socialOct 8, 2026, 3:02 PM

If you are a data scientist/causal inference person, you know what that means: we had a natural experiment that could be leveraged using diff-in-diff analysis to estimate the causal impact of the AI feature on various aspects of the petitions.

@informor.bsky.socialOct 8, 2026, 3:02 PM

This was work led by the amazing @isabelcorpus.bsky.social with @allisonkoe.bsky.social and @eegilbert.org. Looking at the data we crawled (millions of petitions), Isabel noticed that the textual changes lagged in Australia; we later confirmed this was due to late launch of the AI feature there.

@informor.bsky.socialOct 8, 2026, 3:02 PM

🆕 📝 New paper officially out in @nathumbehav.nature.com!

In 2023, Change.org built an AI-assisted writing tool into their platform. We offer causal evidence that access to the AI tool changed petition text (word count, language)... but may have actually hurt outcomes (signatures, comments).

Older posts
Terms of UsePrivacy PolicyCommunity StandardsHelpGet the app

Grilled Cheese is a product of Village Compute

Version devBuilt at: 2026-10-12 02:39:10 EDT