randomwalker

randomwalker, 25 days ago to random

Kirkus Reviews, which provides early book reviews to the publishing industry, has given AI Snake Oil a very positive "starred" review, which we're told is rare and kind of a big deal. Honored and grateful! https://kirkusreviews.com/book-reviews/arvind-narayanan/ai-snake-oil/
Preorder:
https://www.amazon.com/Snake-Oil-Artificial-Intelligence-Difference/dp/069124913X
https://bookshop.org/p/books/ai-snake-oil-what-artificial-intelligence-can-do-what-it-can-t-and-how-to-tell-the-difference-arvind-narayanan/21324674
More preorder links at the bottom of this post
https://www.aisnakeoil.com/p/ai-snake-oil-is-now-available-to
Coauthored by @sayashk, published by @princetonupress.

randomwalker, 9 months ago to random

The "ChatGPT has a liberal bias" paper has at least 4 independently fatal flaws:
– Tested an older model, not ChatGPT.
– Used a trick prompt to bypass the fact that it actually refuses to opine on political q's.
– Order effect: flipping q's in the prompt changes bias from Democratic to Republican.
– The prompt is very long and seems to make the model simply forget what it's supposed to do.
By @sayashk and me, summarizing our analysis and a separate one by Colin Fraser. https://www.aisnakeoil.com/p/does-chatgpt-have-a-liberal-bias

randomwalker, 1 year ago to random

People have been posting glaring examples of ChatGPT’s gender bias, like arguing that attorneys can't be pregnant. So @sayashk and I tested ChatGPT on WinoBias, a standard gender bias benchmark. Both GPT-3.5 and GPT-4 are about 3 times as likely to answer incorrectly if the correct answer defies gender stereotypes — despite the benchmark dataset likely being included in the training data. https://aisnakeoil.substack.com/p/quantifying-chatgpts-gender-bias

randomwalker, 1 year ago to random

We're at over 1,000 registrations for the @knightcolumbia algorithmic amplification symposium this Friday & Saturday. We're lucky to have an all-star cast of speakers. In-person registration is closed/waitlisted, but you can still register to attend online: https://knightcolumbia.org/events/optimizing-for-what-algorithmic-amplification-and-society

natematias, 1 year ago to random

Who do so many people seem unaware of the mass exodus from Twitter?

Social media feeds are engines for distorting our social understanding. But we can push back against the algorithm, with a simple automated out-of-office message on Twitter (how-to included).

This post explains the science of social influence that allows Twitter to maintain an illusion of a full room, how to change that, & why we need industry-independent science for our digital environments.

https://natematias.medium.com/how-twitter-misleads-us-about-how-many-people-have-left-and-what-to-do-about-it-bba484b6fed6