First, although GPT-4’s UBE score nears the 90th percentile when examining approximate conversions from February administrations of the Illinois Bar Exam, these estimates are heavily skewed towards repeat test-takers who failed the July administration and score significantly lower than the general test-taking population.
What I find delightful about this is that I already wasn’t impressed! Because, as the paper goes on to say
Moreover, although the UBE is a closed-book exam for humans, GPT-4’s huge training corpus largely distilled in its parameters means that it can effectively take the UBE “open-book”
And here I was thinking it not getting a perfect score on multiple-choice questions was already damning. But apparently it doesn’t even get a particularly good score!
Yeah, even setting aside the intelligence claims, I know I’d be feeling a lot more positive about LLMs as a fun theoretical tool if they weren’t being sold as personal assistants or search engine replacements etc, which even the apologists here admit they’re really really bad at.
(Also I’d argue “linguistic patterns” is pushing it. “Textual patterns” more like, it’s not supposed to have any idea about grammar or even about what “text” is.) (I say “supposed to” because who knows what sort of hacks they’re running under the hood.)
Yes that is indeed the sort of question I was expecting. But anyway good thing the LLM didn’t have just one book, but oodles of books and expert opinion and past exam data at its disposal! Oh wait it didn’t help and the machine especially made to give correct answers failed to give correct answers :(
If what you really care about is stemming the ill-effects of large and growing student debt, debt cancellation is a terrible policy. If you want people to consume less of something, the last thing you should do is subsidize people who consume that thing.
Yes, I agree, once debt is cancelled we shouldn’t let people go into debt and attending university should be free.
I love the way these idiots keep incrementing the number on their ChatGPT fantasy as if it’s a sufficient image of the future and it’s going to get everyone on board. Complete failure of imagination, don’t try to picture any actual use for it or anything, just make it… more.
Seeing Cremieux Recueil will be there, does anyone know who’s behind it, what’s the deal with it, etc? I’m always seeing it pop up on these freaks’ timelines and I imagine it’s eugenics shit but I can never be bothered to dig enough to find the really incriminating stuff. It’s well creepy though.
From what I can tell, like everybody else involved, it’s ego and ennui? Sad but I suppose at least it’s mildly entertaining to read about gormless rich kids failing very hard to be cool.
I have to add also, as someone who had a terrible time being 18 in 2004, I am truly amazed that these people took the vapid and complacent culture of the noughties, the mcinnes-era vice magazines, the cobrasnakes, the cory kennedies, the whole tshirtness of it, and made it even worse somehow.
The main inovation is that the racism went from ironic to scientific!
This shit is intended to be ideologically confused. Its purpose is to seduce dissatisfied progressives towards fascism. See also, Grayzone, Caleb Maupin, the history of holocaust denial on the ultra left, there’s plenty of flavours.
“Antisemitism is the socialism of fools” etc. On this subject I’ve always been a fan of this Moishe Postone article: Anti-Semitism and National Socialism
The turn to biology and the desire for a return to “natural origins,” combined with an affirmation of technology, which appear in many forms in the early twentieth century, should be understood as expressions of the antinomic fetish that gives rise to the notion that the concrete is “natural,” and which increasingly presents the socially “natural” in such a way that it is perceived in biological terms. The hypostatization of the concrete and the identification of capital with the manifest abstract underlie a form of “anticapitalism” that seeks to overcome the existing social order from a standpoint which actually remains immanent to that order. Inasmuch as that standpoint is the concrete dimension, this ideology tends to point toward a more concrete and organized form of overt capitalist social synthesis. This form of “anticapitalism,” then, only appears to be looking backward with yearning. As an expression of the capital fetish its real thrust is forward. It emerges in the transition from liberal to bureaucratic capitalism and becomes virulent in a situation of structural crisis.
This form of “anticapitalism,” then, is based on a one-sided attack on the abstract. The abstract and concrete are not seen as constituting an antinomy where the real overcoming of the abstract—of the value dimension—involves the historical overcoming of the antinomy itself as well as each of its terms. Instead there is the one-sided attack on abstract reason, abstract law, or, at another level, money and finance capital. In this sense it is antinomically complementary to liberal thought, where the domination of the abstract remains unquestioned and the distinction between positive and critical reason is not made.
Remember how ChatGPT totally aced the bar exam? Wow! yeah, turns out that was just a lie (www.nytimes.com)
archive archive.ph/is57b
18+ here's a great and useful rundown of Scott Alexander Siskind's actual awful beliefs, from a centrist who found it difficult to accept until that email leaked (miniver.blogspot.com)
the return of our messiah Roaring Kitty (www.bloomberg.com)
archive archive.ph/g9Y6a
Stubsack: weekly thread for sneers not worth an entire post, week ending Sunday 19 May 2024
Have a sneer percolating in your system but not enough time/energy to make a whole post about it? Go forth and be mid!...
Sam Altman says instead of Universal Basic Income, there should be Universal Basic Compute, where everybody gets a slice of GPT-7's compute (nitter.poast.org)
Thank you sir, I didn’t know the way to fix ailing welfare states was to make ChatGPT available to all....
Stubsack: weekly thread for sneers not worth an entire post, week ending Sunday 12 May 2024
Have a sneer percolating in your system but not enough time/energy to make a whole post about it? Go forth and be mid!...
18+ Honor Levy is the latest from Dimes Square. Truly breathtaking text production.
holy shit, it’s Ready Player One for race scientists...