This Stack Overflow/OpenAI news is an absolute disaster and a dark day in the history of online communities.
It's hard to read this as anything other than Stack Overflow being desperate for cash. Reports are already surfacing about how badly they handled it, and I expect that will only worsen.
Stack Overflow, a popular forum for programmers and software developers, announced a partnership with OpenAI earlier this week, selling the site’s data, including users’ forum posts, to train ChatGPT.
Now unhappy users are finding themselves banned for editing their popular posts in protest, and even finding those posts changed back by admin – “a reminder that anything you post on any of these platforms can and will be used for profit,” concluded one. Futurism has more.
Das war eine sehr unterhaltsame Recherche, bei der ich Sepp Hochreiter getroffen habe - ein Pionier des maschinellen Lernens, der mit seiner alten Idee (#lstm) jetzt OpenAi „vom Markt fegen“ will.
Ob dieser alte Algorithmus wirklich das Zeug dazu hat, große Sprachmodelle zu revolutionieren, kann ich schwer einschätzen. Was mir aber immer klarer wurde in letzter Zeit: Transformermodelle sind an ihrer Grenze. Von daher wird sich was bewegen müssen.
"Microsoft and OpenAI are reportedly working on a massive datacenter to house an AI-focused supercomputer featuring millions of GPUs. The Information reports that the project could cost "in excess of $115 billion" and that the supercomputer, currently dubbed "Stargate" inside OpenAI, would be U.S.-based."
So much could be done with that amount of money... such a huge waste.
"OpenAI released draft guidelines for how it wants the AI technology inside ChatGPT to behave—and revealed that it’s exploring how to ‘responsibly’ generate explicit content.
Ein neues Tool von #OpenAI soll erkennen können, ob ein Bild echt ist oder mit dem Bildgenerator DALL-E erstellt wurde. Etwas ähnliches hat das gehypte Unternehmen bereits für seine KI-generierten Texte versprochen – und ist daran gescheitert.
Just came up with a new analogy I'm rather proud of: LLMs are digital compost heaps. They decompose whatever you hurl in and turn it into artificial excrement.
Also I'm moving from StackExchange to Codidact. If I'm going to do any more unpaid labour it's going to be for a not-for-profit, rather than a for-profit company. Feeding that work into a digital compost heap is the push I needed.
#AI#GenerativeAI#OpenAI#AIHype#Science: "I don't do predictions, but I do spend a good bit of time these days pondering how things might play out when the current AI hype bubble finally pops, or slowly deflates, or drifts away, or whatever it does. It seems clear by now that the engine keeping this hot air balloon (if I can abruptly switch to a nearby metaphor) inflated and afloat is the frothy interest of venture capitalists and the finance side of Big Tech. But that air has been blowing so hot and so long now that its miasma has long since infected just about every other sector. And I worry that when the VCs start focusing somewhere else, we'll still be stuck digging out from entrenched surveillance as well as business processes that have been contorted to jump on the ChatGPT bandwagon."