Google Researchers’ Attack Prompts ChatGPT to Reveal Its Training Data (www.404media.co)

ChatGPT is full of sensitive private information and spits out verbatim text from CNN, Goodreads, WordPress blogs, fandom wikis, Terms of Service agreements, Stack Overflow source code, Wikipedia pages, news blogs, random internet comments, and much more....

ct_bergstrom, to ChatGPT
@ct_bergstrom@fediscience.org avatar

It is absolutely astounding to me that we are still earnestly entertaining the possibility that #ChatGPT and #LLMS more broadly have a role in scientific writing, manuscript review, experimental design, etc.

The training data for the question below are massive. It's a very easy question if you're trained on the entire internet.

Question: What teams have never made it to the World Series?

Correct answer: Seattle Mariners.

Now, four responses from GPT4.

NB: The Nationals won it all in 2019.

Which teams have never played in the world series?As of my last update in January 2022, the following MLB teams had never appeared in the World Series: 1. Seattle Mariners: The Mariners have been in the league since 1977 and, despite having several competitive seasons and star players like Ken Griffey Jr. and Ichiro Suzuki, they have not made it to the World Series. 2. San Diego Padres: While the Padres have actually appeared in the World Series twice (in 1984 and 1998), they haven't won a championship. 3. Texas Rangers: The Rangers, who originated as the Washington Senators before moving to Texas in 1972, have been to the World Series twice (in 2010 and 2011) but have not won. 4. Milwaukee Brewers: The Brewers have made one World Series appearance in 1982 but did not win. 5. Tampa Bay Rays: The Rays, who began play in 1998, have appeared in the World Series twice (in 2008 and 2020) but haven't won the title. 6. Colorado Rockies: The Rockies, who began play in 1993, made it to the World Series in 2007 but were defeated by the Boston Red Sox. Now, it's important to note that the list of teams that have never won a World Series is longer and includes some teams like the Padres, Rangers, Brewers, Rays, and Rockies, as mentioned, among others. However, this information is as of January 2022. The list could change based on subsequent seasons. You might want to check more recent sources to see if any of these teams have made or won the World Series in the past two seasons.
Which teams have never played in the world series? As of my last training data in January 2022, the following MLB teams have never played in the World Series: 1. Seattle Mariners - Founded in 1977, they have yet to make an appearance in the World Series. 2. Colorado Rockies - Although they've been to the playoffs multiple times since their inception in 1993, the Rockies have made it to the World Series once in 2007 but were swept by the Boston Red Sox, so they have played in the World Series. It's worth checking the most recent MLB seasons (2022 and 2023) to see if either of these teams have since made it to the World Series.
Which teams have never played in the world series? As of September 2021, three Major League Baseball (MLB) teams have never played in the World Series: 1. Seattle Mariners: The team was established in 1977 and is based in Seattle, Washington. Despite having some successful seasons and making multiple playoff appearances, the Mariners have never advanced to the World Series. 2. Washington Nationals: While the Nationals franchise itself has played in and won the World Series (in 2019), the team was formerly known as the Montreal Expos and was based in Montreal, Quebec, Canada. The Expos, established in 1969, never played in the World Series before relocating to Washington, D.C., and becoming the Nationals in 2005. 3. Colorado Rockies: Established in 1993 and based in Denver, Colorado, the Rockies have made several playoff appearances and reached the World Series once, in 2007, but did not win. It’s worth noting that teams' fortunes can change rapidly in sports, and new teams may have joined the league or existing teams may have reached the World Series since my last training data in September 2021. Was this response better or worse? d9 Better CP Worse = Same X

governa, to ChatGPT
@governa@fosstodon.org avatar
grammargirl, to ai
@grammargirl@zirk.us avatar

I've been thinking about the new Associated Press guidelines to avoid referring to in ways that could imply humanness, sentience, or intent:

Don't say, "It WANTS you to enter more information," for example.

I've often used that kind of wording for computers in the past.

But more precise wording matters now because it's the first time we've widely had systems that could be mistaken for being human or having sentience, and it's important not to reinforce that idea.

albertcardona, to science
@albertcardona@mathstodon.xyz avatar

Not sure what those who advocate for the use of ChatGPT in scientific writing have in mind. It is the very act of writing that helps us think about the connections and implications of our results, identify gaps, and devise further experiments and controls.

Any science project that can be written up by a bot from tables of results and associated literature isn’t the kind of science that I’d want to do to begin with.

Can’t imagine completing a manuscript not knowing what comes next, because the writing was done automatically instead of me putting extensive thought into it.

And why would anyone bother to read it if the authors couldn’t be bothered to write it. Might as well put up the tables and figures into an archive online, stamp a DOI on it, and move on.

65dBnoise, (edited ) to random
@65dBnoise@mastodon.social avatar

Today's dose of hallucination is brought to you by :

? 🤨, ? 🙄

EDIT: the word "hallucination" is probably out of place and misleading here, as @apodoxus argues in this thread. The anthropomorphic connotations of the word may actually create more misconceptions than help eliminate.

aral, to ai
@aral@mastodon.ar.al avatar

“How ChatGPT might be able to help the world’s poorest and the organisations that work with them”

– United Nations University

https://www.inkl.com/a/kxjXGaijBoj

I see the United Nations continues to be the favoured PR agency for Silicon Valley.

zersiax, to random
@zersiax@cupoftea.social avatar

Maybe this is an unpopular take, but why are people getting so hung up on if it's still getting so many things wrong in an at times hard to verify way?
Maybe my queries have just been too specific but I have never actually seen the thing say something halfway useful yet. It all sounds authoritative enough, but doesn't hold up to the smallest amount of scrutiny. Am I just asking it the wrong things? Does it get better with GPT4? I just don't see it yet. So far, what I see is another Facebook that tricks people into thinking they're smart by parrotting something the internet said without fact-checking, just on demand now rather than on the schedule of others. Is it actually useful to folks yet as a way to learn new facts/information or does it just summarize and generate clickbaity blog posts so far?

beandev, to ChatGPT German
@beandev@social.tchncs.de avatar

Also halluziniert auch nur noch wild herum, wenn es zu den Problemen auch im Netz keine (oder falsche) Lösungen gibt oder der Kontext von den Lösungen nur scheinbar passen.

Allerdings ist es in einigen Fällen (meiner Tests - und das kann für jeden anders sein) durchaus schneller, als zig Suchmaschinenrecherchen.

Vielleicht ist es aber in der Softwareentwicklung besonders leicht, damit zufriedengestellt zu werden. Man hat idR ein gutes Wissen in ein paar Programmiersprachen.

1/2

matthewskelton, to ChatGPT
@matthewskelton@mastodon.social avatar

LLMs and GPT-based AI systems should pay IP fees to all creators and authors whose work provides the AI ability.

What's that you say? They wouldn't be financially viable? Then these AI systems are basically stealing. 💰

aral, (edited ) to ai
@aral@mastodon.ar.al avatar

Hi there, if you don’t want me to hit you, please carry this sign that says “please don’t hit me” with you always. Otherwise, I can’t possibly be held responsible if I hit you. Because it’s in my nature to hit you. I can’t live without hitting people. It’s just who I am and what I do. Thank you for your understanding in this delicate matter.

Sincerely,
OpenAI

adamjcook, to ChatGPT

Another day, another dangerous video.

You know, I have been following Tesla's FSD Beta program for a very long time.

Back around 2015 or so, the mantra was that the FSD Beta was on the cusp of an "AlphaGo" moment.

But, is old news now.

is white hot.

Let's explore why a system capable of partial driving automation (like FSD Beta) and automated driving systems more broadly are decidedly not at all like ChatGPT.

https://youtu.be/4zcqVc37Jcw

ct_bergstrom, (edited ) to ChatGPT
@ct_bergstrom@fediscience.org avatar

People keep telling me that is amazing for proofreading text and improving scientific writing.

I just gave a section of a grant proposal and it made 11 suggestions, none of which were worth keeping (often adding or removing a comma, or repeating a preposition in a list).

More interestedly, a number of its suggestions were identical to my originals.

joelanman, to ai
@joelanman@hachyderm.io avatar

Just realised chatGPT is violating the gov.uk content licence:

You must (where you do any of the above):
acknowledge the source of the Information in your product or application by including or linking to any attribution statement specified by the Information Provider(s) and, where possible, provide a link to this licence;

rcpierce, to Law
@rcpierce@mastodon.online avatar

This trend isn’t going away is it?

“Two More Cases, Just this Week, of Hallucinated Citations in Court Filings Leading to Sanctions”

https://www.lawnext.com/2024/02/not-again-two-more-cases-just-this-week-of-hallucinated-citations-in-court-filings-leading-to-sanctions.html

@law

kentbrew, to ai
@kentbrew@xoxo.zone avatar

So I've landed in Nextdoor's "Assistant" experiment, which will offer to completely rewrite your post. It is just amazingly creepy having this thing come up without warning.

https://help.nextdoor.com/s/article/Introducing-Assistant

nixCraft, to ChatGPT
@nixCraft@mastodon.social avatar

OpenAI’s Altman and other AI giants back warning of advanced AI as ‘extinction’ risk. If Sam truly believes in the risks posed by AI, he should consider shutting down OpenAI. Power down the data center, delete software & models associated with it. I don't get his motivation here. What do you want, man? First,you say OpenAI is the best. Then, the next day you say it will pose a significant risk to the human race. So, shut down the OpenAI & move on with your life. Stop making up bullshit

augieray, to ChatGPT
@augieray@mastodon.social avatar

This is the funniest thing I've seen in a while. Someone asks to rewrite a simple statement (sitting outdoors enjoying a bagel) in a way that cannot possibly cause any offense to anyone.

codewiz, to OpenAI
@codewiz@mstdn.io avatar

Testing GPT4 as a prompt generator for DALL-E 3. I asked to make four images at once, and it generated slight variations of the original prompt!

pallenberg, to ChatGPT
@pallenberg@mastodon.social avatar

So!
Ich habe nun ein 1-jaehriges Projekt gestartet um die These aus meinem 1. Artikel vom Dezember 👉 https://www.metacheles.de/p/ist-die-chatgpt-ai-der-ultimative#details zu bestaetigen:

"GPTs werden zu den No. 1 Google Content-Spammern"

Keine Angst, ich spamme niemanden zu, produziere aber ein tgl. Format, dessen Inhalte komplett durch ChatGPT erstellt werden & mit nem Bulk-Prozess umgesetzt werden.

Zeitlicher Aufwand? Ca. 1h um Content fuer 20 Tage zu produzieren.

Am 17. Mai 2024 sehen wir, ob das klappt oder nicht!

lauren, (edited ) to random
@lauren@mastodon.laurenweinstein.org avatar

***** An AI question that runs a cold chill down your spine *****

Email from a very intelligent friend I received today:

"Can I just replace with for my work?"

That this question is even asked shows the vast dangers of the premature deployment of these generative AI technologies, and the utter lack of meaningful education of the public about their risks. Disclaimers on the user interfaces are routinely ignored. This is all a disaster waiting to happen.

  • All
  • Subscribed
  • Moderated
  • Favorites
  • normalnudes
  • hgfsjryuu7
  • magazineikmin
  • thenastyranch
  • Youngstown
  • slotface
  • everett
  • ngwrru68w68
  • mdbf
  • kavyap
  • tsrsr
  • Durango
  • PowerRangers
  • DreamBathrooms
  • Leos
  • InstantRegret
  • khanakhh
  • osvaldo12
  • vwfavf
  • tacticalgear
  • rosin
  • cubers
  • cisconetworking
  • GTA5RPClips
  • ethstaker
  • tester
  • modclub
  • anitta
  • All magazines