AI could probably fly under the radar if they just didn’t do stupid stuff like this, but they just have to push the boundaries. If they made any number of fake voices it’d be fine, but no, had to do a celebrity. I hope they lose. Stupid stupid stupid marketing department.
Actually, I think this is a legally very interesting area.
At the end of the day, AIs are just fancy imitations. Nobody would sue someone for imitating a voice, as long as it’s not impersonation (in the legal sense).
It’s a hard one. You train a general AI and ask for a story idea, that’s not a huge deal IMO. You ask it to write in the style of George RR Martin or something that’s something different. Yes you can do it by hand too, but these tools make it easier than ever.
Then sub questions… Is it okay to do it for free? What if you distribute it? What if you charge for it? All questions that these ai companies are just ignoring when they potentially have massive ramifications.
Making a random avatar is fine. Using ScarJo is iffy if you’re using it for free. What if you’re streaming on twitch with her? What if you’re charging to use her likeness on twitch where the users will make money? Idk the answers to any of those.
But why would anyone commit anything fraudulent by that? Where exactly does it become “too much” AI?
I did it very iffy to argue that writing in the style of someone else is illegal. That’s a perfectly normal thing to happen. Maybe AI makes it easier, but if an action is not illegal, why would doing the same thing tool assisted be illegal? Doesn’t make sense.
Well, there have been several music lawsuits about certain songs and their amount of identity to others. If you were to write something as closely to another author that you are imitating something like trademark mannerisms there may be a case for that.
I think you misunderstand something. The same thing many AI enthusiasts and critics often choose to not understand. Regenerative AIs aren‘t just born from plain code and they don’t just imitate. They use a ton of data as reference points. It’s literally in the name of the technology.
You could claim „well maybe they used different voices and mixed them together“ but that is highly unlikely, given how much of a wild west approach most regenerative AI services have. it‘s more likely they used protected property here in a way it was not intended to be used. In which case SJ does indeed have a legal case here.
They use a ton of data as reference points. It’s literally in the name of the technology.
Reference is the wrong word.
They learn the patterns that exist in data and are able to predict future patterns.
They don't actually reference the source material during generation (barring over itting which can happen and is roughly akin to a human memorizing something and reproducing it).
Weather or not the copyrighted data shows up in the final model is utterly irrelevant though. It is illegal to use copyrighted material period outside of fair use, and this is most certainly not. This is civil law, not criminal, the standard is more likely than not rather than beyond a reasonable doubt. If a company cannot provide reasonable evidence that they created the model entirely with material they own the rights to use for that purpose, than it is a violation of the law.
Math isn’t a person, doesn’t learn in anything approaching the same method beyond some unrelated terminology, and has none of the legal rights that we afford to people. If it did, than this would be by definition a kidnapping and child abuse case not a copyright case.
It is illegal to use copyrighted material period outside of fair use, and this is most certainly not.
Yeah it is. Even assuming fair use applied, fair use is largely a question of how much a work is transformed and (a billion images) -> AI model is just about the most transformative use case out there.
And this assumes this matters when they're literally not copying the original work (barring over fitting). It's a public internet download. The "copy" is made by Facebook or whoever you uploaded the image to.
The model doesn't contain the original artwork or parts of it. Stable diffusion literally has one byte per image of training data.
The number of bytes per image doesn’t necessarily mean there’s no copying of the original data. There are examples of some images being “compressed” (lossily) by Stable Diffusion; in that case the images were specifically sought out, but I think it does show that overfitting is an issue, even if the model is small enough to ensure it doesn’t overfit for every image.
I never understood why so many from the more techbro political alignment find this argument so convincing.
It doesn't really matter whether the original data is present in the model or if it was reduced to such an abstract form that we cannot find it anymore. The model only can exist because of the original data being used to make it, and it was used without proper license. It doesn't matter how effective nor how lossy your compression is, mere compression is not transformation and does not wash away copyright.
The argument that it is in some way transformative is more relevant. But it's also got a pretty heavy snort of "thinking like a cop" in it, fundamentally. Yes, the law protects transformative works, so if we only care what the written rules of the law says, then if we can demonstrate that what the AI does is transformative, the copyright issues go away. This isn't a slam dunk argument that there's nothing wrong with what an AI does even if we grant it is transformative. It may also simply be proving that the copyright law we have fails to protect artists in the new era of AI.
In a truly ideal world, we wouldn't have copyright. At all. All these things would be available and offered freely to everyone. All works would be public domain. And artists who contributed to the useful arts and sciences would be well-fed, happy, and thriving. But we don't live in that ideal world, so instead we have copyright law. The alternative is that artists cannot earn a living on their works.
It doesn't really matter whether the original data is present in the model
Yeah it does. One of the arguments people make is that AI models are just a form of compression, and as a result distributing the model is akin to distributing all the component parts. This fact invalidates that argument.
This isn't a slam dunk argument that there's nothing wrong with what an AI does even if we grant it is transformative. It may also simply be proving that the copyright law we have fails to protect artists in the new era of AI.
If we change the law to make it illegal it's illegal.
It’s illegal to reproduce copyrighted material*. That includes changing the format as well as things which fall under “derivative” works, but not creating a new work in the style of someone else’s (unless it falls under the derivative definition). Many voice impersonators exist and the way you impersonate a voice is to listen to (usually) recordings of that person and practice producing the same sounds that they use for common phonemes (as well as vocal tract shape and larynx positioning to alter the vocal pitch production and overtones which represent vowel shapes). ML does, effectively the same thing without requiring a human to do the listening and practicing.
That said, I think this type of use should be strictly prohibited. In fact, I think it should have severe criminal penalties for any specific voice, not just celebrities. Having the ability to simulate accurate, regional-sounded voices is extremely valuable in the general sense, but imitating or mimicking a specific person’s voice without their explicit consent and/or direction has very few, if any, legitimate uses.
I didn’t think that voice mimicking would count as valid for any law, but Google tells me of the “Right of Publicity” and there is (again according to Google) case law involving Ford and Bette Midler. So while it’s not a copyright violation to reproduce a voice, it may still run afoul of some laws.
Again: how is that different from an imitation? What exactly differentiates a human watching a movie to imitate a voice from a machine doing the same thing?
And that is, what you misunderstand. AI is not magic, it’s computation. Nothing more. In no other context would it even matter, whether the source data was intended for the use case, if no infringement is being committed by the end product.
The bad actors stealing data to train their apps don’t seem to have an adequate understanding of the implications of their actions. They’re just looking to make a quick buck and run.
I mean depends on where they are from. If they are from the US or Europe they would be fucking idiots but if they are Chinese, Russian, etc they are basically untouchable and it will merely be a game of whackamole.
Edit: welp did a Whois on their website and seems its from Arizona. So yeah nevermind my top comment, if this is truly a company stationed in Arizona they really fucked up.
I recently was watching some feelgood videos to up my mood (stuff like Thedodo) and one of the channels I landed on, the voice instantly sounded extremely familiar.
I thought "oh, did The Girl with the Dogs start another channel?" but then I listened more carefully and noticed the typical "generated" fragments in the audio.
They aren't just copying the voices of celebrities, but also of popular YouTubers.
Add comment