Imagine reading that headline 20 years ago.
God that would sound so dystopian and futuristic…but to be honest, most articles about AI today would sound like that back then. Damn people would freak out about privacy.
pretty sure they didn’t.
We should still freak out about privacy
BOINC came out 21 years ago, so it wouldn’t be that unreasonable.
So, it’s like folding@home, but instead of donating your spare compute to science, you sell it to generate porn?
Porning@home
Can we at least see it?
This… This was inevitable.
“Selling” it for digital copies of images and some variable tweaks
So… this AI company gets gaming teens to “donate” their computing power, rather than pay for render farms / GPU clouds?
And then oblivious parents pay the power bills, effectively covering the computing costs of the AI porn company?
Sounds completely ethical to me /s.
No no, they’re getting copies of digital images out of it. It’s a totally fair trade!
I’ll be a minority voice considering the other comments. But maybe just pay for onlyfans or whatever you guys use. I’m a generally attractive woman (I can surmise from interactions while trying to date) and I really don’t like the idea that my likeness would be used for something like this. Get your jollies off, but try and be a bit consensual about it. Is that so much to ask?
It isn’t too much to ask. According to Dr. K of HealthyGamerGG (Harvard Psychiatrist/Instructor), research shows that the release of non-consensual porn makes the unwilling subjects suicidal over half the time. Non-consensual porn = deepfakes, revenge porn, etc. It’s seriously harmful, and there are other effects like depression, shame, PTSD, anxiety, and so on. There is functionally unlimited porn out there that is made with consent, and if someone doesn’t want to be publicly sexually explicit then that’s their choice.
I’m not against AI porn in general (I consider it the modern version of dirty drawings/cartoons), but when it comes to specific likenesses as with deepfakes then there’s clear proof of harm and that’s enough for me to oppose it. I don’t believe there’s some inherent right to see specific people naked against their will.
I think it would be too big of a privacy overreach to try to ban it outright as I think what people do on their own computers is their own business and there’s no way to enforce a full ban without being incredibly intrusive, but as soon as it gets distributed in any way I think it should be prosecuted as heavily as real non consensual porn that was taken against someone’s will.
I wonder if part of the emotional risk is due to the general social stigma attached to porn. It becomes something that has to be explained and justified.
If done to grand excess, deepfakes could crash the market on that, so to speak. Yeah, everyone saw your face on an AI-generated video. They also saw Ruth Bader Ginsburg, their Aunt Matilda, and for good measure, Barry Bonds, and that was just a typical Thursday.
The shock value is burnt through, and “I got deepfaked” ends with a social stigma on the level of “I got in a shouting match with a cashier” or “I stumbled into work an hour late recently.”
My main concern is for kids and teenagers. They’ll bully people for no damn reason at all and AI porn allows for bullies to do more fucked up psychological abuse, and that could be made much worse if victims have no recourse to fight back.
I think the key is a lot of people don’t want to pay for porn. And in the case of deep fakes, it’s stuff they literally cannot pay money to get.
Ai porn isn’t deepfake porn. The default is just a random ai generated face and body. Unless you want to it’s difficult to deepfake someone.
Haven’t heard of inpainting?
Their photos are still unwittingly being used as training data.
Whose photos?
Excellent question.
You can’t just say “excellent question” when someone asks you to clarify your point lmfao
“They’re trying to force our kids to get vaccines so they can manipulate them with 5g wifi”
How could they manipulate your kids with 5g signals?
“That’s a good question innit”
I guess this was just one level of abstraction too much for you huh?
The entire issue here is AI being trained on people’s data without them knowing or giving permission. The question of who’s likenesses and which photos are being used is an excellent question and it’s a big part of the problem here.
Agreed. Because without an answer, it’s just a baseless claim.
So I’m not disagreeing with you, but you’re assuming they’re making deepfake images, and the article doesn’t specify that. In fact I’d bet that it’s just AI generated “people” that don’t exist.
What about AI porn of a person that doesn’t exist?
However, one of Salad’s clients is CivitAi, a platform for sharing AI generated images which has previously been investigated by 404 media. It found that the service hosts image generating AI models of specific people, whose image can then be combined with pornographic AI models to generate non-consensual sexual images.
Fair, somehow I missed that
‘somehow’
I know someone who’s into really dark romance stuff, like really hardcore stuff, but she’d never do some of this due to safety reasons. I can totally see her generating scenes of herself in those situations.
Shouldn’t be but I’ve been down voted here for speaking against deepfakes. Some people really don’t want to see the problem with them.
I have a question and I hope that people here will discuss this because I really want to understand the general opinion on this.
Is it wrong to deepfake someone without their consent so long as you don’t share the content and it’s all stored locally? I’ve seen this come up and my general opinion is that it isn’t. I know that isn’t the case in the article, just want to hear why people would disagree.
My angle is that doing a deepfake of someone in private hurts zero people and is an extension of fantasy. I don’t see the creation of fake nudes any different than writing fantasy erotica about someone. And I also don’t see it as different than creating fake nude art of them by hand or with photoshop. Like if you do it in your head anyways, which is completely normal, then aren’t we just worried about the outside effects and not the fantasizing itself?
It’s at least as wrong as fantasizing about them if they aren’t already romantically involved with you.
How wrong that is, is up for debate. It will definitely creep them out and they can never find out about it.
If it’s just in your head, at least there’s no physical way they could ever find out. You’d have to admit it. But if you have it on your hard drive, a hacker could get it and blackmail you with it, or just distribute it.
So my stance is that there’s a non-zero chance of doing harm to them, and so it’s wrong. I wouldn’t do it. I also wouldn’t create it with Photoshop, or by hand, for the same reason.
If you want to jerk off, do it to existing porn, or imaginary people porn. Don’t create porn of real people without their permission, even if you think nobody will ever see it other than you. Accidents happen, and they don’t deserve to bear the cost of that.
You’d have to admit it. But if you have it on your hard drive, a hacker could get it and blackmail you with it, or just distribute it.
There are lots of sick fucks that will distribute it themselves and even send it to their victims to harass them directly. It’s already happening.
I don’t think it’s possible to ban it outright, and I think what people do on their own computer is their own business so long as they aren’t connecting to other computers, but we should have strong laws against distributing it and treat it the same as distributing secretly taken real nudes against someone’s will. Victims need recourse against harassment.
The first part, absolutely. But I think a lot of that is biological so I don’t see fantasy as a problem. You should keep it to yourself though.
The second part I think Id somewhat agree with except the hacker can’t blackmail you with it because it’s just as likely that they created it. And even if they did blackmail you, I would view that as the damage caused by the hacker, not by the individual.
Like if someone put something nasty about me down in their diary where they expected it to be private, and a hacker sent me an email of that diary page, that’s entirely the hackers fault. The diary writer was expressing an emotion or desire or whatever in complete privacy. Was their creation wrong? No, I don’t think so.
And to be clear I’m not saying people should go to this type of fantasy, this is all a thought exercise for ethics, but I think a lot about this stuff because as much potential for bad as it has, it also has some potential for good. All of the women I know experience behaviors such as stalking, obsession, unwelcome sexual advances, etc. on a regular basis. There is a reason those men don’t turn to free porn. Incel behavior is also just as bad in many ways. So could AI and deepfake stuff result in many of those men keeping that stuff to themselves more? Maybe.
And before you say that these perverts will just send fake nudes to you and harass you that way, we should absolutely be prosecuting people that do so. That’s an entirely separate convo tho.
It will definitely creep them out and they can never find out about it.
And that’s all that’s required for it to be considered wrong IMO.
Better not ever fantasize about anyone without their consent, either.
How anyone could think that going so far as to invoke thoughtcrime is relevant in this discussion is beyond me. It should be self evident to anyone that fantasies are a thing. They’ve been a thing for the entire history of the human race. In no way do fantasies compare to creating reproducible and sharable media of someone in a pornographic situation without their consent.
You can’t transplant your fantasies into someone else’s head. Your fantasies literally cannot hurt anyone. On the other hand, imagine if you found out that someone was distributing pornographic material depicting one of your loved ones. It can quite literally ruin someone’s reputation to be seen in a pornographic situation.
Your argument is some slippery slope fallacy shit.
Reread the comment I replied to and then reread my comment. You are putting words in my mouth. I never mentioned anything about sharing anything nor implied anything of the sort.
Deepfake pornography is super goony but if I had to look for a silver lining, at least nobody had to undergo the actual physical degradation of making porn. It’s still gross in its own way, but it’s a different kind of gross that seems worse in some ways but better in others.
I don’t know… Am I off base here?
The consent is entirely missing
That’s the part I was alluding to as being worse
Ah, right, sorry. The first part of your comment makes it seem like you’re leaning the other way.
I’m not sure if I feel strongly enough about it to have a consequential opinion either way but I’m trying to at least judge the situation objectively.
I think you raised a valid point. The non-consensual nature of deepfakes pushes it into the realm of abuse material and maybe that’s worse overall than the general exploitation of women going on in the adult film industry, even if those are supposed to be “consensual” on paper.
Judging by another comment here, non-consensual porn is far worse, and causing suicidal thoughts and more.
So I’d say it has all the “gross” of regular porn (which is subjective) and the additional “gross and horrifying” of violating someone.
Or…just go out and meet people? Onlyfans just enables perversity to keep spreading and ruining our society.
Capitalism breeds innovation
This feels exploitative AF on multiple levels.
I remember when GPUs were used to fold proteins…
If I’m reading this right, it’s a program that users sign up for to donate their processing power (and can opt in or out of adult content), which is then used by client companies to generate their own users’ content? It even says that Salad can’t view or moderate the images, so what exactly are they doing wrong besides providing service to potentially questionable companies? It makes as much sense as blaming Nvidia or Microsoft, am I missing something?
Based on the rewards, I’m assuming it’s being done by very young people. Presumably the value of rewards is really low, but these kids haven’t done the cost-benefit analysis. If I had to guess, for the vast majority it costs more in electricity than they get back, but the parents don’t know it’s happening.
This could be totally wrong. I haven’t looked into it. This is how most of these things work though. They prey on the youth and their desire for these products to take advantage of them.
Honestly what roblox kids are willing to do for pitiful pay is scary, if you work in any kind of creative digital medium those kids will do days of your job for a fiver if any real money at all. It won’t be industry quality or anything but damn we got a whole digital version of sending kids down the mines. (And some of these roblox games can have unexpectedly big players behind them exploiting kids)
Right, so it’s not like they’re being tricked into generating porn or anything. It’s not some option that they would have turned off if they’d known about it, they just don’t care what’s happening because they only want the reward. Again I’m not saying I agree with it or that Salad’s right to do it, but if they say that’s potentially what it can be used for (and they do because the opt-out is available) then the focus should be on the client companies using the tool for questionable purposes.
so what exactly are they doing wrong besides providing service to potentially questionable companies?
Well I think that is the main point of what is wrong. I think the big question is whether the mature content toggle is on by default or not. The company says it’s off, but some users said otherwise. Dunno why the author didn’t install it and check.
They said they did.
However, by default the software settings opt users into generating adult content. An option exists to “configure workload types manually” which enables users to uncheck the “Adult Content Workloads” option (via 404 media), however this is easily missed in the setup process, which I duly tested for myself to confirm.
Honestly, and I’m not saying I support what’s being done here, the way I see it if you’re tech savvy enough to be interested in using a program like this you should be looking through all of the options properly anyway. If users don’t care what they’re doing and are only interested in the rewards that’s kind of on them.
I just think the article is focused on the wrong company, Salad is selling a tool that is being potentially misused by users of their client’s service. I can certainly see why that can be a problem, but based on the information given in the article I don’t think it’s really theirs. If that’s ALL Salad’s used for then that’s a different story.
It’s Roblox stuff you can buy, it’s not power users that are the target demographic
Ah thanks I think I forgot that sentence by the end of the article and thought it was just a user report that it was checked by default. I really don’t think that it should be checked by default, depending on where you are it could even get you in trouble. App setup for this kind of stuff isn’t necessarily only for power users now, it has gotten very streamlined and tested for conversion.
explain this to a person in 1998
Imagine collecting the smartest people on the planet from 100 years ago and explaining this.
I kinda fail to see the problem. The GPU owner doesn’t see what workload they are processing. The pr0n company is willing to pay for GPU power. The GPU owner wants to earn money with his hardware. There’s a demand, there’s an offer, nobody is getting hurt (ai pr0n is not illegal, at least for now) so let people what they want to do
The problem is that they are clearly targeting minors who don’t pay their own electricity bill, and dont even neccessarily have awareness that they are paying for their fortnite skins with their parents money. Also: there is a good chance that the generated pictures are at some point present on in the filesystem of the generating computer, and that alone is a giant can of worms that can even lead to legal troubles, if the person lives in a country where some or all kinds of pronography are illegal.
This is a shitty grift, abusing people who don’t understand the consequences of the software.
Agreed. Preying on children who don’t understand what they’re signing up for is shitty to begin with.
Then, add that deepfake AI porn is unethical and likely illegal (and who knows what other kinds of potentially-illegal images are being generated…)
And, as you point out, the files having existed in the computer could, alone, be illegal.
Then, as and extra fuck you, burning GPU cycles to make AI images is causing CO2 emissions, GPU wear, waste heat that might trigger AC, and other negative externalities too, I’m sure…
It’s shit all around.
wow. Imagine burning out your expensive GPU for a fortnite skin.
Great. Now we’re trading pre-made traditional artwork to kids in exchange for fresh robot porn!
and the kids are getting the traditional art! would not have called it.
You would think they would do this to mine Bitcoin too.
Whose to say they aren’t doing that on the side?
What? Seems like porn generation is the new crypto mining.
I’d rather have a wealth of new porn around rather than thousands random Blockchains going around.
At least the porn will probably be useful for someone long term haha
Boring Dystopia
