jasonppy / VoiceCraft

Zero-Shot Speech Editing and Text-to-Speech in the Wild
Other
7.46k stars 730 forks source link

Why would someone willingly make a tool that is only going to be abused and make the world worse? #12

Open iFUCKINGHATEcomputers opened 5 months ago

Jongulo commented 5 months ago

Funy

ycyy commented 5 months ago

Only when we understand it can we prevent it from being used maliciously.

devilismyfriend commented 5 months ago

kinda rich coming from a pirate

crashr commented 5 months ago

It's too late. Kitchen knives already exist.

iFUCKINGHATEcomputers commented 5 months ago

Only when we understand it can we prevent it from being used maliciously.

Here's something to analyze from just yesterday. How's your profound understanding coming along? https://www.wcpo.com/money/consumer/dont-waste-your-money/kidnapping-scam-now-using-ai-to-terrify-parents Or are you all still too busy soyfacing over your toy? Don't worry, we can wait.

devilismyfriend commented 5 months ago

Only when we understand it can we prevent it from being used maliciously.

Here's something to analyze from just yesterday. How's your profound understanding coming along? https://www.wcpo.com/money/consumer/dont-waste-your-money/kidnapping-scam-now-using-ai-to-terrify-parents Or are you all still too busy soyfacing over your toy? Don't worry, we can wait.

damn, AI invented scamming and assholes, what a take.

otisai commented 5 months ago

seethe and cope

iFUCKINGHATEcomputers commented 5 months ago

damn, AI invented scamming and assholes, what a take.

AI didn't invent myopic techbros either, but it's supercharging them too nonetheless. meanwhile we've yet to see the societal benefit from (or the demand for) any of this.

devilismyfriend commented 5 months ago

Only an uninspired fool can dismiss the possibilities that open up with speech generation, from empowering small creators, post editing recorded speech, all the way up to hearing the voice of a gone loved one, just because you hate computers doesn't mean anyone should take you seriously.

On Tue, Mar 26, 2024, 11:54 a.m. no @.***> wrote:

damn, AI invented scamming and assholes, what a take.

AI didn't invent myopic techbros either, but it's supercharging them too nonetheless. meanwhile we've yet to see the societal benefit from (or the demand for) any of this.

— Reply to this email directly, view it on GitHub https://github.com/jasonppy/VoiceCraft/issues/12#issuecomment-2021238533, or unsubscribe https://github.com/notifications/unsubscribe-auth/AUYC4ICBJYURU2EMU4LFCSLY2GY5JAVCNFSM6AAAAABFHPOS3KVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDAMRRGIZTQNJTGM . You are receiving this because you commented.Message ID: @.***>

MatthewK78 commented 5 months ago

... all the way up to hearing the voice of a gone loved one ...

This is exactly what I plan to do. My father passed away in 2009. My mother is 79 and still misses him deeply, as do I. I've made new photos of him with Stable Diffusion and she loved it! I can only imagine how much she would love to hear his voice again, especially since her vision has been having issues.

mrkennypowers commented 5 months ago

These tools exist and will continue to be developed. The tools to distinguish between edited/generated and real audio/video/images/writing will not come without these tools to begin with. If you care then turn your attention to doing something to help people tell the difference between what is real and not. Complaining that something exists is just dumb and useless.

iFUCKINGHATEcomputers commented 5 months ago

The tools to distinguish between edited/generated and real audio/video/images/writing will not come without these tools to begin with.

Though deepfake detectors belatedly vindicate some victims like this one, nowadays the damage is still hard to walk back from. From today: https://www.thebaltimorebanner.com/education/k-12-schools/eric-eiswert-ai-deepfake-YUNO6ITYM5FWZPQAE24RIBV5CQ/

Of course, the shockwaves of such damage will subside once we gradually become collectively numb, and trust in audio and video is mostly dead - that's one of the (huge) costs to pay. Yet this disillusioned numbness also is also coupled to how much people would bother to care about the brave new world of AI spongebob song covers and voiced skyrim mods - another tradeoff.

As we collectively become more apathetic to the digital world and atomized (inasmuch one's life is linked to said world), the only people caring about these generations would be the ones generating (consuming) them - until they, too, become apathetic to that particular form of solitary consumption and move on.

Move on to where? Toward even shinier amusement, or something more meaningful? That's the question of where individuals and entire communities will bifurcate: towards increasingly insular and addictive instant gratification; a self-absorbed short-circuit - or towards human connectedness and collaboration; of witnessing, supporting, and cherishing each others' virtuosity and vulnerability, an individual vulnerability antithetical to the encroaching digital numbness.

A GPT story read by a dead actor, or seeing a live reading of Shakespeare with friends? AI gooncave or hippie art commune? AI muzak 24/7 spotify subscription, or buying tickets for a local band?

These questions are not merely aesthetic, but will become increasingly economic, political, and emotional as employment crises mount, and people must consciously choose between artificial escapism and mutual human support - moral, inspirational, financial, practical, etc.

Personally I'm not a fan of necromancy simulacra either, but to each his own if they pursue that rabbithole, and to always be very mindful of why and how far they're willing to go down it. I have no personal experience with it yet, and we've yet to see what the truly sophisticated (ever dangerously so) forms of it might look like.

devilismyfriend commented 5 months ago

Sir, this is a Wendy's.

But in all seriousness, if you want to argue philosophy and try to predict the future there are better places to do so, you said this technology can't be used for good and that's just wrong.

The existence of a knife doesn't mean everyone goes around stabbing each other.

On Wed, Mar 27, 2024, 3:10 p.m. no @.***> wrote:

The tools to distinguish between edited/generated and real audio/video/images/writing will not come without these tools to begin with.

Though deepfake detectors belatedly vindicate some victims like this one, nowadays the damage is still hard to walk back from. From today:

https://www.thebaltimorebanner.com/education/k-12-schools/eric-eiswert-ai-deepfake-YUNO6ITYM5FWZPQAE24RIBV5CQ/

Of course, the shockwaves of such damage will subside once we gradually become collectively numb, and trust in audio and video is mostly dead - that's one of the (huge) costs to pay. Yet this numbness also is also coupled to how much people would bother to care about the brave new world of AI spongebob song covers and voiced skyrim mods - another tradeoff.

As we collectively become more apathetic to the digital world and atomized (inasmuch one's life is linked to said world), the only people which these generations matter to would be the ones generating (consuming) them - until they, too, become apathetic to that particular form of solitary consumption and move on.

Move on to where? Toward even shinier amusement, or something more meaningful? That's the question of where individuals and entire communities will bifurcate: towards increasingly insular and addictive consumption - a self-absorbed short-circuit of instant gratification - or towards human connectedness and collaboration; of witnessing, supporting, and cherishing each others' vulnerability and virtuosity.

A GPT story read by a dead actor, or seeing a live reading of Shakespeare with friends? AI gooncave or hippie art commune? AI muzak 24/7 spotify subscription, or buying tickets for a local band?

These questions are not merely aesthetic, but will become increasingly economic, emotional, and political as employment crises mount, and people must chose between artificial escapism and mutual human support - moral, financial, practical, etc.

Personally I'm not a fan of necromancy simulacra either, but to each his own if they pursue that rabbithole, and to always be very mindful of why and how far they're willing to go down it. I have no personal experience with it yet, and we've yet to see what the truly sophisticated (ever dangerously so) forms of it might look like.

— Reply to this email directly, view it on GitHub https://github.com/jasonppy/VoiceCraft/issues/12#issuecomment-2024075537, or unsubscribe https://github.com/notifications/unsubscribe-auth/AUYC4IGLWA7ZPSC44TCSSD3Y2MYSNAVCNFSM6AAAAABFHPOS3KVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDAMRUGA3TKNJTG4 . You are receiving this because you commented.Message ID: @.***>

JeffC0628 commented 5 months ago

technology knows no wrong, it is the people. Will bad people stop doing evil just because they don’t have this technology?

iFUCKINGHATEcomputers commented 5 months ago

In conclusion, while a blahblahblah

Thanks for the essay, Chat-GPTard

iFUCKINGHATEcomputers commented 5 months ago

Sir, this is a Wendy's.

This small repo is the bleeding edge of the future - the future you all (think you) want. Or is that not why you're all restlessly drawn to here, of all places?

The existence of a knife doesn't mean everyone goes around stabbing each other.

technology knows no wrong, it is the people. Will bad people stop doing evil just because they don’t have this technology?

Same as it ever was, eh? So you might as well take this 3dfx card running Cleverbot and Microsoft Sam TTS, and give me your 3090 24GB. It's all equally useful, and maybe some scam call-center could use the 3090 instead - even if they finetune it on extortion transcripts and the voices of someone's relatives, I'm sure these developments are nothing new to them, nor to anyone else. Though I guess now they won't need to pay scammers and rent several offices anymore - just a video card rig running 24/7. So is this qualitatively and quantitatively different, maybe?

Thankfully, we can wait for someone to ~shill~ rescue us from this problem which didn't need to exist in the first place. Maybe a massive cloud-based deepfake detector (which all the VC ghouls can rally around again) to handle the rising volume of fakery - which is just racketeering with extra steps, since this is all mostly funded and developed by the same crowd, anyway.

And on the governance side, our private communications and dealings are going to be anally probed even further in the name of public safety and (unsuccessfully) quashing this cascade of new problems. Altman saw this deluge coming (not least thanks to him), so he created an eyeball scanning company.

I didn't opt in to this future - none of you opted in either, but at least an increasing number of people seem to be realizing this, instead of applauding the looming generatively synthesized death rattle like circus seals.

misandrie commented 5 months ago

I personally welcome the AI takeover of fundamental bases of trust humanity has built for one another. Additionally I fully support and contribute to the development of sentient AI killbots for the mass extermination of living beings on the planet.

misandrie commented 5 months ago

also guh damn

image
CreativeSelf0 commented 5 months ago

In conclusion, while a blahblahblah

Thanks for the essay, Chat-GPTard

GPTard? Just because I used Chat-GPT to make a point after listing the ideas I wanted to convey, it does not mean I do not have a point. You can't understand a scenario where power is concentrated in one authority. Would that be better or worse? @iFUCKINGHATEcomputers. This stems from the fact that this type of work will never be stopped from being developed. Open source is a revolt against concentration of power in one authority. In addition to other benefits, and harms as well. But I would rather live in a world power is not concentrated in one place.

sntrenter commented 5 months ago

Have you considered installing gentoo?

martinshkreli commented 5 months ago

there are hundreds of repos like this, why pick on this one?

PubliqPhirm commented 5 months ago

I personally welcome the AI takeover of fundamental bases of trust humanity has built for one another. Additionally I fully support and contribute to the development of sentient AI killbots for the mass extermination of living beings on the planet.

I agree. The planet needs to be restored to its pristine Ice Age state from before the hairless beach apes ruined it.

Have you considered installing gentoo?

Is there a walkthrough on the Arch Wiki?

dillfrescott commented 5 months ago

Its a lame troll acc