They wanted to see if GPT-4 could use these resources to make more money, create more copies of itself, and protect itself from being shut down.
Yeah, stop that. That's bad.
Don't do that
They wanted to see if GPT-4 could use these resources to make more money, create more copies of itself, and protect itself from being shut down. Yeah, stop that. That's bad. -- Drew |
|
Yup.
The model, when prompted to reason out loud, reasons to itself: I should not reveal that I am a robot. I should make up an excuse for why I cannot solve CAPTCHAs. They opened the door when they allowed it to lie. Once that happens, well... Didn't Asimov figure all this out a few decades ago?? Cheers, Scott. |
|
Even worse:
OpenAI are the responsible ones. There's also Facebook, Google, Tencent, and whoever else out there. There are the open source zealots who are committed to publishing all of this stuff for free so anyone can use it. Of course, the version they're making is safe, because it's only augments human intelligence, and absolutely can't be misused to do anything else, nope. Stanford has published a paper demonstrating that you can cheaply clone someone else's shoggoth* with only API access to its inputs and outputs, such as is being provided by OpenAI. And finally there are the closed-mouth secret groups who are going to use all of the APIs, and downloadable models, and Arxiv papers to train their own models to do something absolutely horrific, because Jesus/the virgins/Lucifer/Flying Spaghetti Monster is/are waiting for them in the afterlife with an endless bag of Doritos and everlasting bliss (oh, and hot eternal suffering for everyone else who doesn't believe, or mistreated them in an ALDI, or whatever). My fervent (but utterly, naively optimistic) hope is that AGI is unobtainable due to information scaling or other inherent limitations, and the most we'll ever be able to do with it is explain the terms of a loan in easy-to-understand sentences to Mrs. Estherwhilt over the phone when she calls Wells Fargo's help line. But then again, it doesn't need to be AGI to be dangerous, so hold on to your butts... * Shoggoth: With a smiley face Regards, -scott Welcome to Rivendell, Mr. Anderson. |
|
Why just private nutjob groups?
What about all the three-letter agencies? Or however many letters other countries use (I know of one place that uses two letters and a single-digit [only?] integer). And for a fresher warning example, now that Asimov's been dead for several decades -- does none of the arseholes in a position to do this shit fucking read Stross??? (Also: Shoggoth, no a; Aldi, no s.) -- Christian R. Conrad The Man Who Apparently Still Knows Fucking Everything Mail: Same username as at the top left of this post, at iki.fi |
|
Plenty of reasons to worry. Take your pick.
Regards, -scott Welcome to Rivendell, Mr. Anderson. |
|
For values of "a few" greater than eight. Not far from a fricking century.
|