You may have already seen this, but for those who haven't -
Carlo Graziani at Balloon-Juice:
I'm skeptical that MS has had some sort of breakthrough a few weeks after dumping a bunch of money into this stuff. But I haven't spent much time on this, myself.
History tells us that "breakthroughs" that get a lot of pile-on press almost never are. And even when they actually are (cloning, understanding mRNA, computers beating humans at Go, electric cars with 200-300-400 mile range, etc.), there's still years or decades of development ahead before they become real, useful products in the marketplace.
More at the link.
Cheers,
Scott.
Carlo Graziani at Balloon-Juice:
Singal: “…which values are programmed into AI…”
My head is starting to hurt.
There are no goddamn “values” “programmed” into an “AI”. The current version of “AI” that has swept research in the field for the past 15 years is based on Deep Learning (DL), which does no more and no less than efficiently characterizing the distribution that give rise to some training data (be it digitized photographs, movie preferences, or streams of natural language text) in a way that can be exploited by presenting it with a new data sample and a request fo a decision concerning that sample.
That’s it. It’s a statistical parlor trick, even when the data domain is natural language. The reason ChatGPT can be so easily tricked into spewing nonsense is that the more complex the data distribution (natural language streams are as complex as data gets) the easier it is to construct a new sample to query the trained system with that eludes the domain of the training data, so that the distribution is poorly (but nonetheless confidently) characterized in the neighborhood of the new sample.
[...]
I'm skeptical that MS has had some sort of breakthrough a few weeks after dumping a bunch of money into this stuff. But I haven't spent much time on this, myself.
History tells us that "breakthroughs" that get a lot of pile-on press almost never are. And even when they actually are (cloning, understanding mRNA, computers beating humans at Go, electric cars with 200-300-400 mile range, etc.), there's still years or decades of development ahead before they become real, useful products in the marketplace.
More at the link.
Cheers,
Scott.