I work with this on a daily basis as part of my day job. I'll take my understanding of it over that of sensationalist videos trying to sell online classes.
Latest text model with temp of 0.7 (very creative), and with probability annotations on:
Exact same prompt, note the different response:
Turn the temperature down to 0, same prompt:
Exact same prompt, note the exact same response:
Regarding Musk:
and
So, no.
There is no way they're dedicating personnel on the instrumentation side rather than the make progress side.They absolutely are, and we've talked to them on a daily basis.
Predictive text tokenization has nothing to do with the answers it comes up with on the way out. That's all about reading the input.Completely wrong.
Latest text model with temp of 0.7 (very creative), and with probability annotations on:
Exact same prompt, note the different response:
Turn the temperature down to 0, same prompt:
Exact same prompt, note the exact same response:
Regarding Musk:
The organization was founded in San Francisco in late 2015 by Sam Altman, Elon Musk, and others, who collectively pledged US$1 billion. Musk resigned from the board in February 2018 but remained a donor. In 2019, OpenAI LP received a US$1 billion investment from Microsoft.
and
OpenAI LP is governed by the board of the OpenAI nonprofit, comprised of OpenAI LP employees Greg Brockman (Chairman & President), Ilya Sutskever (Chief Scientist), and Sam Altman (CEO), and non-employees Adam D'Angelo, Reid Hoffman, Will Hurd, Tasha McCauley, Helen Toner, and Shivon Zilis.
So, no.