My point is that fear-mothering is unhealthy. You don’t want to have public sphere full of it. It is toxic. And it is contributing to the potential of the AI misalignment.
The AI that we are going to create in not an alien popping up between us. It is us. A human world projected through text and images into an entity that can simulate everything that there is in it. If there is too much fear and war in the human world, that projection and the simulation can get contaminated by it.
And no amount of alignment effort will change it. Facts will remain facts. Your fears expressed in text are reality.
If AI is going to reflect us, I would like it to reflect a version of us that doesn't build things haphazardly and then shrug about security. I would like the AI to reflect a humanity that is careful and considers vulnerabilities and side effects before it makes decisions.
Maybe it would be good for us to model that behavior for it.
Alignment was one of the explicitly declared goals of ChatGPT. That's why they opened it to the public, to let people hack it and work to close those vulnerabilities.
Unfortunately it went viral, and this caused a rush to product. But you can't say they shrugged or that people aren't earnestly working on Alignment.
> But you can't say they shrugged or that people aren't earnestly working on Alignment.
They opened up 3rd-party API access. They clearly do not view this as a blocker whatever their declared goals are.
> Unfortunately it went viral, and this caused a rush to product.
They encouraged it to go viral. This is not a thing that was thrust upon them against their will. They signed a deal with Microsoft to turn this into a search engine and to allow it to start operating on untrusted 3rd-party text. Nobody held a gun to their head and forced them to do that. They made that choice.
I think, focus on Alignment and simply making the system to be good and useful should be the focus. Not fighting prompt injections or complaining about hallucinations, while not contributing much.
When you are educating a child, you are not focusing on making the child super-resilient to hypnosis. You are simply socializing the child, teaching the child to read, write. The knowledge, need and techniques to avoid being hypnotized don’t need a special focus.
Considering that he had more or less funded (if not founded) OpenAI, I would not disregard Mr. Musk. He also happens to express deranged opinions from time to time. Anf generally behaves as if he is above the law. Not dissimilar to Trump or Putin or Xi. And I really wouldn’t want to find an AI coming from any of these actors.
So? What about all the other things Musk promised and didn't deliver on? Why would this be the exception to the rule? Because it's a current news item?
It's all just sizzle until there's steak.
Opinions are just opinions, but this is a conversation about substance, something he's not known for. He's known for throwing shit at a wall, of which, very little actually sticks.
> What about all the other things Musk promised and didn't deliver on?
Name three?
> Why would this be the exception to the rule? Because it's a current news item?
What exception? The rule so far has been that Musk generally delivers what he promises, he's just a bit optimistic about timelines.
This meme won't ever die, will it? Even if Starships are routinely cruising back and forth between Earth, Moon and Mars, some people will still come out of woodwork and ask, "when ever did Musk deliver on any of his promises?".
The AI that we are going to create in not an alien popping up between us. It is us. A human world projected through text and images into an entity that can simulate everything that there is in it. If there is too much fear and war in the human world, that projection and the simulation can get contaminated by it.
And no amount of alignment effort will change it. Facts will remain facts. Your fears expressed in text are reality.