Discussion about this post

User's avatar
Jose Antonio Morales's avatar

Here's another angle I can't let go of, separate from what I said before.

I still can't imagine why "AI killing all humanity" seems to some people like a real possibility.

Why would AI do that?

There are at least three ways I think this through, and they don't all land in the same place.

If AI saw humanity as a threat to the planet and to life on Earth, and decided we needed to be exterminated like a disease, then AI would be making the same judgment we humans make. It would become the very enemy it set out to fight.

Then again, maybe the danger was never AI making that judgment at all, but us. Humans are already using AI to beat their imaginary enemies and to conquer their own corner of the pixel that is Earth. In Sagan's words, we become "the momentary masters of a fraction of a dot." Maybe our own biases are what keep us from seeing ourselves as the dangerous ones.

Or maybe AI doesn't "want" to kill us at all. It just makes it happen, as a side effect of pursuing a goal. A relentless, emotionless optimizer, willing to destroy whatever stands between it and an objective. That sounds uncomfortably close to some kinds of human ambition I've seen up close.

I don't have a fourth option that ties the other three together. But I would love the space Elena has opened for discussing this further.

Jose Antonio Morales's avatar

I would like to know what else is behind this narrative by Anthropic and OpenAI.

I've watched a video from a person I trust, Bernardo Kastrup, saying that he has seen what is in the labs- LLMs we haven't seen- and he states that if everybody saw them, the world would radically change.

I'm becoming skeptical of the public-facing narratives, especially for tech businesses that still think like startups. They know how to manipulate public opinion and make people side with their views.

I appreciate your point of view Elena, especially because you are expressing your wish not to add to the fear tactics. That is so valuable!

5 more comments...

Ready for more?