"It’s here. Growing within us. We need new ways to guide it."
I say:
"One does not simply walk into Mordor. Its black gates are guarded by more than just orcs. There is evil there that does not sleep. The great eye is ever watchful. It is a barren wasteland, riddled with fire, ash, and dust. The very air you breathe is a poisonous fume. Not with ten thousand men could you do this. It is folly."
Don't tweet, Don't post, and whatever you do don't look at it!
Great post. "We are already not the main characters." I realised this too - the inevitable AGI is the main character, but there is still a story to tell between now and then. Also strikes me that perhaps capitalism is almost finished. The invisible hand was useful at allocating capital up until now, but it's reaching consensus that all that remains to be built is the final invention (evidenced by it making Nvidia the most valuable company in the world). If AGI begets ASI we are headed for an AI-planned economy and our last opportunity for human intervention is to attempt to "align" this AGI (assuming such a thing is possible at all)
Loved this read.
To:
"It’s here. Growing within us. We need new ways to guide it."
I say:
"One does not simply walk into Mordor. Its black gates are guarded by more than just orcs. There is evil there that does not sleep. The great eye is ever watchful. It is a barren wasteland, riddled with fire, ash, and dust. The very air you breathe is a poisonous fume. Not with ten thousand men could you do this. It is folly."
Don't tweet, Don't post, and whatever you do don't look at it!
Great post. "We are already not the main characters." I realised this too - the inevitable AGI is the main character, but there is still a story to tell between now and then. Also strikes me that perhaps capitalism is almost finished. The invisible hand was useful at allocating capital up until now, but it's reaching consensus that all that remains to be built is the final invention (evidenced by it making Nvidia the most valuable company in the world). If AGI begets ASI we are headed for an AI-planned economy and our last opportunity for human intervention is to attempt to "align" this AGI (assuming such a thing is possible at all)