AI has hacked the code of human civilization (Yuval Noah Harari)

“The job that was once performed by Lenin and Mussolini is now performed by AI.”

Yuval Noah Harari lecture at Oxford University (YouTube description): “Human domination relies on large-scale cooperation among strangers, which is sustained by bureaucratic systems – such as laws, finance, religion – designed to build trust. Since AIs are ‘native bureaucrats’, they can effortlessly remember all laws, transactions, and scriptures far better than any human. This leaves AI uniquely placed to take over critical processes, such as granting bank loans, deciding university admissions, determining prison sentences, and executing military strikes. Are we prepared?”

Harari’s vision of the AI future seems most on-target to me.

NEXUS: Religion

Yuval Noah Harari begins his “history of information networks” talking about books as a type of technology, the Bible being the most successful example. And the Catholic Church as one of the most powerful networks.

After his death, Jesus became the subject of one of the most remarkable branding campaigns in history. […] The story of Jesus managed to have a much bigger impact on history than the person of Jesus.

While most Christians were not physically present at the Last Supper, they have heard the story so many times, and they have seen so many images of the event, that they “remember” it more vividly than they remember most of the family dinners in which they actually participated.

Religions always claim to be an objective and eternal truth rather than a fictional story invented by humans.

The Bible as a single holy book didn’t exist in biblical times. King David and the prophet Isaiah never saw a copy of the Bible. […] no two ancient Bibles were identical.

Catholic theology accepted that Jesus told us to love our enemies, but explained that burning heretics was an act of love, because it deterred additional people from adopting heretical views, thereby saving them from the flames of hell.

The first rule of changing church teachings is that you never admit to changing church teachings.

Religions throughout history claimed a nonhuman source for their holy books; soon that might be a reality. Attractive and powerful religions might emerge whose scriptures are composed by AI. Pg 209

The Bible had a profound effect on billions of people, even though it was a mute document. Now try to imagine the effect of a holy book that not only can talk and listen but can get to know your deepest fears and hopes and constantly mold them.

NEXUS: A Brief History of Information Networks from the Stone Age to AI

I have read and enjoyed each of Yuval Noah Harari’s previous books. Sapiens: A Brief History of Humankind; Homo Deus: A Brief History of Tomorrow; and 21 Lessons for the 21st Century. As the titles suggest, he writes about history and persuaded this reader that is the only context to fully understand what is happening in the world.

This book scared the shit out of me. I grew up during the early days of the Cold War, watching B-52 bomber packed with nukes flying overhead. As a teenager, I held my breath with the rest of the world during the Cuban Missile Crises. But Harari makes a compelling case for AI (assuming we fuck it up and we will) as a greater existential threat.

Like all of Harari’s books, this one (about 400 pages) got a loft of highlighter. More excerpts after the jump. Or you can watch this 40 minute discussion with Sam Harris. Continue reading →

So what next?

“The first step is to tone down the prophecies of doom and switch from panic mode to bewilderment. Panic is a form of hubris. It comes from the smug feeling that one knows exactly where the world is heading: down. Bewilderment is more humble and therefore more clear-sighted. Do you feel like running down the street crying “The apocalypse is upon us”? Try telling yourself, “No, it’s not that.Truth is, I just don’t understand what’s going on in the world.”

— 21 Lessons for the 21st Century (2018)

Production-line Education

“The Industrial Revolution has bequeathed us the production-line theory of education. In the middle of town there is a large concrete building divided into many identical rooms, each room equipped with rows of desks and chairs. At the sound of a bell, you go to one of these rooms together with thirty other kids who were all born the same year as you. Every hour a different grown-up walks in and starts talking. The grown-ups are all paid to do so by the government. One of them tells you about the shape of the earth, another tells you about the human past, and a third tells you about the human body. It is easy to laugh at this model, and almost everybody agrees that no matter its past achievements, it is now bankrupt.”

— 21 Lessons for the 21st Century