The Power of Intelligence is an essay published by Eliezer Yudkowsky in 2007.

Now, a few points:

Sorting Pebbles Into Correct Heaps was about the orthogonality thesis. A consequence of the orthogonality thesis is that powerful artificial intelligence will not necessarily share human values.

This video is about just how powerful and dangerous intelligence is. These two insights put together are a cause for concern.

If humanity doesn't solve the problem of aligning AIs to human values, there's a high chance we'll not survive the creation of artificial general intelligence. This issue is known as "The Alignment Problem". Some of you may be familiar with the paperclips scenario: an AGI created to maximize the number of paperclips uses up all the resources on Earth, and eventually outer space, to produce paperclips. Humanity dies early in this process. But, given the current state of research, even a simple goal such as “maximize paperclips” is already too difficult for us to program reliably into an AI. We simply don't know how to aim AIs reliably at goals. If tomorrow a paperclip company manages to program a superintelligence, that superintelligence likely won't maximize paperclips. We have no idea what it would do. It would be an alien mind pursuing alien goals. Knowing this, solving the alignment problem for human values in general, with all their complexity, appears like truly a daunting task. But we must rise to the challenge, or things could go very wrong for us.

You can read The Power of Intelligence and many other essays by Eliezer Yudkowsky on this website: https://www.readthesequences.com/

▀▀▀▀▀▀▀▀▀PATREON, MEMBERSHIP, KO-FI▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀

🟠 Patreon:   / rationalanimations  

🟢Merch: https://crowdmade.com/collections/rat...

🔵 Channel membership:    / @rationalanimations  

🟤 Ko-fi, for one-time and recurring donations: https://ko-fi.com/rationalanimationss

▀▀▀▀▀▀▀▀▀SOCIAL & DISCORD▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀

Twitter:   / rationalanimat1  

Discord:   / discord  

▀▀▀▀▀▀▀▀▀OTHER STUFF▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀

Share this video with a friend or on Social Media:    • The Power of Intelligence - An Essay ...  

Playlist with all the animated videos:    • The Planning Fallacy: Why You Struggl...  

Bitcoin address: 1FX4iepZfh1yuMNYtvYf2CWL7gha8cakuf
Ethereum address: 0xDa8463494Dd233c3aBe59bc42Abc4D50823A5f3

▀▀▀▀▀▀▀▀▀PATRONS & MEMBERS▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀

Name
Colin Ricardo
Long Hoang
Tor Barstad
Stuart Alldritt
AGI275
Serena Thompson
Atm Lun
Ville Ikäläinen
Chris Painter
Fermain
Juan Benet
James
Dylan Mavrides
Michael McGuffin
DJ Peach Cobbler
Lex Song
Falcon Scientist
Trevaugn Martin
Please Insert Name
Christian Loomis
Ðœikhail Samin
AudD
Tomarty
Edward Yu
Chase
Ahmed Elsayyad
Chad M Jones
Jim Bob
Emmanuel Fredenrich
Neal Strobl
Renn Bright
bparro
Danealor
Dain Bramage
Travis Reid
Craig Falls
Diego
Aaron Camacho
Vincent Weisser
Shivanshu Purohit
Alex Hall
Hex Ramdass
Yarrow Bouchard
Ivan Bakhtin
Vincent Söderberg
joe39504589
Tim Davis
Oisin Hendrix
indexhtml
Craig Talbert
Klemen Slavic
Filip Passeri
Nick Sharp
hr101
Udo
Scott Alexander
Thomas Farago
noggieB
Dawson
Florian
Logic
Daniel Cunningham
YouAyePee
John S
Dang Griffith
Gabriel Ledung
William Deng
David Mc
Meade Marmalade
Ana Tomasovic
JHeb
Jeroen De Dauw
Craig Ludington
Jacob Van Buren
Gabriel Fair
Superslowmojoe
Lars Osborne
Nicholas Kees Dupuis
Ashten The Platypus
Michael Zimmermann
Austin Cluff
Nathan Fish
Sephiths
Ryouta Takehiko
Nathan
Kevin Ma
Bleys Goodson
FusionOak
Ducky
Treviisolion
Bryan Egan
Perry Jackson
Calvin McCarter
Matt Parlmer
Neel Nanda
Tim Duffy
Connor
Marty Betz
Robin Hanson
rictic
Mark Gongloff
Roborodger
ReddChronic
Matthew Brooks
marverati
Luke Freeman
Raphaël Lévy
Rochelle Harris
Dan Wahl
Francisco Lillo
AWyattLife
Evan Carroll
codeadict
Lazy Scholar
Torstein Haldorsen
Alex G
Supreme Reader
Michał Zieliński
The CEO
רם רינגל

▀▀▀▀▀▀▀CREDITS▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀

Animation Director:   / evan  

Animation team:
-   / celestialshibe   / Lara
-   / damonedgson   Damon
-   / earl.gravy   / Grey
-   / mrgabreleiros   / Gabriel
-   / hannah_luloo   / Hannah
- https://www.kristysteffens.com / Kristy
-   / nezhahah   / Neda
-   / deewangart   / Dee
- ?? / :3

Writer:
- Eliezer Yudkowsky

Producer:
- :3

Narrator: Robert Miles
VO Editor: Tony Dipiazza

Sound design and music: Epic Mountain