You've seen the recent screenshots of Microsoft's Bing Chat treating users like a total psychopath ( I have been a good Bing 😊 )— Here's an explanation of the problem going on inside the mind of a system like Bing Chat, and how we can solve it if we want to build truly useful and functional artificial intelligent assistants.

Timecodes:
0:00 Intro
0:36 How an Agent works
2:37 How old A.I. works
4:25 How current A.I. works
7:12 Understanding Bings Personality Disorder
13:06 How to Solve this Problem
15:40 Solving the A.I. Alignment Problem
22:49 The Soccer Story
26:41 Conclusion