Published On May 22, 2024
Microsoft promise ‘whale-size’ compute for a GPT-5-tier model, and say the end is not in sight for scaling the power of AI. Google ship models and a fascinating paper, while Anthropic unveil the inner workings of large language models. Meanwhile Sam Altman is forced to repeatedly apologize, Ilya Sutskever leaves, and GPT-4o is pushed back. My reflections on all of the above, and details you may have missed from each paper.
AI Insiders: / aiexplained
Kevin Scott Talk: • Microsoft Build 2024: Day 1 #MSBuild
Mark Chen Hint: https://x.com/GaryMarcus/status/17901...
Noam Comments: / 1676971506969219072
Anthropic Scaling Monosemanticity: https://transformer-circuits.pub/2024...
https://www.anthropic.com/news/mappin...
Ilya Leaves: / 1790517455628198322
Then Jan Leike: https://x.com/janleike/status/1791498...
And Logan Hints: https://x.com/OfficialLoganK/status/1...
Altman Apologizes: https://x.com/sama/status/17919368575...
https://www.forbes.com/sites/antoniop...
And Her Delayed: https://help.openai.com/en/articles/8...
Superalignment Starved: https://fortune.com/2024/05/21/openai...
https://openai.com/index/introducing-...
Gemini Updated Paper: https://storage.googleapis.com/deepmi...
And Prizes: https://x.com/JeffDean/status/1793026...
Google AI Studio: https://ai.google.dev/aistudio
Business GenAI Consulting: https://theinsiders.ai
Non-hype Newsletter: https://signaltonoise.beehiiv.com/
AI Insiders: / aiexplained