From the crazy potential of data quality, the dramatic possibilities of new architectures like Mamba (summarised here in around 5 minutes!), hybrid architectures, prompt optimisation and more. And regardless of all of that, photo-realism is coming to video.

I'll also explore a 100 year old prediction, on this 2024 New Year in AI...

  / aiexplained  

Fan Tweet:   / 1741499431474934165  
Mamba: https://arxiv.org/abs/2312.00752
Mamba Tri Dao Interview:    • Interviewing Tri Dao and Michael Poli...  
Albert Gu:   / 1731727682814050570  
AI Improvement Paper: https://arxiv.org/abs/2312.07413
Mistral Interview:    • Safety in Numbers: Keeping AI Open  
Lukasz Kaiser on Inference Time Compute:    • Deep Learning Decade and GPT-4 | Luka...  
W.A.L.T Video:   / 1740788207967736047  
https://aicountdown.com/
AI Explained Orca:    • Orca: The Model Few Saw Coming  
Let’s Verify:    • 'Show Your Working': ChatGPT Performa...  
Q-Star:    • Q* - Clues to the Puzzle?  
1923 Cartoon:   / svpino_a-1923-cartoon-that-predicts-genera...  
Quadratic Complexity:   / how-to-apply-transformers-to-time-series-m...  
Striped Hyena: https://www.together.ai/blog/stripedh...
Illustrated Transformer: https://jalammar.github.io/illustrate...
Language Models as Optimizers: https://arxiv.org/abs/2309.03409
https://www.etched.com/
W.A.L.T https://www.tomsguide.com/news/walt-i...
S4: https://hazyresearch.stanford.edu/blo...

  / aiexplained   Non-Hype, Free Newsletter: https://signaltonoise.beehiiv.com/