Published On Dec 13, 2023
Phi-2 is a tiny model that could fit on a phone, but it outperforms huge language models like Llama 2. I explain more about how it was made and what it means. Then we see Imagen-2, the most stunning text-to-image yet, at least according to Google' images. We then glimpse Optimus 2, smaller in the sense that it's 10kg lighter! With more degrees of freedom, it's movements look a lot more humanoid. And then the full launch of AI Insiders, plus a recap of why we shouldn't use the MMLU to 2 decimal places!
/ aiexplained
phi2 now on HuggingFace: https://huggingface.co/microsoft/phi-2
Bubeck Video, min 19: • Textbooks Are All You Need
Phi 2: https://www.microsoft.com/en-us/resea...
Shital Shah: / 1734882570603753814
Shoggoth: / 1702488701782352097
Mamba 3B: https://www.together.ai/blog/mamba-3b...
Phi 1.5B: https://arxiv.org/abs/2309.05463
Phi 1: https://arxiv.org/abs/2306.11644
Microsoft Prompting: https://www.microsoft.com/en-us/resea...
SmartGPT Video: • SmartGPT: Major Benchmark Broken - 89...
The Information: https://www.theinformation.com/articl...
Imagen 2: / 1734954295655534780
https://deepmind.google/technologies/...
/ 1734763060244386074
Greg Technology: / 1734544659953623509
Swyx: https://www.latent.space/
AI Engineer: https://youtube.com/@aiDotEngineer?si...
Shawn Wang: https://x.com/swyx?s=09
/ aiexplained Non-Hype, Free Newsletter: https://signaltonoise.beehiiv.com/