Become a Patreon:   / theaiepiphany  
👨‍👩‍👧‍👦 Join our Discord community:   / discord  

Junyang joined us to talk about the recently annonced Qwen2 LLM!

▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬
https://qwenlm.github.io/blog/qwen2/
▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬

⌚️ Timetable:
00:00:00 - 00:00:32 Intro
00:00:32 - 00:02:13 Hyperstack GPUs (sponsored)
00:02:13 - 00:07:05 Junyang & Qwen team at Alibaba
00:07:05 - 00:13:05 Qwen2
00:13:05 - 00:15:55 Tokenizer
00:15:55 - 00:23:30 Training Qwen2
00:23:30 - 00:30:50 Pretraining data
00:30:50 - 00:37:35 Model Architecture (changes?)
00:37:35 - 00:50:00 Context length
00:50:00 - 00:57:50 Post-training
00:57:50 - 00:59:20 Benchmarks/safety
00:59:20 - 01:03:32 Future work

▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬
💰 SPONSOR

The AI Epiphany -   / theaiepiphany  
One-time donation - https://www.paypal.com/paypalme/theai...

Huge thank you to these AI Epiphany patreons:
Eli Mahler
Petar Veličković

▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬

💼 LinkedIn -   / aleksagordic  
🐦 Twitter -   / gordic_aleksa  
👨‍👩‍👧‍👦 Discord -   / discord  

📺 YouTube -    / theaiepiphany  
📚 Medium -   / gordicaleksa  
💻 GitHub - https://github.com/gordicaleksa
📢 AI Newsletter - https://aiepiphany.substack.com/

▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬

#qwen2 #alibaba #llms