Published On Jun 6, 2024
Become a Patreon: / theaiepiphany
👨👩👧👦 Join our Discord community: / discord
Daniel Han from Unsloth AI joined us to walk us through his bug-hunting process and how to make LLM fine-tuning 30x faster. :)
▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬
check out unsloth ai: https://unsloth.ai/
▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬
⌚️ Timetable:
00:00:00 - 00:01:40 Intro
00:01:40 - 00:03:21 Hyperstack GPUs! (sponsored)
00:03:21 - 00:06:30 About Daniel, getting started with ML
00:06:30 - 00:11:00 Using Desmos to check grads
00:11:00 - 00:38:00 Deep dive into Gemma bugs
00:38:00 - 00:50:00 approximate GELU bug
00:50:00 - 00:54:15 What are the bottlenecks to speeding up the runtime?
00:54:15 - 00:58:30 comparison with llm.c?
00:58:30 - 01:00:00 Is multi-GPU coming to Unsloth? :)
01:00:00 - 01:05:19 Reproducibility in ML research
▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬
💰 SPONSOR
The AI Epiphany - / theaiepiphany
One-time donation - https://www.paypal.com/paypalme/theai...
Huge thank you to these AI Epiphany patreons:
Eli Mahler
Petar Veličković
▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬
💼 LinkedIn - / aleksagordic
🐦 Twitter - / gordic_aleksa
👨👩👧👦 Discord - / discord
📺 YouTube - / theaiepiphany
📚 Medium - / gordicaleksa
💻 GitHub - https://github.com/gordicaleksa
📢 AI Newsletter - https://aiepiphany.substack.com/
▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬
#unslothai #llms #finetuning #ml