LoRA: Low-Rank Adaptation of Large Language Models - Explained visually + PyTorch code from scratch
Umar Jamil Umar Jamil
41.7K subscribers
25,491 views
1K

 Published On Jul 25, 2023

A full visual explanation of LoRA, with PyTorch code form scratch!

Full code and slides are available on my GitHub: https://github.com/hkproj/pytorch-lora

Chapters
00:00 - Introduction
00:47 - How neural networks work
01:48 - How fine tuning works
03:50 - LoRA
08:58 - Math intuition
10:25 - Math explanation
14:05 - PyTorch implementation from scratch

show more

Share/Embed