This video describes my approach to teaching. First, it's necessary to establish a strong basis in linguistic understanding, by engaging in vast amounts of repetition. Humans learn to speak and read through many years of learning, which is similar to how large language models and AI is pre-trained on simple word completion tasks.

I personally read a lot of books growing up, which gave me a strong vocabulary and basis in English text. Along with practicing teaching by explaining technical concepts, this basis gives me a strong skill at managing linguistic complexity of sentences. I believe this is one of the key features that great teachers from around the world all possess.

At the end, I ask whether I should make more videos about teaching, research, or related topics. Also, I announced my new discord server and mailing list!

My discord server:
  / discord  

My mailing list:
https://linktr.ee/seriouself (new version coming soon)

#teaching #llm #linguistics

Extracting Training Data from ChatGPT
https://not-just-memorization.github....

Bilingual Contexts Modulate the Inhibitory Control Network
https://www.frontiersin.org/articles/...

Advice for machine learning beginners | Andrej Karpathy and Lex Fridman
   • Advice for machine learning beginners...  

"Surely You're Joking, Mr. Feynman!": Adventures of a Curious Character
  / surely-you-re-joking-mr-feynman  

0:00 Intro
0:18 Contents
0:23 Part 1: The flood of language
0:33 How LLMs learn via pretraining
1:00 Example: Revealing LLM training data
1:40 How humans learn
2:08 My experience with reading
2:43 Generalizing to different domains and modalities
2:59 Example: Romans reading aloud
3:41 Example: Learning voice recognition modality
4:21 Repetition builds a language predictor in your brain
5:07 Example: code switching between languages
5:56 Part 2: Building up skills
6:21 Editing papers and books
6:41 Writing code
7:00 Understand material well to teach it
7:25 Managing linguistic complexity
7:36 The perfect storm to become a teacher
8:00 Great teachers all have a way with words
8:12 Book recommendation: Surely you're joking, Mr Feynman
8:27 Part 3: How I teach
9:03 Similarity with copy and line editing
9:59 Thinking of all the ways to say something
10:17 Receiving feedback from the listener
11:08 Why I teach: altruism?
11:42 How to improve: comprehensible input
12:17 Soliciting feedback on teaching and research
12:28 Announcement 1: discord channel
13:02 Announcement 2: mailing list
13:46 Conclusion
14:24 Manage linguistic complexity
14:41 Outro