gen-ai
/
nn-zero-to-hero
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity

add new GPT lecture

master
Andrej Karpathy 2023-01-17 08:50:54 -08:00
parent 74aac39aea
commit 374864c1f2
1 changed files with 9 additions and 0 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

9
README.md
View File

@ -66,6 +66,15 @@ We take the 2-layer MLP from previous video and make it deeper with a tree-like
---
**Lecture 7: Let's build GPT: from scratch, in code, spelled out.**
We build a Generatively Pretrained Transformer (GPT), following the paper "Attention is All You Need" and OpenAI's GPT-2 / GPT-3. We talk about connections to ChatGPT, which has taken the world by storm. We watch GitHub Copilot, itself a GPT, help us write a GPT (meta :D!) . I recommend people watch the earlier makemore videos to get comfortable with the autoregressive language modeling framework and basics of tensors and PyTorch nn, which we take for granted in this video.
- [YouTube video lecture](https://www.youtube.com/watch?v=kCc8FmEb1nY). For all other links see the video description.
---
Ongoing...
**License**