adding lecture 6: makemore part5: cnn part 1 lol omg

pull/17/head
Andrej Karpathy 2022-11-21 09:32:09 +09:00
parent 44cfac7e03
commit 74aac39aea
2 changed files with 655 additions and 1 deletions

View File

@ -57,10 +57,17 @@ I recommend you work through the exercise yourself but work with it in tandem an
---
ongoing...
**Lecture 6: Building makemore Part 5: Building WaveNet**
We take the 2-layer MLP from previous video and make it deeper with a tree-like structure, arriving at a convolutional neural network architecture similar to the WaveNet (2016) from DeepMind. In the WaveNet paper, the same hierarchical architecture is implemented more efficiently using causal dilated convolutions (not yet covered). Along the way we get a better sense of torch.nn and what it is and how it works under the hood, and what a typical deep learning development process looks like (a lot of reading of documentation, keeping track of multidimensional tensor shapes, moving between jupyter notebooks and repository code, ...).
- [YouTube video lecture](https://youtu.be/t3YJ5hKiMQ0)
- [Jupyter notebook files](lectures/makemore/makemore_part5_cnn1.ipynb)
---
Ongoing...
**License**
MIT

File diff suppressed because one or more lines are too long