ai_all_resources/README.md

457 lines
30 KiB
Markdown
Raw Normal View History

2019-12-27 01:00:59 +08:00
# An Ultimate Compilation of AI Resources for Mathematics, Machine Learning and Deep Learning
2019-12-26 20:51:15 +08:00
2019-12-27 01:00:59 +08:00
## _Knowledge Not Shared is wasted - Clan Jacobs_
2019-12-26 20:51:15 +08:00
2019-12-28 03:06:35 +08:00
### This collection is a compilation of Excellent ML and DL Tutorials created by the people below
2019-12-27 01:00:59 +08:00
2020-01-13 07:07:39 +08:00
- [Andrej Karpathy blog](http://karpathy.github.io/)
- [Brandon Roher](https://brohrer.github.io/blog.html)
- [Andrew Trask](https://iamtrask.github.io/)
- [Jay Alammar](https://jalammar.github.io/)
- [Sebastian Ruder](https://ruder.io/)
- [Distill](https://distill.pub/)
2020-02-06 01:13:26 +08:00
- [StatQuest with Josh Starmer](https://www.youtube.com/user/joshstarmer)
2020-01-13 07:07:39 +08:00
- [sentdex](https://www.youtube.com/channel/UCfzlCWGWYyIQ0aLC5w48gBQ)
- [Lex Fridman](https://www.youtube.com/user/lexfridman)
- [3Blue1Brown](https://www.youtube.com/channel/UCYO_jab_esuFRV4b17AJtAw)
2020-02-06 01:13:26 +08:00
- [Alexander Amini](https://www.youtube.com/user/Zan560)
- [The Coding Train](https://www.youtube.com/user/shiffman)
2020-01-13 07:07:39 +08:00
## Communities to Follow
2020-02-05 01:23:53 +08:00
- [Coimbatore School of AI](http://soaicbe.org/)
- *Join here*🔗⬇️
2020-02-05 01:19:30 +08:00
- [Meetup : Coimbatore School of AI](https://www.meetup.com/Coimbatore-School-of-AI/)
2020-02-05 01:42:32 +08:00
- [Telegram : For Daily Updates](https://t.me/joinchat/MmtTDRUcEqIuAPpr6Ph0Jw)
2020-02-05 01:19:30 +08:00
- [Facebook : Coimbatore School of AI](https://www.facebook.com/groups/440187506472896/)
2020-02-05 01:42:32 +08:00
- [TensorFlow User Group Coimbatore](https://www.tensorflow.org/community/groups)
- [Meetup : TFUGCbe](https://www.meetup.com/TFUGCbe/)
- [Facebook : TFUGCbe](https://www.facebook.com/groups/2425901487658992/)
2020-01-13 07:07:39 +08:00
- [Omdena - Building AI for Good - By the People, For the People](https://medium.com/omdena)
2020-02-05 01:19:30 +08:00
## Why Data Science and how to get started ?
2019-12-27 01:00:59 +08:00
2020-02-05 01:19:30 +08:00
- [🖥️ HOW TO GET STARTED WITH MACHINE LEARNING!](https://www.youtube.com/watch?v=I74ymkoNTnw)
2020-01-13 07:07:39 +08:00
- [How to Build a Meaningful Career in Data Science](https://www.datacamp.com/community/blog/how-to-build-a-meaningful-career-in-data-science)
2020-02-05 01:19:30 +08:00
- [My Self-Created Artificial Intelligence Masters Degree](https://hackernoon.com/my-self-created-ai-masters-degree-ddc7aae92d0e)
- [PyImageSearch](https://www.pyimagesearch.com/start-here/)
2019-12-27 01:00:59 +08:00
2020-01-13 07:07:39 +08:00
## Intro to ML
2019-12-26 20:51:15 +08:00
2020-02-11 01:05:23 +08:00
- [Luis Serrano: A Friendly Introduction to Machine Learning](https://www.youtube.com/watch?v=IpGxLWOIZy4)
- [StatQuest: A Gentle Introduction to Machine Learning](https://www.youtube.com/watch?v=Gv9_4yMHFhI)
## Any one can do Machine Learning
- [Teachable Machine](https://teachablemachine.withgoogle.com/) _Train a computer to recognize your own images, sounds, & poses. A fast, easy way to create machine learning models for your sites, apps, and more no expertise or coding required._
2020-01-13 07:07:39 +08:00
## MOOCs
- [Machine Learning by Andrew Ng, Stanford](https://www.coursera.org/learn/machine-learning) _IMDB 10/10 LOL :P_
- [Datacamp : Data Engineer with Python](https://www.datacamp.com/tracks/data-engineer-with-python)
- [Intro to Machine Learning](https://classroom.udacity.com/courses/ud120) _Topics Covered Naive Bayes, SVM, Decision Trees, Regressions, Outliers, Clustering, Feature Scaling, Text Learning, Feature Selection, PCA, Validation, Evaluation Metrics_
- [Intro to TensorFlow for Deep Learning](https://classroom.udacity.com/courses/ud187) _The Best Course for Learning TensorFlow_
- [End-to-End Machine Learning](https://end-to-end-machine-learning.teachable.com/courses/)
- [NVIDIA DEEP LEARNING INSTITUTE](https://www.nvidia.com/en-us/deep-learning-ai/education/)
- [Introduction to Machine Learning for Coders!](http://course18.fast.ai/ml)
- [Practical Deep Learning for Coders, v3](https://course.fast.ai/)
- [FastAI](https://www.fast.ai/)
## YouTube ML Playlists
2019-12-26 20:51:15 +08:00
2020-01-13 07:07:39 +08:00
- [Machine Learning by StatQuest with Josh Starmer](https://www.youtube.com/playlist?list=PLblh5JKOoLUICTaGLRoHQDuF_7q2GfuJF)
- [Intelligence and Learning by The Coding Train](https://www.youtube.com/playlist?list=PLRqwX-V7Uu6YJ3XfHhT2Mm4Y5I99nrIKX)
2019-12-26 20:51:15 +08:00
2020-01-13 07:07:39 +08:00
## Machine Learning Fundamentals _(These terms will be often used in the below algorithms)_
2019-12-27 01:00:59 +08:00
2020-01-13 07:07:39 +08:00
- [Bias and Variance](https://www.youtube.com/watch?v=EuBBz3bI-aA)
- [Cross Validation](https://www.youtube.com/watch?v=fSytzGwwBVw)
- [Sensitivity and Specivicity](https://www.youtube.com/watch?v=sunUKFXMHGk)
- [ROC and AUC, Clearly Explained!](https://www.youtube.com/watch?v=4jRBRDbJemM)
- [StatQuest: R-squared explained](https://www.youtube.com/watch?v=2AQKmw14mHM)
- [StatQuest: P Values, clearly explained](https://www.youtube.com/watch?v=5Z9OIYA8He8)
- [Machine Learning Fundamentals: The Confusion Matrix](https://www.youtube.com/watch?v=Kdsp6soqA7o)
- [Regularization Part 1: Ridge Regression](https://www.youtube.com/watch?v=Q81RR3yKn30)
- [Regularization Part 2: Lasso Regression](https://www.youtube.com/watch?v=NGf0voTMlcs)
- [Maximum Likelihood](https://www.youtube.com/watch?v=XepXtl9YKwc)
- [Covariance and Correlation Part 1: Covariance](https://www.youtube.com/watch?v=qtaqvPAeEJY)
- [Statistics Fundamentals: The Mean, Variance and Standard Deviation](https://www.youtube.com/watch?v=SzZ6GpcfoQY)
- [Statistics Fundamentals: Population Parameters](https://www.youtube.com/watch?v=vikkiwjQqfU)
- [Glossary: Statistics](https://github.com/nature-of-code/NOC-S17-2-Intelligence-Learning/wiki/Glossary:-Statistics)
- [Glossary: Machine Learning](https://github.com/nature-of-code/NOC-S17-2-Intelligence-Learning/wiki/Glossary:-Machine-Learning)
2019-12-27 01:00:59 +08:00
2020-01-13 07:07:39 +08:00
## Math
2019-12-27 01:20:34 +08:00
2020-02-05 01:42:32 +08:00
- [Mathematics for Machine Learning](https://nivu.me/posts/mathematics-for-machine-learning/) _In this post I have compiled great e-resources (MOOC, YouTube Lectures, Books) for learning Mathematics for Machine Learning._
- **I highly Recommend you to go through the following resources by 3Blue1Brown**
- [Essence of Linear Algrbra](https://www.youtube.com/playlist?list=PLZHQObOWTQDPD3MizzM2xVFitgF8hE_ab)
- [Essene of Calculus](https://www.youtube.com/playlist?list=PLZHQObOWTQDMsr9K-rj53DwVRMYO3t5Yr)
- [Differential equations](https://www.youtube.com/playlist?list=PLZHQObOWTQDNPOjrT6KVlfJuKtYTftqH6)
2020-01-13 07:07:39 +08:00
- [Gilbert Strang: Linear Algebra vs Calculus](https://www.youtube.com/watch?v=osEADxaIKIc)
- [Basics of Integral Calculus in Tamil](https://www.youtube.com/watch?v=yMQjCFvMFgA)
- [New fast.ai course: Computational Linear Algebra](https://www.fast.ai/2017/07/17/num-lin-alg/)
- [Linear Algebra Book](http://www.deeplearningbook.org/contents/linear_algebra.html)
2019-12-26 20:51:15 +08:00
2020-01-13 07:07:39 +08:00
## Numpy
2020-01-07 20:45:46 +08:00
2020-01-13 07:07:39 +08:00
- [A Visual Intro to NumPy and Data Representation](https://jalammar.github.io/visual-numpy/)
- [CS231n : Python Numpy Tutorial](http://cs231n.github.io/python-numpy-tutorial/#numpy)
- [NumPy resources : part of the End-to-End Machine Learning library](https://brohrer.github.io/numpy_resources.html)
- [100 numpy exercises (with solutions)](https://github.com/rougier/numpy-100)
- [101 NumPy Exercises for Data Analysis (Python)](https://www.machinelearningplus.com/python/101-numpy-exercises-python/)
- [Numpy Tutorial Introduction to ndarray](https://www.machinelearningplus.com/python/numpy-tutorial-part1-array-python-examples/)
- [Sci-Py Lectures : NumPy: creating and manipulating numerical data](https://scipy-lectures.org/intro/numpy/index.html)
- [Python NumPy Tutorial for Beginners](https://www.youtube.com/watch?v=QUT1VHiLmmI) _Learn the basics of the NumPy library in this tutorial for beginners. It provides background information on how NumPy works and how it compares to Python's Built-in lists. This video goes through how to write code with NumPy. It starts with the basics of creating arrays and then gets into more advanced stuff. The video covers creating arrays, indexing, math, statistics, reshaping, and more._
- [Python NumPy Tutorial Learn NumPy Arrays With Examples](https://www.edureka.co/blog/python-numpy-tutorial/)
- [Python Numpy Array Tutorial](https://www.datacamp.com/community/tutorials/python-numpy-tutorial)
- [NumPy Tutorial: Data analysis with Python](https://www.dataquest.io/blog/numpy-tutorial-python/)
- [Deep Learning Prerequisites: The Numpy Stack in Python](https://www.youtube.com/playlist?list=PLxgDUj5eygKmlhteKFiXIIhdqmdD2TwVM)
2020-01-07 20:45:46 +08:00
2020-01-13 07:07:39 +08:00
## Pandas
2019-12-26 20:51:15 +08:00
2020-01-13 07:07:39 +08:00
- [A Gentle Visual Intro to Data Analysis in Python Using Pandas](https://jalammar.github.io/gentle-visual-intro-to-data-analysis-python-pandas/)
- [10 minutes to pandas](https://pandas.pydata.org/pandas-docs/stable/getting_started/10min.html)
- [Python Pandas Tutorial: A Complete Introduction for Beginners](https://www.learndatasci.com/tutorials/python-pandas-tutorial-complete-introduction-for-beginners/)
2019-12-26 20:51:15 +08:00
2020-02-11 01:05:23 +08:00
## Machine Learning YouTube Playlists
- [CodeBasics: Machine Learning Tutorial Python](https://www.youtube.com/watch?v=gmvvaobm7eQ&list=PLeo1K3hjS3uvCeTYTeyfe0-rN5r8zn9rw)
- [StatQuest: Machine Learning](https://www.youtube.com/playlist?list=PLblh5JKOoLUICTaGLRoHQDuF_7q2GfuJF)
- [sentdex: Machine Learning with Python](https://www.youtube.com/playlist?list=PLQVvvaa0QuDfKTOs3Keq_kaG2P55YRn5v)
- [Simplilearn: Machine Learning Tutorial Videos](https://www.youtube.com/playlist?list=PLEiEAq2VkUULYYgj13YHUWmRePqiu8Ddy)
2019-12-26 20:51:15 +08:00
2020-02-11 01:05:23 +08:00
- [Machine Learning Tutorial in Python](https://www.youtube.com/playlist?list=PL9ooVrP1hQOHUfd-g8GUpKI3hHOwM_9Dn)
- [deeplizard: Machine Learning & Deep Learning Fundamentals](https://www.youtube.com/playlist?list=PLZbbT5o_s2xq7LwI2y8_QtvuXZedL6tQU)
_Note: Below you can find the best lectures for popular Machine Learning Algorithms_
2019-12-26 20:51:15 +08:00
2020-01-13 07:07:39 +08:00
## Linear Regression
2019-12-26 20:51:15 +08:00
2020-01-13 07:07:39 +08:00
- [Linear Regression: A friendly introduction by Luis Serrano](https://www.youtube.com/watch?v=wYPUhge9w5c)
- [Statistics 101: Linear Regression, The Very Basics](https://www.youtube.com/watch?v=ZkjP5RJLQF4)
- [All Types of Regression](https://medium.com/greyatom/logistic-regression-89e496433063)
2019-12-26 20:51:15 +08:00
2020-01-13 07:07:39 +08:00
## Logistic Regression
2019-12-26 20:51:15 +08:00
2020-01-13 07:07:39 +08:00
- [Linear Regression vs Logistic Regression | Data Science Training | Edureka](https://www.youtube.com/watch?v=OCwZyYH14uw)
- [Logistic Regression and the Perceptron Algorithm: A friendly introduction by Luis Serrano](https://www.youtube.com/watch?v=jbluHIgBmBo)
2019-12-26 20:51:15 +08:00
2020-01-13 07:07:39 +08:00
## Decission Tree
2019-12-26 20:51:15 +08:00
2020-01-13 07:07:39 +08:00
- [StatQuest: Decision Trees](https://www.youtube.com/watch?v=7VeUPuFGJHk)
- [StatQuest: Decision Trees, Part 2 - Feature Selection and Missing Data](https://www.youtube.com/watch?v=wpNl-JwwplA)
- [Decision Tree Introduction with example](https://www.geeksforgeeks.org/decision-tree-introduction-example/)
- [Decision Tree](https://www.geeksforgeeks.org/decision-tree/)
- [Python | Decision Tree Regression using sklearn](https://www.geeksforgeeks.org/python-decision-tree-regression-using-sklearn/)
- [ML | Logistic Regression v/s Decision Tree Classification](https://www.geeksforgeeks.org/ml-logistic-regression-v-s-decision-tree-classification/)
2019-12-26 20:51:15 +08:00
2020-01-13 07:07:39 +08:00
## Random Forest
2019-12-26 20:51:15 +08:00
2020-01-13 07:07:39 +08:00
- [StatQuest: Random Forests Part 1 - Building, Using and Evaluating](https://www.youtube.com/watch?v=J4Wdy0Wc_xQ)
- [StatQuest: Random Forests Part 2: Missing data and clustering](https://www.youtube.com/watch?v=nyxTdL_4Q-Q)
- [Random Forests for Complete Beginners](https://victorzhou.com/blog/intro-to-random-forests/)
2019-12-26 20:51:15 +08:00
2020-01-13 07:07:39 +08:00
## SVM
2019-12-26 20:51:15 +08:00
2020-01-13 07:07:39 +08:00
- [Support Vector Machines (SVMs): A friendly introduction by Luis Serrano](https://www.youtube.com/watch?v=Lpr__X8zuE8)
- [Support Vector Machines, Clearly Explained!!! by StatQuest](https://www.youtube.com/watch?v=efR1C6CvhmE)
- [Support Vector Machines Part 2: The Polynomial Kernel by StatQuest](https://www.youtube.com/watch?v=Toet3EiSFcM)
- [Support Vector Machines Part 3: The Radial (RBF) Kernel by StatQuest](https://www.youtube.com/watch?v=Qc5IyLW_hns)
- [How Support Vector Machines work / How to open a black box](https://www.youtube.com/watch?v=-Z4aojJ-pdg)
- [Support Vector Machines - The Math of Intelligence (Week 1)](https://www.youtube.com/watch?v=g8D5YL6cOSE)
- [Demystifying Support Vector Machines](https://towardsdatascience.com/demystifying-support-vector-machines-8453b39f7368)
- [Support Vector Machine (SVM) - Fun and Easy Machine Learning](https://www.youtube.com/watch?v=Y6RRHw9uN9o)
2019-12-26 20:51:15 +08:00
2020-01-13 07:07:39 +08:00
## Bayes Theorem
2019-12-26 20:51:15 +08:00
2020-02-05 01:42:32 +08:00
- [Bayes theorem, and making probability intuitive](https://www.youtube.com/watch?v=HZGCoVF3YvM)
2020-01-13 07:07:39 +08:00
- [A friendly introduction to Bayes Theorem and Hidden Markov Models](https://www.youtube.com/watch?v=kqSzLo9fenk)
- [The Bayesian Trap](https://www.youtube.com/watch?v=R13BD8qKeTg)
- [Naive Bayes classifier: A friendly approach](https://www.youtube.com/watch?v=Q8l0Vip5YUw)
2019-12-27 01:00:59 +08:00
2020-01-13 07:07:39 +08:00
## K-Means
2019-12-27 01:00:59 +08:00
2020-01-13 07:07:39 +08:00
- [StatQuest: K-means clustering](https://www.youtube.com/watch?v=4b5d3muPQmA)
- [Machine Learning Tutorial Python - 13: K Means Clustering](https://www.youtube.com/watch?v=EItlUEPCIzM)
2020-02-05 01:54:24 +08:00
- [K Means Clustering Algorithm - K Means Example in Python - Machine Learning Algorithms - Edureka](https://www.youtube.com/watch?v=1XqG0kaJVHY)
2019-12-26 20:51:15 +08:00
2020-01-13 07:07:39 +08:00
## K-Nearest Neighbors
2019-12-26 20:51:15 +08:00
2020-01-13 07:07:39 +08:00
- [KNN from Scratch](https://machinelearningmastery.com/tutorial-to-implement-k-nearest-neighbors-in-python-from-scratch/)
- [Machine Learning Basics with the K-Nearest Neighbors Algorithm](https://towardsdatascience.com/machine-learning-basics-with-the-k-nearest-neighbors-algorithm-6a6e71d01761)
2019-12-26 20:51:15 +08:00
2020-01-13 07:07:39 +08:00
## Principal Component Analysis (PCA)
2019-12-26 20:51:15 +08:00
2020-01-13 07:07:39 +08:00
- [StatQuest: PCA main ideas in only 5 minutes!!!](https://www.youtube.com/watch?v=HMOI_lkzW08)
- [StatQuest: Principal Component Analysis (PCA), Step-by-Step](https://www.youtube.com/watch?v=FgakZw6K1QQ)
- [Principal Component Analysis (PCA) by Luis Serrano](https://www.youtube.com/watch?v=g-Hb26agBFg)
2019-12-26 20:51:15 +08:00
2020-01-13 07:07:39 +08:00
## Boosting Machine Learning
2019-12-26 20:51:15 +08:00
2020-01-13 07:07:39 +08:00
- [Boosting Machine Learning Tutorial | Adaptive Boosting, Gradient Boosting, XGBoost | Edureka](https://www.youtube.com/watch?v=kho6oANGu_A)
- [XGBoost Part1: XGBoost Trees for Regression](https://www.youtube.com/watch?v=OtD8wVaFm6E)
2020-01-13 23:26:32 +08:00
- [XGBoost Part 2: XGBoost Trees For Classification](https://www.youtube.com/watch?v=8b1JEDvenQU)
2020-01-13 07:07:39 +08:00
- [AdaBoost, Clearly Explained](https://www.youtube.com/watch?v=LsK-xG1cLYA)
- [Gradient Boost Part 1: Regression Main Ideas](https://www.youtube.com/watch?v=3CC4N4z3GJc)
2019-12-26 20:51:15 +08:00
2020-01-13 07:07:39 +08:00
## Probabilistic Graphical Models
2019-12-26 20:51:15 +08:00
2020-01-13 07:07:39 +08:00
- [Probabilistic Graphical Models Specialization](https://www.coursera.org/specializations/probabilistic-graphical-models)
2019-12-26 20:51:15 +08:00
2020-01-13 07:07:39 +08:00
## Gradient Descent from Scratch
2019-12-26 20:51:15 +08:00
2020-01-13 07:07:39 +08:00
### The Best
2019-12-26 20:51:15 +08:00
2020-01-13 07:07:39 +08:00
- [An overview of gradient descent optimization algorithms](https://ruder.io/optimizing-gradient-descent/index.html)
- [Gradient Descent, Step-by-Step](https://www.youtube.com/watch?v=sDv4f4s2SB8)
- [Stochastic Gradient Descent, Clearly Explained!!!](https://www.youtube.com/watch?v=vMh0zPT0tLI)
- [How Optimization Works](https://end-to-end-machine-learning.teachable.com/p/building-blocks-how-optimization-works) _A short series on the fundamentals of optimization for machine learning_
- [Linear Regression using Gradient Descent](https://towardsdatascience.com/linear-regression-using-gradient-descent-97a6c8700931)
- [Code](https://github.com/chasinginfinity/ml-from-scratch)
- [Polynomial Regression](https://towardsdatascience.com/polynomial-regression-bbe8b9d97491)
- [Gradient Descent in Linear Regression - Math](https://www.geeksforgeeks.org/gradient-descent-in-linear-regression/)
- [Neural Network Backpropagation Basics For Dummies](https://www.youtube.com/watch?v=8d6jf7s6_Qs)
2019-12-26 20:51:15 +08:00
2020-01-13 07:07:39 +08:00
### Extra Good Ones
2019-12-27 01:20:34 +08:00
2020-01-13 07:07:39 +08:00
- [3.4: Linear Regression with Gradient Descent - Intelligence and Learning](https://www.youtube.com/watch?v=L-Lsfu4ab74)
- [3.5: Mathematics of Gradient Descent - Intelligence and Learning](https://www.youtube.com/watch?v=jc2IthslyzM)
- [3.5a: Calculus: Power Rule - Intelligence and Learning](https://www.youtube.com/watch?v=IKb_3FJtA1U)
- [3.5b: Calculus: Chain Rule - Intelligence and Learning](https://www.youtube.com/watch?v=cE6wr0_ad8Y)
- [3.5c: Calculus: Partial Derivative - Intelligence and Learning](https://www.youtube.com/watch?v=-WVBXXV81R4)
2019-12-27 01:00:59 +08:00
2020-01-13 07:07:39 +08:00
### Vanishing Gradient
2019-12-27 01:00:59 +08:00
2020-01-13 07:07:39 +08:00
- [Vanishing Gradient Problem](https://www.youtube.com/watch?v=SKMpmAOUa2Q)
- [How to overcome Vanishing Gradient Problem](https://www.youtube.com/watch?v=puux7KZQfsE)
2020-01-07 20:45:46 +08:00
2020-01-13 07:07:39 +08:00
### How to Handle Local Minima
2020-01-07 20:45:46 +08:00
2020-01-13 07:07:39 +08:00
- https://datascience.stackexchange.com/questions/24534/does-gradient-descent-always-converge-to-an-optimum
- https://datascience.stackexchange.com/questions/18802/does-mlp-always-find-local-minimum
- https://www.coursera.org/learn/deep-neural-network/lecture/RFANA/the-problem-of-local-optima
2020-01-07 20:45:46 +08:00
2020-01-13 07:07:39 +08:00
## Sci-Kit
2019-12-27 01:00:59 +08:00
2020-01-13 07:07:39 +08:00
- [An introduction to machine learning with scikit-learn](https://scikit-learn.org/stable/tutorial/basic/tutorial.html)
- [Python Machine Learning: Scikit-Learn Tutorial](https://www.datacamp.com/community/tutorials/machine-learning-python)
2020-01-11 06:07:59 +08:00
2020-02-11 01:05:23 +08:00
# Deep Learning
2020-01-11 06:07:59 +08:00
2020-02-05 01:42:32 +08:00
- [DEEP BLUEBERRY BOOK](https://mithi.github.io/deep-blueberry/) _This is a tiny and very focused collection of links about deep learning. If you've always wanted to learn deep learning stuff but don't know where to start, you might have stumbled upon the right place!_
2020-01-13 07:07:39 +08:00
- [6.S191: Introduction to Deep Learning (2019)](http://introtodeeplearning.com/2019/)
- [Class Lectures (YouTube) - MIT 6.S191: Introduction to Deep Learning](https://www.youtube.com/playlist?list=PLtBw6njQRU-rwp5__7C0oIVt26ZgjG9NI)
- [Lab](https://github.com/aamini/introtodeeplearning_labs)
- [MIT 6.S191 Introduction to Deep Learning (2020)](http://introtodeeplearning.com/)
2020-01-13 07:10:52 +08:00
- [MIT Deep Learning Basics: Introduction and Overview](https://www.youtube.com/watch?v=O5xeyoRL95U)
2020-01-13 07:07:39 +08:00
- [MIT Deep Learning by Lex Fridman](https://deeplearning.mit.edu/)
2020-01-13 07:10:52 +08:00
- [Deep Learning Lectures (YouTube)](https://www.youtube.com/playlist?list=PLrAXtmErZgOeiKm4sgNOknGvNjby9efdf)
2020-01-13 07:07:39 +08:00
- [Deep Learning in Tamil](https://www.youtube.com/channel/UC2YVnH6aMky1SMdmlo5S9-A)
2020-01-11 06:07:59 +08:00
2020-02-11 01:05:23 +08:00
### Deep Lerning Papers
- [Deep Learning Papers Reading Roadmap](https://github.com/floodsung/Deep-Learning-Papers-Reading-Roadmap)
2020-01-24 08:42:47 +08:00
2020-01-13 07:07:39 +08:00
## NN
2019-12-26 20:51:15 +08:00
2020-01-13 07:07:39 +08:00
- [Machine Learning for Beginners: An Introduction to Neural Networks](https://victorzhou.com/blog/intro-to-neural-networks/) _A simple explanation of how they work and how to implement one from scratch in Python._
- [A Visual and Interactive Guide to the Basics of Neural Networks](https://jalammar.github.io/visual-interactive-guide-basics-neural-networks/)
- [A Visual And Interactive Look at Basic Neural Network Math](https://jalammar.github.io/feedforward-neural-networks-visual-interactive/)
- [Neural Network Architectures](https://www.youtube.com/watch?v=oJNHXPs0XDk)
- [Neural Networks Demystified by Welch Labs](https://www.youtube.com/playlist?list=PLiaHhY2iBX9hdHaRr6b7XevZtgZRa1PoU)
- [Supporting code for short YouTube series Neural Networks Demystified.](https://github.com/stephencwelch/Neural-Networks-Demystified)
2019-12-26 20:51:15 +08:00
2020-02-11 01:05:23 +08:00
## Computer Vision
2020-01-11 06:07:59 +08:00
2020-01-13 07:07:39 +08:00
- [CS131 Computer Vision: Foundations and Applications Fall 2019](http://vision.stanford.edu/teaching/cs131_fall1920/index.html)
- [CS231A: Computer Vision, From 3D Reconstruction to Recognition Winter 2018](http://web.stanford.edu/class/cs231a/)
2020-01-11 06:07:59 +08:00
2020-02-11 01:05:23 +08:00
### CNN
2019-12-26 20:51:15 +08:00
2020-01-13 07:07:39 +08:00
- [CS231n: Convolutional Neural Networks for Visual Recognition Spring 2019](http://cs231n.stanford.edu/)
- [CS231n: Convolutional Neural Networks for Visual Recognition](http://cs231n.github.io/)
- [A friendly introduction to Convolutional Neural Networks and Image Recognition](https://www.youtube.com/watch?v=2-Ol7ZB0MmU)
- [A Comprehensive Guide to Convolutional Neural Networks — the ELI5 way](https://towardsdatascience.com/a-comprehensive-guide-to-convolutional-neural-networks-the-eli5-way-3bd2b1164a53)
- [Convolutional Neural Networks for Beginners](https://towardsdatascience.com/convolutional-neural-networks-for-beginners-practical-guide-with-python-and-keras-dc688ea90dca)
- [Tensorflow Convolutional Neural Network (CNN)](https://www.tensorflow.org/tutorials/images/cnn)
- [Convolutional Networks Book](http://www.deeplearningbook.org/contents/convnets.html)
- [CNNs, Part 1: An Introduction to Convolutional Neural Networks](https://victorzhou.com/blog/intro-to-cnns-part-1/)
- [CS231n Winter 2016 BY Andrej Karpathy 15 Videos](https://www.youtube.com/watch?v=NfnWJUyUJYU&list=PLkt2uSq6rBVctENoVBg1TpCC7OQi31AlC)
2020-01-13 21:56:19 +08:00
- [Intuitive understanding of 1D, 2D, and 3D Convolutions in Convolutional Neural Networks](https://stackoverflow.com/questions/42883547/intuitive-understanding-of-1d-2d-and-3d-convolutions-in-convolutional-neural-n)
2019-12-27 01:00:59 +08:00
2020-02-11 01:05:23 +08:00
### Object Detection
2019-12-27 01:00:59 +08:00
2020-01-13 07:07:39 +08:00
- [YOLO](https://pjreddie.com/darknet/yolo/)
2020-01-28 14:55:45 +08:00
- [YOLO-Object-Counting-API](https://github.com/tugot17/YOLO-Object-Counting-API)
2019-12-26 20:51:15 +08:00
2020-02-11 01:05:23 +08:00
### Image Segmentation
2020-01-11 06:07:59 +08:00
2020-01-13 07:07:39 +08:00
- [Computer Vision Tutorial: A Step-by-Step Introduction to Image Segmentation Techniques (Part 1)](https://www.analyticsvidhya.com/blog/2019/04/introduction-image-segmentation-techniques-python/)
2020-01-11 06:07:59 +08:00
2020-02-11 01:05:23 +08:00
### GANs
2020-01-11 06:07:59 +08:00
2020-01-13 07:07:39 +08:00
- [Face editing with Generative Adversarial Networks](https://www.youtube.com/watch?v=dCKbRCUyop8)
- [Variational Autoencoders](https://www.youtube.com/watch?v=9zKuYvjFFS8)
- [Generative Adversarial Networks (GANs) in 50 lines of code (PyTorch)](https://medium.com/@devnag/generative-adversarial-networks-gans-in-50-lines-of-code-pytorch-e81b79659e3f)
- [Generative Models](https://openai.com/blog/generative-models/)
2020-01-11 06:07:59 +08:00
2020-01-13 07:07:39 +08:00
## NLP
2020-01-11 06:07:59 +08:00
2020-01-13 07:07:39 +08:00
- [CS224n: Natural Language Processing with Deep Learning](http://web.stanford.edu/class/cs224n/)
2020-01-28 14:55:45 +08:00
- [NLP and The Reformer](https://www.youtube.com/watch?v=rNG_hpSyZcE)
2020-01-11 06:07:59 +08:00
2020-01-13 07:07:39 +08:00
### RNN
2019-12-26 20:51:15 +08:00
2020-01-13 07:07:39 +08:00
- [An Introduction to Recurrent Neural Networks for Beginners](https://victorzhou.com/blog/intro-to-rnns/) _A simple walkthrough of what RNNs are, how they work, and how to build one from scratch in Python._
- [A Visual Guide to Using BERT for the First Time](https://jalammar.github.io/a-visual-guide-to-using-bert-for-the-first-time/)
- [The Illustrated GPT-2 (Visualizing Transformer Language Models)](https://jalammar.github.io/illustrated-gpt2/)
- [The Illustrated Word2vec](https://jalammar.github.io/illustrated-word2vec/)
- [The Illustrated BERT, ELMo, and co. (How NLP Cracked Transfer Learning)](https://jalammar.github.io/illustrated-bert/)
- [The Illustrated Transformer](https://jalammar.github.io/illustrated-transformer/)
- [The Unreasonable Effectiveness of Recurrent Neural Networks by Andrej Karpathy](http://karpathy.github.io/2015/05/21/rnn-effectiveness/)
- [Attention and Augmented Recurrent Neural Networks by Distill](https://distill.pub/2016/augmented-rnns/)
- [Visualizing memorization in RNNs by Distill](https://distill.pub/2019/memorization-in-rnns/) _Inspecting gradient magnitudes in context can be a powerful tool to see when recurrent units use short-term or long-term contextual understanding._
2019-12-28 03:02:39 +08:00
2020-01-13 07:07:39 +08:00
### LSTM
2019-12-28 03:02:39 +08:00
2020-01-13 07:07:39 +08:00
- [LSTM implementation explained](https://apaszke.github.io/lstm-explained.html)
- [A Gentle Introduction to LSTM Autoencoders](https://machinelearningmastery.com/lstm-autoencoders/)
- [Keras LSTM tutorial How to easily build a powerful deep learning language model](http://adventuresinmachinelearning.com/keras-lstm-tutorial/)
2019-12-26 20:51:15 +08:00
2020-01-13 07:07:39 +08:00
### BERT
2019-12-26 20:51:15 +08:00
2020-01-13 07:07:39 +08:00
- [A Visual Guide to Using BERT for the First Time](https://jalammar.github.io/a-visual-guide-to-using-bert-for-the-first-time/)
- [BERT Explained: State of the art language model for NLP](https://towardsdatascience.com/bert-explained-state-of-the-art-language-model-for-nlp-f8b21a9b6270)
- [BERT State of the Art Language Model for NLP](https://www.lyrn.ai/2018/11/07/explained-bert-state-of-the-art-language-model-for-nlp/)
- [BioBERT, a language representation model for biomedical domain, especially designed for biomedical text mining tasks such as biomedical named entity recognition, relation extraction, question answering, etc](https://github.com/dmis-lab/biobert)
2019-12-26 20:51:15 +08:00
2020-01-13 18:52:48 +08:00
## Reinforcement Learning
2019-12-27 01:00:59 +08:00
2020-02-05 01:19:30 +08:00
- [Deep Reinforcement Learning Course 🕹️](https://simoninithomas.github.io/Deep_reinforcement_learning_Course/) _A Free course in Deep Reinforcement Learning from beginner to expert._
2020-01-13 07:07:39 +08:00
- [Implementation of Reinforcement Learning Algorithms. Python, OpenAI Gym, Tensorflow. Exercises and Solutions to accompany Sutton's Book and David Silver's course.](https://github.com/dennybritz/reinforcement-learning)
- [Unity Machine Learning Agents Toolkit](https://github.com/Unity-Technologies/ml-agents)
- [🖥️ WRITING MY FIRST MACHINE LEARNING GAME! (1/4)](https://www.youtube.com/watch?v=ZX2Hyu5WoFg)
- [Deep Reinforcement Learning: Pong from Pixels by Andrej Karpathy](http://karpathy.github.io/2016/05/31/rl/)
- [A Beginner's Guide to Deep Reinforcement Learning](https://pathmind.com/wiki/deep-reinforcement-learning)
2020-02-05 01:19:30 +08:00
- [An Introduction to Unity ML-Agents](https://towardsdatascience.com/an-introduction-to-unity-ml-agents-6238452fcf4c)
2020-02-07 21:53:57 +08:00
- [Deep Reinforcement Learning Algorithms with PyTorch](https://github.com/p-christ/Deep-Reinforcement-Learning-Algorithms-with-PyTorch)
2019-12-27 01:00:59 +08:00
2020-01-13 07:07:39 +08:00
## PyTorch
2019-12-26 20:51:15 +08:00
2020-01-13 07:07:39 +08:00
- [Udacity : Deep Learning with PyTorch](https://classroom.udacity.com/courses/ud188)
- [Deep Learning (PyTorch) : Code](https://github.com/udacity/deep-learning-v2-pytorch)
- [Udacity : Secure AI](https://classroom.udacity.com/courses/ud185)
- [TORCHSCRIPT](https://pytorch.org/docs/stable/jit.html)
- [PyTorchZeroToAll (in English) Sung Kim a Series of 14 Videos](https://www.youtube.com/playlist?list=PLlMkM4tgfjnJ3I-dbhO9JTw7gNty6o_2m)
- [Supporting Code](https://github.com/hunkim/PyTorchZeroToAll)
- [Slides](https://drive.google.com/drive/folders/0B41Zbb4c8HVyUndGdGdJSXd5d3M)
2019-12-26 20:51:15 +08:00
2020-01-13 07:07:39 +08:00
## TensorFlow
2019-12-26 20:51:15 +08:00
2020-01-13 07:07:39 +08:00
- [Introduction to TensorFlow 2.0: Easier for beginners, and more powerful for experts (TF World '19)](https://www.youtube.com/watch?v=5ECD8J3dvDQ)
- [TensorFlow Lite: Solution for running ML on-device (TF World '19)](https://www.youtube.com/watch?v=0SpZy7iouFU)
- [Machine Learning in JavaScript (TensorFlow Dev Summit 2018)](https://www.youtube.com/watch?v=YB-kfeNIPCE)
- [TensorFlow.js Quick Start](https://www.youtube.com/watch?v=Y_XM3Bu-4yc)
- [Intro to TensorFlow for Deep Learning](https://classroom.udacity.com/courses/ud187)
- [Keras vs. tf.keras: Whats the difference in TensorFlow 2.0?](https://www.pyimagesearch.com/2019/10/21/keras-vs-tf-keras-whats-the-difference-in-tensorflow-2-0/)
- [How To Run TensorFlow Lite on Raspberry Pi for Object Detection](https://www.youtube.com/watch?v=aimSGOAUI8Y)
- [How computers learn to recognize objects instantly | Joseph Redmon](https://www.youtube.com/watch?v=Cgxsv1riJhI)
2019-12-26 20:51:15 +08:00
2020-01-13 07:07:39 +08:00
### PyTorch Vs TensorFlow
2020-01-07 20:45:46 +08:00
2020-01-13 07:07:39 +08:00
- [Why is PyTorch becoming so popular among machine learning engineers?](https://www.quora.com/Why-is-PyTorch-becoming-so-popular-among-machine-learning-engineers)
2020-01-07 20:45:46 +08:00
2020-01-13 07:07:39 +08:00
## Transfer Learning
2019-12-26 20:51:15 +08:00
2020-01-13 07:07:39 +08:00
- [Transfer Learning with Keras and Deep Learning](https://www.pyimagesearch.com/2019/05/20/transfer-learning-with-keras-and-deep-learning/)
- [A Comprehensive Hands-on Guide to Transfer Learning with Real-World Applications in Deep Learning](https://towardsdatascience.com/a-comprehensive-hands-on-guide-to-transfer-learning-with-real-world-applications-in-deep-learning-212bf3b2f27a)
- [TensorFlow Core Tutorials](https://www.tensorflow.org/tutorials)
2019-12-26 20:51:15 +08:00
2020-01-13 07:07:39 +08:00
## Deploy Models
2019-12-26 20:51:15 +08:00
2020-01-13 07:07:39 +08:00
- [Machine Learning in 5 Minutes: How to deploy a ML model (SurveyMonkey Engineer explains)](https://www.youtube.com/watch?v=XsD2u7hAwI8)
- [Deploy Machine Learning Models with Django](https://www.deploymachinelearning.com/)
2020-01-13 07:55:49 +08:00
- [MlFlow - An open source platform for the machine learning lifecycle](https://mlflow.org/)
2020-01-24 08:42:47 +08:00
- [TensorFlow: Data and Deployment Specialization](https://www.coursera.org/specializations/tensorflow-data-and-deployment)
2019-12-26 20:51:15 +08:00
2020-01-13 07:07:39 +08:00
## Code
2019-12-27 01:20:34 +08:00
2020-01-13 07:07:39 +08:00
- [codebasics/py](https://github.com/codebasics/py)
- [Google Codelabs](https://codelabs.developers.google.com/)
2019-12-27 01:20:34 +08:00
2020-01-13 07:07:39 +08:00
## CheetSheets
2019-12-27 01:20:34 +08:00
2020-01-13 07:07:39 +08:00
- [Data-Science--Cheat-Sheet](https://github.com/abhat222/Data-Science--Cheat-Sheet)
2019-12-27 01:20:34 +08:00
2020-01-13 07:07:39 +08:00
## GPU
2020-01-11 06:07:59 +08:00
2020-01-13 07:07:39 +08:00
- [Why GPUs](https://course.fast.ai/gpu_tutorial.html)
2020-01-11 06:07:59 +08:00
2020-01-13 07:07:39 +08:00
## Edge ML Kits
2020-01-11 06:07:59 +08:00
2020-01-13 07:07:39 +08:00
- [Nvidia Jetson Nano Developer Kit](https://developer.nvidia.com/embedded/jetson-nano-developer-kit)
- [Intel® Neural Compute Stick 2 (Intel® NCS2)](https://software.intel.com/en-us/neural-compute-stick)
- [Coral](https://coral.ai/)
2020-01-11 06:07:59 +08:00
2020-01-13 07:55:49 +08:00
## Data Science Competitions
- [Kaggle](https://www.kaggle.com/)
- [How to Win a Data Science Competition: Learn from Top Kagglers](https://www.coursera.org/learn/competitive-data-science/)
2020-02-06 02:13:06 +08:00
## Important Youtube🎬 Channels in the field of AI/ML/RL/DS
2020-02-06 01:13:26 +08:00
- [3Blue1Brown](https://www.youtube.com/channel/UCYO_jab_esuFRV4b17AJtAw)
- [StatQuest with Josh Starmer](https://www.youtube.com/user/joshstarmer)
- [Sentdex](https://www.youtube.com/user/sentdex)
- [Luis Serrano](https://www.youtube.com/channel/UCgBncpylJ1kiVaPyP-PZauQ)
- [Brandon Rohrer](https://www.youtube.com/user/BrandonRohrer)
- [deeplizard](https://www.youtube.com/channel/UC4UJ26WkceqONNF5S26OiVw)
- [Tech With Tim](https://www.youtube.com/channel/UC4JX40jDee_tINbkjycV4Sg)
- [Microsoft Research](https://www.youtube.com/user/MicrosoftResearch)
- [Corey Schafer](https://www.youtube.com/user/schafer5)
- [Data School](https://www.youtube.com/user/dataschool)
- [Two Minute Papers](https://www.youtube.com/user/keeroyz)
- [Welch Labs](https://www.youtube.com/user/Taylorns34)
- [Simplilearn](https://www.youtube.com/user/Simplilearn)
- [Great Learning](https://www.youtube.com/user/beaconelearning)
- [DeepLearning.TV](https://www.youtube.com/channel/UC9OeZkIwhzfv-_Cb7fCikLQ)
- [TensorFlow](https://www.youtube.com/channel/UC0rqucBdTuFTjJiefW5t-IQ)
- [Deeplearning.ai](https://www.youtube.com/channel/UCcIXc5mJsHVYTZR1maL5l9w)
- [Code Bullet](https://www.youtube.com/channel/UC0e3QhIYukixgh5VVpKHH9Q)
- [edureka!](https://www.youtube.com/user/edurekaIN)
- [Lex Fridman](https://www.youtube.com/channel/UCSHZKyawb77ixDdsGog4iWA)
- [The Artificial Intelligence Channe](https://www.youtube.com/user/Maaaarth)
- [freeCodeCamp.org](https://www.youtube.com/channel/UC8butISFwT-Wl7EV0hUK0BQ)
- [CloudxLab](https://www.youtube.com/channel/UC8mJ6DL1Q32UWyJUceoO8Jw)
- [Alexander Amini](https://www.youtube.com/user/Zan560)
- [Jeff Heaton](https://www.youtube.com/user/HeatonResearch)
- [Abhishek Thakur](https://www.youtube.com/user/abhisheksvnit)
- [The Coding Train](https://www.youtube.com/user/shiffman)
2020-02-11 01:05:23 +08:00
## This Repo is Maintained by
- [Navaneeth Malingan](https://www.linkedin.com/in/nivu/)
2020-01-13 07:07:39 +08:00
## Reference
2020-01-07 20:45:46 +08:00
2020-01-13 07:07:39 +08:00
- [🖥️ HOW TO GET STARTED WITH MACHINE LEARNING!](https://www.youtube.com/watch?v=I74ymkoNTnw)
- [My Self-Created Artificial Intelligence Masters Degree](https://hackernoon.com/my-self-created-ai-masters-degree-ddc7aae92d0e)
- https://end-to-end-machine-learning.teachable.com/courses/667372/lectures/11900568
- [ML Fundamentals by StatQuest](https://www.youtube.com/watch?v=Gv9_4yMHFhI&list=PLblh5JKOoLUICTaGLRoHQDuF_7q2GfuJF)
- [Machine Learning with Python by sentdex](https://www.youtube.com/playlist?list=PLQVvvaa0QuDfKTOs3Keq_kaG2P55YRn5v)
- [5 Beginner Friendly Steps to Learn Machine Learning and Data Science with Python - Daniel Bourke](https://www.mrdbourke.com/5-beginner-friendly-steps-to-learn-machine-learning/)
- [Data School](https://www.dataschool.io/)
- [Neural Networks and Deep Learning](http://neuralnetworksanddeeplearning.com/)
- https://www.machinelearningisfun.com/
- https://medium.com/@ageitgey/machine-learning-is-fun-80ea3ec3c471
- https://medium.com/greyatom
- https://greyatom.com/glabs
- [John Searle: "Consciousness in Artificial Intelligence" | Talks at Google](https://www.youtube.com/watch?v=rHKwIYsPXLg)
- [ML Terms](https://docs.google.com/document/d/15ZFIglX3oPtk9R_tIdxigc-mG0l2RPAoQFPFFaVw6cc)
- https://github.com/nature-of-code/NOC-S17-2-Intelligence-Learning/tree/master/week3-classification-regression
- https://github.com/nature-of-code/NOC-S17-2-Intelligence-Learning