An Ultimate Compilation of AI Resources for Mathematics, Machine Learning and Deep Learning

Knowledge Not Shared is wasted - Clan Jacobs

This collection is a compilation of Excellent ML and DL Tutorials created by the people below

• Andrej Karpathy blog
• Brandon Roher
• Andrew Trask
• Jay Alammar
• Sebastian Ruder
• Distill
• StatQuest with Josh Starmer
• sentdex
• Lex Fridman
• 3Blue1Brown
• Alexander Amini
• The Coding Train

Communities to Follow

• Coimbatore School of AI
  • Join here🔗⬇️
  • Meetup : Coimbatore School of AI
  • Telegram : For Daily Updates
  • Facebook : Coimbatore School of AI
• TensorFlow User Group Coimbatore
  • Meetup : TFUGCbe
  • Facebook : TFUGCbe
• Omdena - Building AI for Good - By the People, For the People

Why Data Science and how to get started ?

• 🖥️ HOW TO GET STARTED WITH MACHINE LEARNING!
• How to Build a Meaningful Career in Data Science
• My Self-Created Artificial Intelligence Masters Degree
• PyImageSearch

Intro to ML

• A Gentle Introduction to Machine Learning

MOOCs

• Machine Learning by Andrew Ng, Stanford IMDB 10/10 LOL :P
• Datacamp : Data Engineer with Python
• Intro to Machine Learning Topics Covered Naive Bayes, SVM, Decision Trees, Regressions, Outliers, Clustering, Feature Scaling, Text Learning, Feature Selection, PCA, Validation, Evaluation Metrics
• Intro to TensorFlow for Deep Learning The Best Course for Learning TensorFlow
• End-to-End Machine Learning
• NVIDIA DEEP LEARNING INSTITUTE
• Introduction to Machine Learning for Coders!
• Practical Deep Learning for Coders, v3
• FastAI

YouTube ML Playlists

• Machine Learning by StatQuest with Josh Starmer
• Intelligence and Learning by The Coding Train

Machine Learning Fundamentals (These terms will be often used in the below algorithms)

• Bias and Variance
• Cross Validation
• Sensitivity and Specivicity
• ROC and AUC, Clearly Explained!
• StatQuest: R-squared explained
• StatQuest: P Values, clearly explained
• Machine Learning Fundamentals: The Confusion Matrix
• Regularization Part 1: Ridge Regression
• Regularization Part 2: Lasso Regression
• Maximum Likelihood
• Covariance and Correlation Part 1: Covariance
• Statistics Fundamentals: The Mean, Variance and Standard Deviation
• Statistics Fundamentals: Population Parameters
• Glossary: Statistics
• Glossary: Machine Learning

Math

• Mathematics for Machine Learning In this post I have compiled great e-resources (MOOC, YouTube Lectures, Books) for learning Mathematics for Machine Learning.
• I highly Recommend you to go through the following resources by 3Blue1Brown
  • Essence of Linear Algrbra
  • Essene of Calculus
  • Differential equations
• Gilbert Strang: Linear Algebra vs Calculus
• Basics of Integral Calculus in Tamil
• New fast.ai course: Computational Linear Algebra
• Linear Algebra Book

Numpy

• A Visual Intro to NumPy and Data Representation
• CS231n : Python Numpy Tutorial
• NumPy resources : part of the End-to-End Machine Learning library
• 100 numpy exercises (with solutions)
• 101 NumPy Exercises for Data Analysis (Python)
• Numpy Tutorial – Introduction to ndarray
• Sci-Py Lectures : NumPy: creating and manipulating numerical data
• Python NumPy Tutorial for Beginners Learn the basics of the NumPy library in this tutorial for beginners. It provides background information on how NumPy works and how it compares to Python’s Built-in lists. This video goes through how to write code with NumPy. It starts with the basics of creating arrays and then gets into more advanced stuff. The video covers creating arrays, indexing, math, statistics, reshaping, and more.
• Python NumPy Tutorial – Learn NumPy Arrays With Examples
• Python Numpy Array Tutorial
• NumPy Tutorial: Data analysis with Python
• Deep Learning Prerequisites: The Numpy Stack in Python

Pandas

• A Gentle Visual Intro to Data Analysis in Python Using Pandas
• 10 minutes to pandas
• Python Pandas Tutorial: A Complete Introduction for Beginners

Simple ML Playlist from CodeBasics

• Machine Learning Tutorial Python

Linear Regression

• Linear Regression: A friendly introduction by Luis Serrano
• Statistics 101: Linear Regression, The Very Basics
• All Types of Regression

Logistic Regression

• Linear Regression vs Logistic Regression | Data Science Training | Edureka
• Logistic Regression and the Perceptron Algorithm: A friendly introduction by Luis Serrano

Decission Tree

• StatQuest: Decision Trees
• StatQuest: Decision Trees, Part 2 - Feature Selection and Missing Data
• Decision Tree Introduction with example
• Decision Tree
• Python | Decision Tree Regression using sklearn
• ML | Logistic Regression v/s Decision Tree Classification

Random Forest

• StatQuest: Random Forests Part 1 - Building, Using and Evaluating
• StatQuest: Random Forests Part 2: Missing data and clustering
• Random Forests for Complete Beginners

SVM

• Support Vector Machines (SVMs): A friendly introduction by Luis Serrano
• Support Vector Machines, Clearly Explained!!! by StatQuest
• Support Vector Machines Part 2: The Polynomial Kernel by StatQuest
• Support Vector Machines Part 3: The Radial (RBF) Kernel by StatQuest
• How Support Vector Machines work / How to open a black box
• Support Vector Machines - The Math of Intelligence (Week 1)
• Demystifying Support Vector Machines
• Support Vector Machine (SVM) - Fun and Easy Machine Learning

Bayes Theorem

• Bayes theorem, and making probability intuitive
• A friendly introduction to Bayes Theorem and Hidden Markov Models
• The Bayesian Trap
• Naive Bayes classifier: A friendly approach

K-Means

• StatQuest: K-means clustering
• Machine Learning Tutorial Python - 13: K Means Clustering
• K Means Clustering Algorithm - K Means Example in Python - Machine Learning Algorithms - Edureka

K-Nearest Neighbors

• KNN from Scratch
• Machine Learning Basics with the K-Nearest Neighbors Algorithm

Principal Component Analysis (PCA)

• StatQuest: PCA main ideas in only 5 minutes!!!
• StatQuest: Principal Component Analysis (PCA), Step-by-Step
• Principal Component Analysis (PCA) by Luis Serrano

Boosting Machine Learning

• Boosting Machine Learning Tutorial | Adaptive Boosting, Gradient Boosting, XGBoost | Edureka
• XGBoost Part1: XGBoost Trees for Regression
• XGBoost Part 2: XGBoost Trees For Classification
• AdaBoost, Clearly Explained
• Gradient Boost Part 1: Regression Main Ideas

Probabilistic Graphical Models

• Probabilistic Graphical Models Specialization

Gradient Descent from Scratch

The Best

• An overview of gradient descent optimization algorithms
• Gradient Descent, Step-by-Step
• Stochastic Gradient Descent, Clearly Explained!!!
• How Optimization Works A short series on the fundamentals of optimization for machine learning
• Linear Regression using Gradient Descent
  • Code
• Polynomial Regression
• Gradient Descent in Linear Regression - Math
• Neural Network Backpropagation Basics For Dummies

Extra Good Ones

• 3.4: Linear Regression with Gradient Descent - Intelligence and Learning
• 3.5: Mathematics of Gradient Descent - Intelligence and Learning
• 3.5a: Calculus: Power Rule - Intelligence and Learning
• 3.5b: Calculus: Chain Rule - Intelligence and Learning
• 3.5c: Calculus: Partial Derivative - Intelligence and Learning

Vanishing Gradient

• Vanishing Gradient Problem
• How to overcome Vanishing Gradient Problem

How to Handle Local Minima

• https://datascience.stackexchange.com/questions/24534/does-gradient-descent-always-converge-to-an-optimum
• https://datascience.stackexchange.com/questions/18802/does-mlp-always-find-local-minimum
• https://www.coursera.org/learn/deep-neural-network/lecture/RFANA/the-problem-of-local-optima

Sci-Kit

• An introduction to machine learning with scikit-learn
• Python Machine Learning: Scikit-Learn Tutorial

Deep Learning

• DEEP BLUEBERRY BOOK This is a tiny and very focused collection of links about deep learning. If you’ve always wanted to learn deep learning stuff but don’t know where to start, you might have stumbled upon the right place!
• 6.S191: Introduction to Deep Learning (2019)
  • Class Lectures (YouTube) - MIT 6.S191: Introduction to Deep Learning
  • Lab
• MIT 6.S191 Introduction to Deep Learning (2020)
• MIT Deep Learning Basics: Introduction and Overview
• MIT Deep Learning by Lex Fridman
  • Deep Learning Lectures (YouTube)
• Deep Learning in Tamil

Deep Lerning Papers

NN

• Machine Learning for Beginners: An Introduction to Neural Networks A simple explanation of how they work and how to implement one from scratch in Python.
• A Visual and Interactive Guide to the Basics of Neural Networks
• A Visual And Interactive Look at Basic Neural Network Math
• Neural Network Architectures
• Neural Networks Demystified by Welch Labs
  • Supporting code for short YouTube series Neural Networks Demystified.

Computer Vision

• CS131 Computer Vision: Foundations and Applications Fall 2019
• CS231A: Computer Vision, From 3D Reconstruction to Recognition Winter 2018

CNN

• CS231n: Convolutional Neural Networks for Visual Recognition Spring 2019
• CS231n: Convolutional Neural Networks for Visual Recognition
• A friendly introduction to Convolutional Neural Networks and Image Recognition
• A Comprehensive Guide to Convolutional Neural Networks — the ELI5 way
• Convolutional Neural Networks for Beginners
• Tensorflow Convolutional Neural Network (CNN)
• Convolutional Networks Book
• CNNs, Part 1: An Introduction to Convolutional Neural Networks
• CS231n Winter 2016 BY Andrej Karpathy 15 Videos
• Intuitive understanding of 1D, 2D, and 3D Convolutions in Convolutional Neural Networks

Object Detection

• YOLO
• YOLO-Object-Counting-API

Image Segmentation

• Computer Vision Tutorial: A Step-by-Step Introduction to Image Segmentation Techniques (Part 1)

GANs

• Face editing with Generative Adversarial Networks
• Variational Autoencoders
• Generative Adversarial Networks (GANs) in 50 lines of code (PyTorch)
• Generative Models

NLP

• CS224n: Natural Language Processing with Deep Learning
• NLP and The Reformer

RNN

• An Introduction to Recurrent Neural Networks for Beginners A simple walkthrough of what RNNs are, how they work, and how to build one from scratch in Python.
• A Visual Guide to Using BERT for the First Time
• The Illustrated GPT-2 (Visualizing Transformer Language Models)
• The Illustrated Word2vec
• The Illustrated BERT, ELMo, and co. (How NLP Cracked Transfer Learning)
• The Illustrated Transformer
• The Unreasonable Effectiveness of Recurrent Neural Networks by Andrej Karpathy
• Attention and Augmented Recurrent Neural Networks by Distill
• Visualizing memorization in RNNs by Distill Inspecting gradient magnitudes in context can be a powerful tool to see when recurrent units use short-term or long-term contextual understanding.

LSTM

• LSTM implementation explained
• A Gentle Introduction to LSTM Autoencoders
• Keras LSTM tutorial – How to easily build a powerful deep learning language model

BERT

• A Visual Guide to Using BERT for the First Time
• BERT Explained: State of the art language model for NLP
• BERT – State of the Art Language Model for NLP
• BioBERT, a language representation model for biomedical domain, especially designed for biomedical text mining tasks such as biomedical named entity recognition, relation extraction, question answering, etc

Reinforcement Learning

• Deep Reinforcement Learning Course 🕹️ A Free course in Deep Reinforcement Learning from beginner to expert.
• Implementation of Reinforcement Learning Algorithms. Python, OpenAI Gym, Tensorflow. Exercises and Solutions to accompany Sutton’s Book and David Silver’s course.
• Unity Machine Learning Agents Toolkit
• 🖥️ WRITING MY FIRST MACHINE LEARNING GAME! (1/4)
• Deep Reinforcement Learning: Pong from Pixels by Andrej Karpathy
• A Beginner’s Guide to Deep Reinforcement Learning
• An Introduction to Unity ML-Agents

PyTorch

• Udacity : Deep Learning with PyTorch
• Deep Learning (PyTorch) : Code
• Udacity : Secure AI
• TORCHSCRIPT
• PyTorchZeroToAll (in English) Sung Kim a Series of 14 Videos
  • Supporting Code
  • Slides

TensorFlow

• Introduction to TensorFlow 2.0: Easier for beginners, and more powerful for experts (TF World ’19)
• TensorFlow Lite: Solution for running ML on-device (TF World ’19)
• Machine Learning in JavaScript (TensorFlow Dev Summit 2018)
• TensorFlow.js Quick Start
• Intro to TensorFlow for Deep Learning
• Keras vs. tf.keras: What’s the difference in TensorFlow 2.0?
• How To Run TensorFlow Lite on Raspberry Pi for Object Detection
• How computers learn to recognize objects instantly | Joseph Redmon

PyTorch Vs TensorFlow

• Why is PyTorch becoming so popular among machine learning engineers?

Transfer Learning

• Transfer Learning with Keras and Deep Learning
• A Comprehensive Hands-on Guide to Transfer Learning with Real-World Applications in Deep Learning
• TensorFlow Core Tutorials

Deploy Models

• Machine Learning in 5 Minutes: How to deploy a ML model (SurveyMonkey Engineer explains)
• Deploy Machine Learning Models with Django
• MlFlow - An open source platform for the machine learning lifecycle
• TensorFlow: Data and Deployment Specialization

Code

• codebasics/py
• Google Codelabs

CheetSheets

• Data-Science–Cheat-Sheet

GPU

• Why GPUs

Edge ML Kits

• Nvidia Jetson Nano Developer Kit
• Intel® Neural Compute Stick 2 (Intel® NCS2)
• Coral

Data Science Competitions

• Kaggle
• How to Win a Data Science Competition: Learn from Top Kagglers

Important Youtube🎬 Channels in the field of AI/ML/RL/DS

• 3Blue1Brown
• StatQuest with Josh Starmer
• Sentdex
• Luis Serrano
• Brandon Rohrer
• deeplizard
• Tech With Tim
• Microsoft Research
• Corey Schafer
• Data School
• Two Minute Papers
• Welch Labs
• Simplilearn
• Great Learning
• DeepLearning.TV
• TensorFlow
• Deeplearning.ai
• Code Bullet
• edureka!
• Lex Fridman
• The Artificial Intelligence Channe
• freeCodeCamp.org
• CloudxLab
• Alexander Amini
• Jeff Heaton
• Abhishek Thakur
• The Coding Train

Reference

• 🖥️ HOW TO GET STARTED WITH MACHINE LEARNING!
• My Self-Created Artificial Intelligence Masters Degree
• https://end-to-end-machine-learning.teachable.com/courses/667372/lectures/11900568
• ML Fundamentals by StatQuest
• Machine Learning with Python by sentdex
• 5 Beginner Friendly Steps to Learn Machine Learning and Data Science with Python - Daniel Bourke
• Data School
• Neural Networks and Deep Learning
• https://www.machinelearningisfun.com/
• https://medium.com/@ageitgey/machine-learning-is-fun-80ea3ec3c471
• https://medium.com/greyatom
• https://greyatom.com/glabs
• Teachable Machine Train a computer to recognize your own images, sounds, & poses. A fast, easy way to create machine learning models for your sites, apps, and more – no expertise or coding required.
• John Searle: “Consciousness in Artificial Intelligence” | Talks at Google
• ML Terms
• https://github.com/nature-of-code/NOC-S17-2-Intelligence-Learning/tree/master/week3-classification-regression
• https://github.com/nature-of-code/NOC-S17-2-Intelligence-Learning