deep_learning_resource.md

layout	page
title	Online Deep Learning Resource
permalink	/education/deep_learning_resource/

Online Deep Learning Resource

In this page you will find a list of free Deep Learning resources accessible online. While not comprehensive, it should provide a good introduction to the field.

If you would like to contribute to the list, please get in touch with Twin at t.karmakharm@sheffield.ac.uk

• General Machine Learning & Deep Learning

  • Reading with Practical exercises
    • Online book & Exercises by Michael Nielson
    • Stanford DL tutorial
  • Reading
    • Online book Ian Goofellow et al
    • Yann Lecun's NYU spring 2017 DL course - Slides & course notes
  • Video
    • Andrew Ng's Machine Learning Coursera module - Provides excellent foundation on ML techniques
    • Andrew Ng's Neural Network and Deep Learning Module

• A list of other ML algorithms to be aware of

• DL network architecture

  • Convolution networks (visual recognition, image classification & image segmentation)
    • Convolution Neural Networks for visual recognition, Stanford Course
  • Recurrent networks (sequences, audio, video & NLP)
    • Deep Learning for Natural Language Processing, Stanford Course
  • Unsupervised pretraining networks
    • Autoencoder
    • Deep Belief Networks
    • Generative Adversarial Networks

• Interactive & Demonstrators

  • Tensorflow playground
  • Stanford ConvnetJS

• Major DL software packages

  • Caffe
  • Caffe2
  • Tensorflow
  • Theano
  • Torch
  • PyTorch
  • CNTK
  • Keras - Wrapper over Tensorflow, Theano and CNTK
  • DIGITS - GUI and scheduler that uses Caffe and Torch backend

• Datasets

  • MNIST - Handwritten digits dataset
  • Cifar/TinyImages - Small images classfication
  • Imagenet - Image classification
  • COCO - Image classification and object segmentation
  • Kaggle - Various datasets and competitions

• Blog post on more specific DL/ML topics

  • Colah's blog
  • Andrej Karpathy's blog

• Interesting Applications and news

  • Converting photos to a particular art style
  • Google's deep dream
  • AlphaGo
  • Nvidia's AI news portal

• Deep Learning resource aggregate

  • deeplearning.net
  • Nvidia deep learning resources