Awesome Deep learning papers and other resources

A list of recent papers regarding deep learning and deep reinforcement learning. They are sorted by time to see the recent papers first.
I will renew the recent papers and add notes to these papers.

You should find the papers and software with star flag are more important or popular.

Table of Contents

• Papers


• Model Zoo


• Pretrained Model


• Courses


• Books


• Tutorials


• Software


• Applications


• Awesome Projects


• Corpus

Papers

• 2020 year
  
  
  • deep learning
  
  
  • deep reinforcement learning
  
  
  • natural language process
  
  
  • computer vision
  
  
  
  


• 2019 year
  
  
  • deep learning
  
  
  • deep reinforcement learning
  
  
  • natural language process
  
  
  • computer vision
  
  
  
  


• 2018 year
  
  
  • deep learning
  
  
  • deep reinforcement learning
  
  
  • natural language process
  
  
  • computer vision
  
  
  
  


• 2017 year
  
  
  • deep learning
  
  
  • deep reinforcement learning
  
  
  • natural language process
  
  
  • computer vision
  
  
  
  


• 2016 year
  
  
  • deep learning
  
  
  • deep reinforcement learning
  
  
  • natural language process
  
  
  • computer vision
  
  
  
  


• 2015 year


• 2014 year


• 2013 year


• 2012 year


• 2011 year


• 2010 year


• before 2010 year

Model Zoo

• 2012 | AlexNet: ImageNet Classification with Deep Convolutional Neural Networks. pdf code


• 2013 | RCNN: Rich feature hierarchies for accurate object detection and semantic segmentation. arxiv code


• 2014 | CGNA: Conditional Generative Adversarial Nets. arxiv code


• 2014 | DeepFaceVariant: Deep Learning Face Representation from Predicting 10,000 Classes. pdf code


• 2014 | GAN: Generative Adversarial Networks. arxiv code


• 2014 | GoogLeNet: Going Deeper with Convolutions. pdf code

More details in Model Zoo

Pre Trained Model

• Aligning the fastText vectors of 78 languages


• Available pretrained word embeddings


• Inception-v3 of imagenet


• Caffe2 Model Repository

More details in Pretrained Model

Courses

• [Berkeley] CS294: Deep Reinforcement Learning


• [Berkeley] Stat212b：Topics Course on Deep Learning


• [CUHK] ELEG 5040: Advanced Topics in Signal Processing(Introduction to Deep Learning)


• [CMU] Deep Reinforcement Learning and Control


• [CMU] Neural networks for NLP
  )

More details in courses

Books

• Deep Learning by Ian Goodfellow, Yoshua Bengio, and Aaron Courville. 中文版本


• Deep Learning Tutorial by LISA lab, University of Montreal


• Deep Learning Crash Course


• Documentation on all topics that I learn on both Artificial intelligence and machine learning.


• Interpretable Machine Learning


• Deep Learning and the Game of Go


• Deep Learning for Search


• Deep Learning with PyTorch


• Deep Reinforcement Learning in Action


• Grokking Deep Reinforcement Lerning


• Grokking Deep Learning for Computer Vision


• Probabilistic Deep Learning with Python


• Math and Architectures of Deep Learning

More details in books

Tutorials

• UFLDL Tutorial 1


• UFLDL Tutorial 2


• Deep Learning for NLP (without Magic)


• A Deep Learning Tutorial: From Perceptrons to Deep Networks


• Deep Learning from the Bottom up


• Theano Tutorial


• TensorFlow tutorials


• Deep Learning with R in Motion


• Grokking Deep Learning in Motion


• Machine Learning, Data Science and Deep Learning with Python

More details in tutorials

Software

• Keras Deep Learning library for Theano and TensorFlow. :star:


• Kur Descriptive Deep Learning. :star:


• Caffe Deep learning framework by the BVLC :star:


• CNTK The Microsoft Cognitive Toolkit.


• Dlib A modern C++ toolkit containing machine learning algorithms and tools for creating complex software in C++.


• PyTorch Tensors and Dynamic neural networks in Python with strong GPU acceleration. :star:


• Scikit-Learn Machine learning in Python. :star:


• Semisup-Learn Semi-supervised learning frameworks for Python


• Tensorflow An open source software library for numerical computation using data flow graph by Google :star:

More details in software

Applications

• pytorch
  
  
  • 2D and 3D Face alignment library build using pytorch
  
  
  • Adversarial Autoencoders
  
  
  • A implementation of WaveNet with fast generation
  
  
  • A fast and differentiable QP solver for PyTorch.
  
  
  • A method to generate speech across multiple speakers
  
  
  • A model for style-specific music generation :star:
  
  
  • A natural language processing toolkit using state-of-the-art deep learning models. :star:
  
  
  • 使用PyTorch实现Char RNN生成古诗和周杰伦的歌词
  
  
  
  


• theano
  
  
  • CNN-yelp-challenge-2016-sentiment-classification
  
  
  • Deep learning tutorial for PyData
  
  
  • Deep Neural Network for Sentiment Analysis on Twitter
  
  
  • Implementations of many popular deep learning models in Theano+Lasagne
  
  
  
  


• tensorflow
  
  
  • A generic image detection program that uses tensorflow and a pre-trained Inception.
  
  
  • All kinds of text classificaiton models and more with deep learning :star:
  
  
  • Applying transfer learning to a custom dataset by retraining Inception's final layer
  
  
  • An easy implement of VGG19 with tensorflow, which has a detailed explanation.
  
  
  • An experimentation system for Reinforcement Learning using OpenAI Gym, Tensorflow, and Keras. :star:
  
  
  • An implementation of Pix2Pix in Tensorflow for use with frames from films
  
  
  
  


• 
  

  Keras

  
  
  
  
  • A DCGAN to generate anime faces using custom mined dataset
  
  
  • A facial expression classification system that recognizes 6 basic emotions: happy, sad, surprise, fear, anger and neutral.
  
  
  • A neural network trained to help writing neural network code using autocomplete
  
  
  • Attention mechanism Implementation for Keras.
  
  
  • Automated deep neural network design with genetic programming :star:
  
  
  • Attention based Neural Machine Translation for Keras
  
  
  • Keras Implementation of Ladder Network for Semi-Supervised Learning
  
  
  
  


• 
  

  Mxnet

  
  
  
  
  • 使用MXNet的动态图接口Gluon实现Char RNN生成古诗和周杰伦的歌词
  
  
  
  

More details in applications

Awesome Projects

• 15 AI and Machine Learning Events


• 188 examples of artificial intelligence in action


• A curated list of automated machine learning papers, articles, tutorials, slides and projects :star:


• A curated list of awesome Machine Learning frameworks, libraries and software.


• A curated list of awesome places to learn and/or practice algorithms.


• A curated list of awesome R packages and tools


• A curated list of awesome SLAM tutorials, projects and communities.


• A curated list of resources dedicated to bridge between coginitive science and deep learning


• A curated list of resources dedicated to Natural Language Processing (NLP)


• A curated list of resources for NLP (Natural Language Processing) for Chinese


• Another curated list of deep learning resources


• A list of artificial intelligence tools you can use today


• A list of deep learning implementations in biology


• Awesome-2vec


• Awesome Action Recognition

More details in awesome projects

Corpus

• 用于对话系统的中英文语料


• 搜狗实验室


• 情感分析︱网络公开的免费文本语料训练数据集汇总


• 中文情感分析用词语集


• 人民日报切分/标注语料库


• 哈工大信息检索研究中心(HIT CIR)语言技术平台共享资源


• 中文句结构树资料库


• 中文对白语料 chinese conversation corpus


• 中文语料小数据：Some useful Chinese corpus datasets


• 中文人名语料库。中文姓名,姓氏,名字,称呼,日本人名,翻译人名,英文人名


• 联合国平行语料库


• 保险行业语料库


• 用于训练中英文对话系统的语料库 Datasets for Training Chatbot System


• PTT 八卦版問答中文語料


• 3 Million Instacart Orders, Open Sourced


• ACM Multimedia Systems Conference Dataset Archive


• A dataset for book recommendations: ten thousand books, one million ratings


• A dataset for personalized highlight detection


• A dataset of 200k English plaintext jokes.


• A large-scale and high-qualityFMA: A Dataset For Music Analysis dataset of annotated musical notes.


• A large-scale dataset of manually annotated audio events :star:


• Alphabetical list of free/public domain datasets with text data for use in NLP

More details in corpus

Contributors

Special thanks to everyone who contributed to this project.

• raer6


• isikdogan


• outlace


• divamgupta


• Naman-Bhalla


• ppuliu


• benedekrozemberczki


• roziunicorn


• von-latinski

License

The details in License