Deep Learning Tricks

Published: 09 Oct 2015 Category: deep_learning


Practical recommendations for gradient-based training of deep architectures

Bag of Tricks for Image Classification with Convolutional Neural Networks


Efficient BackProp

Deep Learning for Vision: Tricks of the Trade

Optimizing RNN performance

  • intro: Silicon Valley AI Lab
  • keywords: Optimize GEMM, parallel GPU, GRU and LSTM…
  • blog:

Must Know Tips/Tricks in Deep Neural Networks

Training Tricks from Deeplearning4j

Suggestions for DL from Llya Sutskeve

Efficient Training Strategies for Deep Neural Network Language Models

Neural Networks Best Practice

Dark Knowledge from Hinton

Stochastic Gradient Descent Tricks(Leon Bottou)

Advice for applying Machine Learning

How to Debug Learning Algorithm for Regression Model

Large-scale L-BFGS using MapReduce

Selecting good features

– Part I: univariate selection: – Part II: linear models and regularization: – Part III: random forests: – Part IV: stability selection, RFE and everything side by side:


Stochastic Gradient Boosting: Choosing the Best Number of Iterations

Large-Scale High-Precision Topic Modeling on Twitter

H2O World - Top 10 Deep Learning Tips & Tricks - Arno Candel

How To Improve Deep Learning Performance: 20 Tips, Tricks and Techniques That You Can Use To Fight Overfitting and Get Better Generalization

Neural Network Training Speed Trick

The Black Magic of Deep Learning - Tips and Tricks for the practitioner