Neural Network

Tutorials

Neural Network Tutorial

• intro: In this tutorial series we develop the back-propagation algorithm, explore how it functions, and build a back propagation neural network library in C#
• youtube: https://www.youtube.com/playlist?list=PL29C61214F2146796

A history of Bayesian neural networks

• intro: by Zoubin Ghahramani, University of Cambridge. NIPS 2016 Bayesian Deep Learning
• slides: http://bayesiandeeplearning.org/slides/nips16bayesdeep.pdf

Papers

A Fast C++ Implementation of Neural Network Backpropagation Training Algorithm: Application to Bayesian Optimal Image Demosaicking

• project page: http://www.ipol.im/pub/art/2015/137/
• paper: http://www.ipol.im/pub/art/2015/137/article_lr.pdf
• code: http://www.ipol.im/pub/art/2015/137/NN.tar.gz

CrAIg: Using Neural Networks to learn Mario

• blog: https://medium.com/@savas/craig-using-neural-networks-to-learn-mario-a76036b639ad
• github: https://github.com/joenot443/crAIg
• paper: http://nn.cs.utexas.edu/downloads/papers/stanley.ec02.pdf

Calculus and Backpropagation

• paper: https://github.com/mtomassoli/papers/blob/master/backprop.pdf

A Tutorial about Random Neural Networks in Supervised Learning

• inro: Neural Network World
• arxiv: https://arxiv.org/abs/1609.04846

Blogs

Artificial Neural Networks (ANN) Introduction

• blog: https://annalyzin.wordpress.com/2016/03/13/how-do-computers-recognise-handwriting-using-artificial-neural-networks/

Getting It Done - What I learnt from finishing the Neural Network Algorithm

• blog: http://nicksparallellaideas.blogspot.com.au/2015/12/getting-it-done-what-i-learnt-from.html
• blog: http://pan.baidu.com/s/1sk6VPBf

Learning How To Code Neural Networks

• blog: https://medium.com/learning-new-stuff/how-to-learn-neural-networks-758b78f2736e#.nc2bx42ct

Watch Tiny Neural Nets Learn

http://swanintelligence.com/watch-tiny-neural-nets-learn.html

Rohan & Lenny #1: Neural Networks & The Backpropagation Algorithm, Explained

https://medium.com/a-year-of-artificial-intelligence/rohan-lenny-1-neural-networks-the-backpropagation-algorithm-explained-abf4609d4f9d#.9igtj84gm

The Essence of Artificial Neural Networks

https://medium.com/@ivanliljeqvist/the-essence-of-artificial-neural-networks-5de300c995d6#.yk0kydmf8

Neural Networks with PHP

• youtube: https://www.youtube.com/watch?v=5bFxDsoNFzU
• mirror: http://pan.baidu.com/s/1boc933p

Neural Networs in MySQL

• blog: http://blog.itdxer.com/2016/07/01/neural-networs-in-mysql.html
• github: https://github.com/itdxer/Neural-Network-in-MySQL

Neural Networks in JavaScript

• blog: http://www.antoniodeluca.info/blog/10-08-2016/neural-networks-in-javascript.html

Multiplication with simple neural nets

• blog: http://nbviewer.jupyter.org/gist/fperez/c7b1cb4810f9d0935e893f34c41f0c62

Training Neural Networks with Theano

http://blog.asidatascience.com/training-neural-networks-with-theano/

An Introduction to Machine Learning in Julia

http://juliacomputing.com/blog/2016/09/28/knn-char-recognition.html

A Quick Introduction to Neural Networks

http://www.kdnuggets.com/2016/11/quick-introduction-neural-networks.html

Starting with Neural Networks in Swift 3.0

• blog: https://medium.com/@michael.m/starting-with-neural-networks-in-swift-3-0-d260c1f0bf74#.rghtp2ip3
• bitbucket: https://bitbucket.org/mmick66/neural1

Visual and Interactive Guide to the Basics of Neural Networks

http://jalammar.github.io/visual-interactive-guide-basics-neural-networks/

Backpropagation

A Step by Step Backpropagation Example

• blog: http://mattmazur.com/2015/03/17/a-step-by-step-backpropagation-example/
• github: https://github.com/mattm/simple-neural-network

Can you give a visual explanation for the back propagation algorithm for neural networks?

• github: https://github.com/rasbt/python-machine-learning-book/blob/master/faq/visual-backpropagation.md

一文弄懂神经网络中的反向传播法——BackPropagation

http://www.cnblogs.com/charlotte77/p/5629865.html

Visualize Algorithms based on the Backpropagation

• blog: http://neupy.com/2015/07/04/visualize_backpropagation_algorithms.html#gradient-descent

Backpropagation — How Neural Networks Learn Complex Behaviors

• blog: https://medium.com/autonomous-agents/backpropagation-how-neural-networks-learn-complex-behaviors-9572ac161670#.ipu4jr2ka

Derivation of Backpropagation

https://www.cs.swarthmore.edu/~meeden/cs81/s10/BackPropDeriv.pdf

Backpropagation

https://en.wikipedia.org/wiki/Backpropagation#Derivation

A Derivation of Backpropagation in Matrix Form

• blog: http://sudeepraja.github.io/Neural/

Backpropagation — How Neural Networks Learn Complex Behaviors

• blog: https://medium.com/autonomous-agents/backpropagation-how-neural-networks-learn-complex-behaviors-9572ac161670#.dmdy8glec

How to Implement the Backpropagation Algorithm From Scratch In Python

• blog: http://machinelearningmastery.com/implement-backpropagation-algorithm-scratch-python/

Notes on Backpropagation

• intro: This document derives backpropagation for some common error functions and describes some other tricks.
• paper: https://www.ics.uci.edu/~pjsadows/notes.pdf

Yes you should understand backprop

• intro: Andrej Karpathy
• blog: https://medium.com/@karpathy/yes-you-should-understand-backprop-e2f06eab496b#.hbbhgjzi9

Back-propagation, an introduction

• blog: http://www.offconvex.org/2016/12/20/backprop/

Project

Neural Networks demo in Javascript

• demo: http://cs.stanford.edu/people/karpathy/svmjs/demo/demonn.html

Interactive visualization of artificial neural networks

• homepage: http://experiments.mostafa.io/public/ffbpann/
• github: https://github.com/drdrsh/interactive-bpann

NNX: Neural networks for Excel

• intro: “Multilayer perceptrons done the Excel way”
• homepage: https://nnx-addin.org/
• github: https://github.com/ikhramts/nnx

GNU Gneural Network

• homepage: http://www.gnu.org/software/gneuralnetwork/

Generating procedural plants with neural networks

• blog: http://www.iotapersei.com/_neural_networks_article.html

NeuroFlow: A lightweight, scala based library for Artificial Neural Networks

• github: https://github.com/zenecture/neuroflow

DN2A - Digital Neural Network Architecture

• homepage: http://www.dn2a.org/
• github: https://github.com/dn2a/dn2a-javascript

visual-neural-net

• intro: Interactive visualization of artificial neural networks that leverages deeplearning4j, spring, and angular2
• github(server): https://github.com/JavaFXpert/visual-neural-net-server
• github(client):https://github.com/JavaFXpert/ng2-spring-websocket-client

NN++: A small and easy to use neural net implementation for C++

• intro: It includes the neural net implementation and a Matrix class for basic linear algebra operations
• github: https://github.com/stagadish/NNplusplus

Neural networks module for Redis

• github: https://github.com/antirez/neural-redis

Introduction of neural-redis

• part 1: https://medium.com/the-quarter-espresso/introduction-of-neural-redis-part-1-fa13c1faeef1#.v4sqluonf
• part 2: https://medium.com/the-quarter-espresso/introduction-of-neural-redis-part-2-6c22b42f412c#.gt452jx8c
• part 3: https://medium.com/the-quarter-espresso/introduction-of-neural-redis-part-3-9d59012120a#.wo9gblc1u

Neural Nets in native Haskell

• github: https://github.com/brunjlar/neural

Command Line Neural Network

• github: https://github.com/hugorut/neural-cli

Chai: An open source neural network library

• github: https://github.com/SullyChen/Chai

Neural networks in JavaScript

• homepage: http://brainjs.com/
• github: https://github.com/harthur-org/brain.js

Neural Network in Rust

• homepage: http://juggernaut.rs/
• github: https://github.com/afshinm/juggernaut

Videos

Neural Networks with PHP

• youtube: https://www.youtube.com/watch?v=5bFxDsoNFzU
• video: http://pan.baidu.com/s/1boc933p

Books

Neural Network Programming with Java

https://www.packtpub.com/mapt/book/All%20Books/9781785880902