Skip to content

A simple implementation of an artificial neural network based with Apache Spark and python. this is another implementation of my toy program https://github.com/lzhengchun/step-by-step-neural-network

Notifications You must be signed in to change notification settings

lzhengchun/a-simple-neural-network-on-spark

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

31 Commits
 
 
 
 
 
 
 
 
 
 

Repository files navigation

a simple neural network using apache spark

A simple implementation of an artificial neural network using Apache Spark and python. this is another implementation of my toy program https://github.com/lzhengchun/step-by-step-neural-network.

a virtual machine used for testing is provided by an online course: https://courses.edx.org/courses/BerkeleyX/CS190.1x/1T2015/info, with which a spark environemnt has been properly configured.

about detailed comments about this ANN model, please refer to: https://github.com/lzhengchun/step-by-step-neural-network

process flow chart:

alt text

todo:

  1. add comments about the implementaion

  2. well abstract as a class and make the model more general

Notes:

As you can see, it is firly easy to implement a simple aritfical neural netowork, as I said in my another ANN toy model, ANN is not magic and not that difficult to understand and implement, the only thing you should do is just do it! Get it working before you optimize it.

Further improvement may be carried out via calibrate the neural network model parameter like hidden layer size.

About

A simple implementation of an artificial neural network based with Apache Spark and python. this is another implementation of my toy program https://github.com/lzhengchun/step-by-step-neural-network

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published