r/MachineLearning • • Jun 29 '17

Project [P] Basic neural network Java implementation, which can train itself, for beginners to try out and learn how they work.

https://github.com/sebig3000/MachineLearning
2 Upvotes

6 comments sorted by

2

u/[deleted] Jun 30 '17

Are you using finite differences to estimate the gradient?

2

u/sebig3000 Jun 30 '17

Finite difference It just calculates the current costs, costs with increasing the weight by one step and decreasing the weight by one step and the just chooses the best of this three options and uses it.

2

u/[deleted] Jun 30 '17

For each weight separately? I guess you can consider this then to be a form of something called coordinate descent.

You should consider trying as a next step to calculate your gradients analytically, or do the finite difference or symmetric difference in a more proper way.

I think it's also worth noting this might be better suited at /r/learnmachinelearning.

Best of luck

2

u/DrawStreamRasterizer Jul 02 '17

Mind if I contribute some training algorithms of my own such as the cocktail party algo?

1

u/sebig3000 Jul 02 '17

Sure, that would be awesome! I'm pretty new to machine learning so I'm not familiar to a lot of algorithms. So I ask everybody to make their own brach and then combine them so we can combine many algorithms!

0

u/vonnik Jun 30 '17

This is great. For Java people interested in a more fully featured lib, there's also DL4J: https://github.com/deeplearning4j