r/computerscience • u/wstcpyt1988 • Jan 19 '20
60s Machine Learning — Single Layer Neural Network
4
u/Teddyzander Jan 19 '20 edited Jan 19 '20
For those interested in how the each weight is adjusted, if I remember correctly the formula is:
Error * input * activation function'(output)
Where:
Error is the difference between what the neuron calculates and the expected output (calculated output - expected output)
input is simply the the initial input from the training data set.
activation function'(output) is the derivative of the activation function (in this case, the sigmoid function) at the calculated output.
This kind of network is used for linear binary classification.
EDIT: If I'm wrong, please point it out for the sake of others.
EDIT 2: Also, this was a concept developed in the very late 50s, not 60s (though I'm sure it was used extensively in the 60s!).
5
u/vinvinnocent Jan 19 '20
Even simpler is error * input * learning rate for perceptions with step0 activation function.
2
u/Teddyzander Jan 19 '20
Absolutely true! But since this one uses the sigmoid function, thought I'd roll with that one
1
2
u/wstcpyt1988 Jan 19 '20
If you find it is too fast, here is the original post:
https://www.instagram.com/p/B7fOrlypyiv/?utm_source=ig_web_copy_link