Agreed. It looks interesting at first, but looking closer at the OP dictionary, basically the only thing it can do is affine transforms and various scalar nonlinearities, which means it will only come up with variations of NNs with potentially exotic activation functions.
The co-learning of predictor and learner is interesting, but very dumb: the learner should at least have access to the predictor in some sense, either through operations such as grad(), or some more advanced ability to traverse the computational graph.
0
u/[deleted] Mar 10 '20
[deleted]