r/MachineLearning • • Mar 10 '20

AutoML-Zero: Evolving Machine Learning Algorithms From Scratch

https://arxiv.org/pdf/2003.03384.pdf
22 Upvotes

11 comments sorted by

View all comments

2

u/rafgro Mar 11 '20

Each cycle picks T<P algorithms at random and selects the best performing one as the parent (i.e. tournament selection, [25]). This parent is then copied and mutated to produce a child algorithm that is added to the population, while the oldest algorithm in the population is removed.

As usual with "evolving" in the title, the actual methods are toyish, not evolutionary. It's 1980s level. In fact, that [25] is a review from 1991, which in turn cites the actual source for their method from 1981. LOL

4

u/[deleted] Mar 29 '20 edited Mar 30 '20

LOL?

The original algorithm for pagerank, if my memory serves correct, was first published in a 1950s mathematical paper with a brief commentary on the possibilities of future technology to use it.All the google authors had to do was scan the literature base with gusto!

There are probably quite a few useful algorithms( or psuedo-algorithms) in the 1800s literature base. I even give a 1% chance that some useful currently unknown algorithm is buried in ancient china or rome or another ancient civilization.

So what is this "Lol" you speak of? It is no shame to simply test-and-apply the methodology of old papers which once could not have been done due to the technological limitations of the time-period.

1

u/rafgro Mar 29 '20

You missed the whole thing. Developments since 1981, NEAT, improved NEATs, advancement in bioinf/compbio/evolutionary genomics etc etc.