r/computerscience • • Aug 13 '18

Amazon scientists: How perfect hashing helps us shrink Alexa's machine learning models by 94% for offline use

https://developer.amazon.com/blogs/alexa/post/09bacbdd-c089-4b02-863d-6761728102ed/shrinking-machine-learning-models-for-offline-use
171 Upvotes

5 comments sorted by

18

u/mattrussell2 Aug 13 '18

Sweet. Thanks for the share. It’s surprising that only 11 people have liked this so far.

2

u/Scopesx Aug 14 '18

Yeah good read.

5

u/csosu Aug 14 '18

Cool article! Thanks for sharing. MurmurHash is an interesting strategy.

Here's a link to their whitepaper, for the incredibly lazy.

0

u/The-42nd-Doctor Aug 14 '18

I cant download that on my phone, if you wouldn't mind summarizing, what makes it different/better than, say, the faster xxhash?

2

u/csosu Aug 15 '18

They're both non-cryptographic and fast... though apparently xxHash is much faster. Perhaps the team used MurmurHash for some reason - like xxHash's more restrictive licensing. In terms of potential technical reasons, I don't know enough about both of them to say for sure.