Notices by ☆ Dmitri ☭ (yogthos@mastodon.social), page 14

@Tryphon right we loosely base neural nets on the way the brain is wired, and they exhibit similar behaviors unsurprisingly. Obviously the brain evolved to model the world, so it's pretty good at it. :)

The interesting part to me was that we didn't really know why it should be good at it, and renormalization provides a plausible explanation for why hierarchical networks should be effective.

@Tryphon this is probably a better article on the topic actually https://www.quantamagazine.org/deep-learning-relies-on-renormalization-physicists-find-20141204/

@Tryphon basically the core insight is that deep learning relies on renormalization, which is a well known technique used in physics. I'm really not sure what's so outlandish about that.

@xtof54 @Tryphon didn't seem that way to me at all actually. The article talks about the fact that the universe is inherently hierarchical and how similar statistical models as those found in ML have been used in physics for a long time..

There are a lot of links between statistical physics and neural networks actually https://www.quora.com/Is-deep-learning-related-to-statistical-physics-particularly-network-science

@Tryphon do explain :)

@valerauko I haven't run into problems myself with resource usage, but depends on what kind load you're expecting. The cheapest digital ocean should get you pretty far though.

day to night by Stephen Wlikes
https://www.stephenwilkes.com/fine-art/day-to-night/5b11a7f1-fd94-4fb3-9157-0be7ac110003

@valerauko always good to work through all the pieces from the ground up. ;)

The Extraordinary Link Between Deep Neural Networks and the Nature of the Universe

https://www.technologyreview.com/s/602344/the-extraordinary-link-between-deep-neural-networks-and-the-nature-of-the-universe/..

rapid industrial expansion in the 19th century Germany was likely due to an absence of copyright law

http://m.spiegel.de/international/zeitgeist/no-copyright-law-the-real-reason-for-germany-s-industrial-expansion-a-710976.html