We used to compare the number of transistors on a chip to the number of neurons in the brain. Now we use the total number of filters in the Conv2D layers of a DL model for that comparison. It makes as much sense (which is none).
Btw GPUs have 10-15B transistors these days, growing by 10x in ~5 years. So GPUs should be brain-scale in less than 5 years
You can follow @fchollet.
Tip: mention @threader_app on a Twitter thread with the keyword “compile” to get a link to it.
Enjoy Threader? Sign up.
Threader is an independent project created by only two developers. The site gets 500,000+ visits a month and our iOS Twitter client was featured as an App of the Day by Apple. Running this space is expensive and time consuming. If you find Threader useful, please consider supporting us to make it a sustainable project.