We used to compare the number of transistors on a chip to the number of neurons in the brain. Now we use the total number of filters in the Conv2D layers of a DL model for that comparison. It makes as much sense (which is none).
Btw GPUs have 10-15B transistors these days, growing by 10x in ~5 years. So GPUs should be brain-scale in less than 5 years
You can follow @fchollet.
Tip: mention @threader_app on a Twitter thread with the keyword “compile” to get a link to it.
Enjoy Threader? Sign up.
Since you’re here...
... we’re asking visitors like you to make a contribution to support this independent project. In these uncertain times, access to information is vital. Threader gets 1,000,000+ visits a month and our iOS Twitter client was featured as an App of the Day by Apple. Your financial support will help two developers to keep working on this app. Everyone’s contribution, big or small, is so valuable. Support Threader by becoming premium or by donating on PayPal. Thank you.