François Chollet+ Your Authors @fchollet Deep learning @google. Creator of Keras, neural networks library. Author of 'Deep Learning with Python'. Opinions are my own. Oct. 01, 2018 1 min read + Your Authors

One of the most amazing things about the brain is how incredibly slow it is. Nerve impulses travel extremely slowly compared to the speed of electricity, and our fastest neurons can fire *a few* times per second . Compare that to the clock speed of a modern CPU, ~10M times faster

Yet we can produce complex behaviors in response to unexpected events in about 400-500ms (like catching an incoming object). Including muscle-brain roundtrip. This implies that each neuron involved in the computation fires at most a couple of times.

This inherent slowness, coupled with the constraint of real-time responses, must have shaped the algorithms developed by the brain in profound ways (in particular, this is likely why we need *so many* neurons). Intelligence developed on a computer might look very different.

In particular, we are unable to brute-force any problem. We solve constraint satisfaction problems via intuition and analogy. A chess master evaluates millions of times fewer positions than a computer program at a comparable level.

Our biological and experiential limitations *force* our brains to be *intelligent* -- to learn from few examples, to generalize strongly, to build complex solutions in few trials. Everything that is out of reach for AI today.

You can follow @fchollet.


Tip: mention @threader_app on a Twitter thread with the keyword “compile” to get a link to it.

Enjoy Threader? Sign up.

Since you’re here...

... we’re asking visitors like you to make a contribution to support this independent project. In these uncertain times, access to information is vital. Threader gets 1,000,000+ visits a month and our iOS Twitter client was featured as an App of the Day by Apple. Your financial support will help two developers to keep working on this app. Everyone’s contribution, big or small, is so valuable. Support Threader by becoming premium or by donating on PayPal. Thank you.

Follow Threader