François Chollet @fchollet Deep learning @google. Creator of Keras, neural networks library. Author of "Deep Learning with Python". All opinions are my own (strong but weakly held). Jun. 22, 2018 1 min read

Deep learning is useful because it enables us to create programs that we could not otherwise code by hand. But the space of programs you can learn via deep learning models is a minuscule slice of the space of programs that we may be interested in.

Most interesting processes cannot be learned by a stack of affine transforms (plus squashing functions) mapping one vector space to another point-by-point. Even given large amounts of data.

Perhaps more importantly, although human engineers can cover a dramatically larger section of the space of interesting programs (compared to deep learning models), many useful programs remain inaccessible even to humans -- we cannot develop them by hand.

It will be the job of future AI systems to give us access to these programs.

You can follow @fchollet.


Tip: mention @threader_app on a Twitter thread with the keyword “compile” to get a link to it.

Enjoy Threader? Sign up.