Deep learning is useful because it enables us to create programs that we could not otherwise code by hand. But the space of programs you can learn via deep learning models is a minuscule slice of the space of programs that we may be interested in.
Most interesting processes cannot be learned by a stack of affine transforms (plus squashing functions) mapping one vector space to another point-by-point. Even given large amounts of data.
Perhaps more importantly, although human engineers can cover a dramatically larger section of the space of interesting programs (compared to deep learning models), many useful programs remain inaccessible even to humans -- we cannot develop them by hand.
It will be the job of future AI systems to give us access to these programs.
You can follow @fchollet.
Tip: mention @threader_app on a Twitter thread with the keyword “compile” to get a link to it.
Enjoy Threader? Sign up.
Since you’re here...
... we’re asking visitors like you to make a contribution to support this independent project. In these uncertain times, access to information is vital. Threader gets 1,000,000+ visits a month and our iOS Twitter client was featured as an App of the Day by Apple. Your financial support will help two developers to keep working on this app. Everyone’s contribution, big or small, is so valuable. Support Threader by becoming premium or by donating on PayPal. Thank you.