François Chollet+ Your Authors @fchollet Deep learning @google. Creator of Keras, neural networks library. Author of 'Deep Learning with Python'. Opinions are my own. Oct. 18, 2019 1 min read + Your Authors

There's a big difference between data-efficiency and information-efficiency. We could make considerable progress on the former without even starting to approach the latter -- and never realize our fundamental mistake.

Abstraction is the golden path to information efficiency. But all kinds of hacks can get you data efficiency.

The difference between data & information:

- Data is plentiful & noisy, the large majority of data is not information
- Information is what makes data useful
- We are bad at extracting info from data. We only manage to distill & use a small fraction of what is really available

Working on "data efficiency" typically means finding new hacks to increase the amount of information we can extract from the same data. But "information efficiency" is an entirely unrelated concept: how to efficiently and effectively make use of information

You can follow @fchollet.


Tip: mention @threader_app on a Twitter thread with the keyword “compile” to get a link to it.

Enjoy Threader? Sign up.

Since you’re here...

... we’re asking visitors like you to make a contribution to support this independent project. In these uncertain times, access to information is vital. Threader gets 1,000,000+ visits a month and our iOS Twitter client was featured as an App of the Day by Apple. Your financial support will help two developers to keep working on this app. Everyone’s contribution, big or small, is so valuable. Support Threader by becoming premium or by donating on PayPal. Thank you.