A way to describe intelligence is that it is the power to produce abstraction. AI in the true sense would be Autonomous Abstraction.
Current AI consists of recording abstractions generated by the human mind (via hard-coding rules, training ML models on human-labeled data, etc).
All generalization must by definition come from some form of abstraction.
The abstractions that can be learned by DL models (often reflections of human abstractions injected via labels) are fairly weak and shallow, which is why DL is only capable of local generalization.
If AI today isn't capable of autonomous abstraction, it isn't because it's a particularly hard technical problem. Rather, it's a subtle conceptual problem. It doesn't seem like many people are looking at it. You can't produce the right answers if you're asking the wrong questions
AI today is to human intelligence what the phonograph was to human musicians. Superficially, it may seem like it has a comparable output & is ready to replace musicians (which was a real fear back then). But it has radically different capabilities: it's merely a recording device.
Don't confuse music creation with sound recording. Musicians are the origin of music. Unlike a phonograph, they can play a never-played before score, or write never-heard before music. Or take up a new instrument. Or invent a new musical genre.
Historically, we went technology to record sound to technology capable of helping with music production and creation. New, more powerful tools. Eventually, we will see open-ended autonomous music creation.
This will be the trajectory of AI as well.
From recorded abstraction, to cognitive augmentation tools, to autonomous abstraction.
You can follow @fchollet.
Tip: mention @threader_app on a Twitter thread with the keyword “compile” to get a link to it.
Enjoy Threader? Sign up.
Threader is an independent project created by only two developers. The site gets 500,000+ visits a month and our iOS Twitter client was featured as an App of the Day by Apple. Running this space is expensive and time consuming. If you find Threader useful, please consider supporting us to make it a sustainable project.