Answer by Franck Dernoncourt:
Let me add two pictures toanswer, taken from (Yaser Abu-Mostafa, Caltech):
Big picture of what learning is:
Synopsis of the main machine learning techniques:
The main classification of machine learning models according to the problems they solve isvs. unsupervised learning, but it gets pretty messy once you try to classify models at a finer level.