Open NicolaBernini opened 5 years ago
Machine Learning Models have typically much less learning capacity of Deep Learning Models
The reason for this is their input domain is typically low dimensional (e.g. scalar time series, not images, videos, ...) and that's because
Deep Learning Models target high dimensional spaces as their input (e.g. images, videos) and they do not need any manually engineered feature
In fact they automatically learn the most appropriate representation for their data
This automatic representation learning is the result of the inductive bias related to the architecture consisting of an hierarchy of layers : this choice forces the network to learn a hierarchy of layer specific representations so that each layer representation depends on the previous layer one and the first layer depends on the high dimensional input representation
This requires the Deep Learning Models to have a much higher learning capacity (as they need to learn both the hierarchical representation and how to solve their problem) and it creates a lot of additional complexities with respect to machine learning models like
Overview
Basic Elements about Deep Learning