Deep learning algorithms
In chapter 3, Deep Learning Fundamentals, we gave an easy-to-understand introduction to deep learning. In the next section, Deep networks, we'll give a more precise definition of the key concepts that will be thoroughly introduced in the coming chapters.
Deep networks
We could define deep learning as a class of machine learning techniques, where information is processed in hierarchical layers to understand representations and features from data in increasing levels of complexity. In practice, all deep learning algorithms are neural networks, which share some common basic properties. They all consist of interconnected neurons that are organized in layers. Where they differ is network architecture (or the way neurons are organized in the network), and sometimes in the way they are trained. With that in mind, let's look at the main classes of neural networks. The following list is not exhaustive, but it represents the vast majority of algorithms in use today:
- Multi-layer...