Algorithms used by neural networks
Here, we will look at the structure of individual neurons. We will also look into the details about the two algorithms, thus, we will understand how word2vec generates vectors from words.
Structure of the neurons
We have seen the overall neural network structure, but we haven't yet seen what each neuron is made of and what the structure of the neurons is. So, in this section, we will look at the structure of each single input neuron.
We will look at the following structures:
- Basic neuron structure
- Training a single neuron
- Single neuron application
- Multi-layer neural network
- Backpropagation
- Mathematics behind the word2vec model
In this, we will heavily include the mathematical formulas. If you are not from a mathematical background, then don't worry. I will give you explanations in simple words so you know what is going on in each section.
Basic neuron structure
Refer to Figure 6.16; it shows the basic neuron structure:
Figure 6.16: Basic neuron structure (Image credits...
