Understanding algorithmic techniques and the mathematics behind the word2vec model
This section is very important, as we are going to discuss here the core algorithms that have been used in word2vec. By the end of this section, there won't be any secrets left in order for you to understand the concept of word2vec. Thus, this section is converting word2vec black box into word2vec white box. Here, I'm going to include the math part as well, so readers can understand the core concepts in a better manner. Don't worry if you don't know the math, because I will provide you with some resources that you may find really useful.
Understanding the basic mathematics for the word2vec algorithm
To begin with, we need some of the basic mathematics concepts in place for a better understanding of the algorithm. The topics from mathematics that we need are listed as follows:
- Vectors: Vectors have magnitude and direction. So, when we draw a vector in vector space it carries some magnitude as well as direction...