Semantics with Word2Vec | The Skip-Gram Model, Some Probability, and Softmax Activation
Omnology Omnology
125 subscribers
8,624 views
167

 Published On Nov 27, 2019

In this video I give a detailed overview of the structure of the Skip-Gram model for creating word embeddings, go over the softmax activation function, and talk about some import probability theory. In the next video, I will talk about entropy and cross-entropy, and how the loss for our network will be calculated

show more

Share/Embed