Posts

Showing posts with the label pca

What is the semantic relationship expected between word vectors which are scalar multiples of each other in word2vec?

Image
Clash Royale CLAN TAG #URR8PPP What is the semantic relationship expected between word vectors which are scalar multiples of each other in word2vec? Let's say you have a word vector for the word queen . Some of its scalar multiples would be x = queen + queen , y = queen + queen + queen and n * queen for any real value of n ( so we're also considering non-integer values of n such as in 0.83 * queen ). queen x = queen + queen y = queen + queen + queen n * queen 0.83 * queen Therefore I have two questions: How are these points expected to appear on the biplot generated after PCA? Will they lie around a straight line? What is the semantic relationship expected between the words x , y and queen ? I know these vectors will all have the same ratio between the dimensional values within the vector, but I'm having a hard time figuring out how to read this in terms of word meaning. x y queen By clicking "Pos...