Adding Word Prediction

[cdzech]

Hi,

I have noticed that, at least for my use case, a crucial feature is missing in the Word2Vec module: Word prediction. There is no function that takes a context as an input and outputs the probability distribution for the center word (in CBOW).

For my project, I implemented such a function. Is there any interest of the community to provide such a method for the users? If so, I would look into porting it.

Best,
Chris

[gojomo]

Yes! That capability has occasionally been requested, or been relevant to experiments people want to do, so a PR would be welcome.

[cdzech]

Sounds good. I'll need some time, though. I'll get back when I'm ready.

[metalaman]

Are we looking at a language model implementation for this feature?

[gojomo]

The Word2Vec model already is trained via implicit word-predictions, so no extra model implementation should be necessary – just providing another way to run the trained model and report the results (across all possible word-predictions).