Releases: piskvorky/gensim
Releases · piskvorky/gensim
0.12.4, 29/01/2016
- Word2vec in line with original word2vec.c (Andrey Kutuzov, #538)
- Same default values. See diff akutuzov@6456cbc
- Standalone script with command line arguments matching those of original C tool.
Usage ./word2vec_standalone.py -train data.txt -output trained_vec.txt -size 200 -window 2 -sample 1e-4 - load_word2vec_format() performance (@svenkreiss, #555)
- Remove
init_sims()
call for performance improvements when normalized vectors are not needed. - Remove
norm_only
parameter (API change). Callinit_sims(replace=True)
after theload_word2vec_format()
call for the oldnorm_only=True
behavior.
- Remove
- Better internal handling of job batching in word2vec (#535)
- up to 300% speed up when training on very short documents (~tweets)
- Word2vec allows non-strict unicode error handling (ignore or replace) (Gordon Mohr, #466)
- Doc2Vec
model.docvecs[key]
now raises KeyError for unknown keys (Gordon Mohr, #520) - Fix
DocvecsArray.index_to_doctag
somost_similar()
returns string doctags (Gordon Mohr, #560) - On-demand loading of the
pattern
library in utils.lemmatize (Jan Zikes, #461)utils.HAS_PATTERN
flag moved toutils.has_pattern()
- Threadsafe Word2Vec/Doc2Vec finish-check to avoid hang/unending Word2Vec/Doc2Vec training (Gordon Mohr, #571)
- Tuned
TestWord2VecModel.test_cbow_hs()
against random failures (Gordon Mohr, #531) - Prevent ZeroDivisionError when
default_timer()
indicate no elapsed time (Gordon Mohr, #518) - Forwards compatibility for NumPy > 1.10 (Matti Lyra, #494, #513)
- LdaModel and LdaMulticore produce a large number of DeprecationWarnings from
.inference() because the term ids in each chunk returned from utils.grouper
are floats. This behaviour has been changed so that the term IDs are now ints. - utils.grouper returns a python list instead of a numpy array in .update() when
LdaModel is called in non distributed mode - in distributed mode .update() will still call utils.grouper with as_numpy=True
to save memory - LdaModel.update and LdaMulticore.update have a new keyword parameter
chunks_as_numpy=True/False (defaults to False) that allows controlling
this behaviour
- LdaModel and LdaMulticore produce a large number of DeprecationWarnings from
0.12.3
0.12.3rc1, 05/11/2015
- Make show_topics return value consistent across models (Christopher Corley, #448)
- All models with the
show_topics
method should return a list of
(topic_number, topic)
tuples, wheretopic
is a list of
(word, probability)
tuples. - This is a breaking change that affects users of the
LsiModel
,LdaModel
,
andLdaMulticore
that may be reliant on the old tuple layout of
(probability, word)
.
- All models with the
- Mixed integer & string document-tags (keys to doc-vectors) will work (Gordon Mohr, #491)
- DocvecsArray's
index2doctag
list is renamed/reinterpreted asoffset2doctag
offset2doctag
entries map todoctag_syn0
indexes after last plain-int doctag (if any)- (If using only string doctags,
offset2doctag
may be interpreted same asindex2doctag
.)
- DocvecsArray's
- New Tutorials on Dynamic Topic Modelling and Classification via Word2Vec (@Arttii #471, @mataddy #500)
- Auto-learning for the eta parameter on the LdaModel (Christopher Corley, #479)
- Python 3.5 support
- Speed improvements to keyword and summarisation methods (@erbas #441)
- OSX wheels (#504)
- Win build (#492)
0.12.3rc1
0.12.3rc1, 05/11/2015
- Make show_topics return value consistent across models (Christopher Corley, #448)
- All models with the
show_topics
method should return a list of
(topic_number, topic)
tuples, wheretopic
is a list of
(word, probability)
tuples. - This is a breaking change that affects users of the
LsiModel
,LdaModel
,
andLdaMulticore
that may be reliant on the old tuple layout of
(probability, word)
.
- All models with the
- Mixed integer & string document-tags (keys to doc-vectors) will work (Gordon Mohr, #491)
- DocvecsArray's
index2doctag
list is renamed/reinterpreted asoffset2doctag
offset2doctag
entries map todoctag_syn0
indexes after last plain-int doctag (if any)- (If using only string doctags,
offset2doctag
may be interpreted same asindex2doctag
.)
- DocvecsArray's
- New Tutorials on Dynamic Topic Modelling and Classification via Word2Vec (@Arttii #471, @mataddy #500)
- Auto-learning for the eta parameter on the LdaModel (Christopher Corley, #479)
- Python 3.5 support
- Speed improvements to keyword and summarisation methods (@erbas #441)
- OSX wheels (#504)
- Win build (#492)