Skip to content

Release 0.1.3
Compare
Choose a tag to compare
@jwijffels jwijffels released this 08 Jan 15:11
· 2 commits to 7e2184f4a681d136b176ff8d086622e74120c32a since this release
0.1.3
674980f

CHANGES IN sentencepiece VERSION 0.1.3

  • Fix Solaris installation issue related to incorrect usage of pointer as a function
  • Also download the binary model in sentencepiece_download_model as it can be loaded with word2vec::read.wordvectors
  • read_word2vec now uses word2vec::read.wordvectors from word2vec >= 0.2.0
  • added BPEembed and predict.BPEembed
  • allow subword regularisation by adding nbest and alpha option in sentencepiece_encode and changed sentencepiece_decode accordingly
  • Added txt_remove_
Assets 2
Loading