You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Along with #248, we should add a utility to train a model proto for sentence piece. This can leverage the sentencepiece pip package to run their trainer.
We should not expose most of the option the sentencepiece trainer has, the goal will be for this to cover the majority of use cases, with advanced users till using the sentencepiece pip package directly.
The text was updated successfully, but these errors were encountered:
Along with #248, we should add a utility to train a model proto for sentence piece. This can leverage the sentencepiece pip package to run their trainer.
We should not expose most of the option the sentencepiece trainer has, the goal will be for this to cover the majority of use cases, with advanced users till using the sentencepiece pip package directly.
The text was updated successfully, but these errors were encountered: