v0.4.3 #38
benbrandt
announced in
Announcements
v0.4.3
#38
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
What's Changed
impl ChunkSizer
for&Tokenizer
and&CoreBPE
, allowing for generating chunks based off of a reference to a tokenizer as well, instead of requiring ownership. by @benbrandt in Support references to tokenizers #37Full Changelog: v0.4.2...v0.4.3
This discussion was created from the release v0.4.3.
Beta Was this translation helpful? Give feedback.
All reactions