Skip to content
forked from wbrown/gpt_bpe

GPT2 Byte Pair Encoding implementation in Golang

License

Notifications You must be signed in to change notification settings

coreweave/gpt_bpe

 
 

Repository files navigation

gpt-bpe

An implementation of GPT2 Byte Pair Encoding Encoder/Decoder in golang. Generally very fast, bottlenecked by the regex engine for whitespace separation.

About

GPT2 Byte Pair Encoding implementation in Golang

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

 
 
 

Languages

  • Go 100.0%