Skip to content

Latest commit

 

History

History
5 lines (4 loc) · 342 Bytes

README.md

File metadata and controls

5 lines (4 loc) · 342 Bytes

bpe-ts

Implementation of byte pair encoding algorithm with typescript

Definition (wiki)

Byte pair encoding is a simple form of data compression in which the most common pair of consecutive bytes of data is replaced with a byte that does not occur within that data. A table of the replacements is required to rebuild the original data.