v0.6.4 - HF more caching for no-batch module
Breaking changes
- The default
batch_size
incappr.huggingface
is now2
, not32
- The implementation for
cappr.huggingface.classify_no_batch
is now incappr.huggingface.classify_no_batch_no_cache
New features
cappr.huggingface.classify_no_batch
now caches the prompt, which makes it much faster. It can also cache shared instructions or exemplars for prompts using the new context manager. See this functionality in action in the Banking 77 demo
Bug fixes
None