New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Set encoding to avoid Encoding::CompatibilityError #9

Merged

yoshoku merged 1 commit into yoshoku:main from keyasuda:set-output-encoding

Sep 14, 2023

+1 −1

Contributor

keyasuda commented Sep 10, 2023

This PR is to avoid following error on LLaMACpp.generate.

/home/keyasuda/.rbenv/versions/3.2.1/lib/ruby/gems/3.2.0/gems/llama_cpp-0.5.1/lib/llama_cpp.rb:107:in `delete_prefix': incompatible character encodings: ASCII-8BIT and UTF-8 (Encoding::CompatibilityError)
	from /home/keyasuda/.rbenv/versions/3.2.1/lib/ruby/gems/3.2.0/gems/llama_cpp-0.5.1/lib/llama_cpp.rb:107:in `generate'
	from test2.rb:8:in `<main>'

Test script is like following:

require 'llama_cpp'

params = LLaMACpp::ContextParams.new
params.seed = 42
model = LLaMACpp::Model.new(model_path: ARGV[0], params: params)
context = LLaMACpp::Context.new(model: model)
prompt = '[INST] <<SYS>>あなたは誠実で優秀な日本人のアシスタントです。<</SYS>>明日の天気は?[/INST]'
puts LLaMACpp.generate(context, prompt, n_threads: 16, n_predict: 256)


          fix: set encoding to avoid Encoding::CompatibilityError

4461d6e

yoshoku approved these changes

View reviewed changes

Owner

yoshoku left a comment

thank you

yoshoku merged commit 77613a3 into yoshoku:main

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet