Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Fix required llama-cpp-agent version #138

Open
wants to merge 1 commit into
base: main
Choose a base branch
from

Conversation

dinerburger
Copy link

The Get Keywords node fails as llama-cpp-agent has refactored structured output. This moves back to a pre-April 29 2024 version to ensure the API is the expected one.

@gokayfem
Copy link
Owner

Locking this version can cause locking some libraries it is depending. I am not sure about doing this. I want VLM nodes to be version free. It is better to fix the node instead of locking the version.

@dinerburger
Copy link
Author

I did try; wasn't sure how to send grammar down, though the temperature setting went into the sampling_settings field okay.

@Mister-Link
Copy link

Definitely broken for several nodes (anything that uses "temperature" as a parameter, in my case). There's no alternative to dinerburger's fix:

pip uninstall llama-cpp-agent
pip install llama-cpp-agent==0.0.26

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants