Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Implement event-driven persona updates #107

Open
wants to merge 7 commits into
base: alpha
Choose a base branch
from

Conversation

NeonDaniel
Copy link
Member

Description

Defines an SIO and MQ configured_personas_changed event
Emits updated personas any time the server makes a change to the database
Leaves existing logic untouched to allow clients to request an update from the server at any time

Issues

Relates to NeonGeckoCom/neon-llm-core#8

Other Notes

  • The emitted changes broadcast personas for all LLMs, where the existing queries are filtered by base LLM.
  • It appears that the existing requests do not include a User object, so the added functionality here also uses an empty User

…tted any time the server makes a change to the database

Leaves existing logic untouched to allow clients to request an update from the server at any time
Relates to NeonGeckoCom/neon-llm-core#8
… are in the same order of persona responses

Includes `update_time` in TTL cached query so cached responses include accurate timestamps
@NeonDaniel NeonDaniel marked this pull request as ready for review December 5, 2024 20:12
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants