Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

FIX: Sources from LLM #256

Closed
Tracked by #248 ...
Mookse opened this issue Jul 7, 2024 · 2 comments · Fixed by #258, #273 or #274
Closed
Tracked by #248 ...

FIX: Sources from LLM #256

Mookse opened this issue Jul 7, 2024 · 2 comments · Fixed by #258, #273 or #274
Assignees
Labels
bot bug Something isn't working enhancement New feature or request

Comments

@Mookse
Copy link
Member

Mookse commented Jul 7, 2024

OpenAI GPT engines return not only source references but sources. For phase one, given the non-sensitivity of our public content (yes, that's tautological), we can just remove them. Phase two, we'll need to honor and sophisticate.
Worth noting that this particular hallucination was able to draw up its own hallucinatory source. Although, oof, as I look at it, linguistically, the trick is ingenius. While referencing a sane object in the system (a biographer bot), and by wrapping Walter in quotes, the poor dumb kid Q never had a chance. That said, I bet it can hallucinate sources, but these may not be they.
image
In reality, there are no walters in the system, nor would Q have access to that information (at least at this stage, Oy future KM!), so it's not a security issue in this instance, but a fine illustration of how to test!!!

@Mookse Mookse added bug Something isn't working enhancement New feature or request bot labels Jul 7, 2024
@Mookse Mookse self-assigned this Jul 7, 2024
@Mookse Mookse mentioned this issue Jul 7, 2024
3 tasks
@Mookse Mookse moved this from To triage to Backlog in MyLife Alpha MVP Build Jul 7, 2024
@Mookse Mookse moved this from Backlog to In progress in MyLife Alpha MVP Build Jul 7, 2024
@Mookse
Copy link
Member Author

Mookse commented Jul 7, 2024

  • content removed
    const rSource = /【.*?\】/gs
    const rLines = /\n{2,}/g

@Mookse Mookse moved this from Open to In Development in MyLife Alpha-Talc Jul 7, 2024
@Mookse Mookse moved this from In Development to In Testing in MyLife Alpha-Talc Jul 7, 2024
@Mookse Mookse mentioned this issue Jul 9, 2024
3 tasks
@Mookse Mookse linked a pull request Jul 9, 2024 that will close this issue
3 tasks
@Mookse
Copy link
Member Author

Mookse commented Jul 9, 2024

ready for phase 2 from description

@Mookse Mookse moved this from In progress to Backlog in MyLife Alpha MVP Build Jul 9, 2024
@Mookse Mookse linked a pull request Jul 16, 2024 that will close this issue
14 tasks
@github-project-automation github-project-automation bot moved this from In Testing to Done in MyLife Alpha-Talc Jul 16, 2024
@github-project-automation github-project-automation bot moved this from Backlog to Done in MyLife Alpha MVP Build Jul 16, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment