-
Notifications
You must be signed in to change notification settings - Fork 69
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Cannot get the service to return anything but a String
.
#671
Comments
If you can attach a sample application that we can use to run and debug things, that would be most helpful |
|
Thanks |
I assume I need some data as well? |
Nope |
I see what the problem is.
|
I tried with arrays before and got a funky error as well. |
Yeah, they don't work great |
Seems like in upstream the methods I need are private, so I'll have to open a PR to open them. |
At some point we probably want to write our own JsonSchema generater from a Jandex type (should be fairly easy), but I don't want to do it now since I have a talk next week. Maybe I can bait you into doing that? :P The upstream code that tries to do this is here. |
I wish I had time to do something like that, but I really can't promise anything soon. I also filed #675 which I hope I might be able to work on in the future. |
🙏🏼 |
It would be helpful if the new parser could be customized using the For example, today the use of the You must respond strictly in the following JSON format: <object_schema> With the custom parser, we could have control of the prefix, which could be enabled or disabled, with a property like quarkus.langchain4j.response-schema.prefix={true|false} This allows the developer to remove the prefix and add something else, for example if they are writing the prompt in a language other than English. |
That's a good point. We just need to do this at some point: I don't envision it to be more than a day's work (likely less) :) |
The docs at https://docs.quarkiverse.io/quarkus-langchain4j/dev/ai-services.html#_ai_method_return_type say I should be able to get a structured return type from my service, but it does not seem to support anything but a
String
.This generates the following exception:
So it looks like the generated service interface has
String
as a method return type.Also, @geoand told me:
But the docs say:
So that's contradictory.
The text was updated successfully, but these errors were encountered: