Cannot use prompt experiments "No dataset item contains any variables" #4418
-
Beta Was this translation helpful? Give feedback.
Replies: 5 comments 3 replies
-
Hey @j10sanders! I'm a bot here to help you with bugs, questions, and becoming a contributor. Let's tackle this issue together! To resolve the error "No dataset item contains any variables," ensure that your dataset items are correctly structured and mapped to the variables in your prompt. Here’s what you need to check:
By ensuring these configurations, your prompt experiments should recognize the "input" field and run without errors [1][2]. |
Beta Was this translation helpful? Give feedback.
-
here is a demo I made for this "discussion", and I get the same error |
Beta Was this translation helpful? Give feedback.
-
Hi @j10sanders, The input within the dataset needs to be a key-value JSON object (we will simplify this in the future). Examples from docs: https://langfuse.com/docs/datasets/prompt-experiments Example Dataset input
Example prompt
Hope this helps! |
Beta Was this translation helpful? Give feedback.
-
@marcklingen My prompt contains the following variables: context, first_message, currentDatetime {
"context": "Was previously looking for a home in the Fredericksburg or Northern virginia area and was previously looking for possible payment options.",
"question": "No specifics ",
"first_message": "Hi Ben, are you still searching for a home in Fredericksburg or Northern Virginia? We’d love to help explore payment options again. -Eva, Client Concierge, Rumph Realty Reply N to stop messages",
"currentDatetime": "2024-11-26T19:22:00"
} And I don't get the error anymore |
Beta Was this translation helpful? Give feedback.
-
@marcklingen The thing is, I don't use the question variable in my prompt. I give this prompt to the Tool Agent in Flowise and I don't have to give the user's query as a placeholder. The goal is to having the prompt stored in Langfused to be automatically promoted as the new prompt of our agent, and we would use webhooks for that, when you guys add them in the system |
Beta Was this translation helpful? Give feedback.
Hi @j10sanders,
The input within the dataset needs to be a key-value JSON object (we will simplify this in the future).
Examples from docs: https://langfuse.com/docs/datasets/prompt-experiments
Example Dataset input
Example prompt
Hope this helps!