Skip to content

Commit

Permalink
feat: Update promptfoo eval command in Makefile
Browse files Browse the repository at this point in the history
This commit updates the promptfoo eval command in the Makefile to include the option to specify the name of the eval directory. This allows for more flexibility when running evaluations.
  • Loading branch information
ZanzyTHEbar committed Jun 20, 2024
1 parent c61ba48 commit ea7e5e8
Show file tree
Hide file tree
Showing 2 changed files with 6 additions and 6 deletions.
2 changes: 1 addition & 1 deletion test/evals/promptfoo-poc/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -20,7 +20,7 @@ To run or create evals, you will need to have the following installed:
To run the evaluations, you can cd into the relevant directory and use the following command:

```bash
make evals
make eval <name_of_eval_dir>
```

Or, you can run all the evaluations by running the following command:
Expand Down
10 changes: 5 additions & 5 deletions test/evals/promptfoo-poc/fix/fix.prompt.txt
Original file line number Diff line number Diff line change
Expand Up @@ -84,12 +84,12 @@ You MUST ensure the line numbers for the 'old' property correctly remove *ALL* c
Example change object:
---
{
summary: "Fix syntax error in loop body.",
old: {
startLineString: "pdx-5: for i := 0; i < 10; i++ { ",
endLineString: "pdx-7: }",
"summary": "Fix syntax error in loop body.",
"old": {
"startLineString": "pdx-5: for i := 0; i < 10; i++ { ",
"endLineString": "pdx-7: }"
},
new: "for i := 0; i < 10; i++ {\n execQuery()\n }\n }\n}",
"new": "for i := 0; i < 10; i++ {\n execQuery()\n }\n }\n}"
}
---

Expand Down

0 comments on commit ea7e5e8

Please sign in to comment.