Skip to content

Commit

Permalink
TEST DRAFT
Browse files Browse the repository at this point in the history
  • Loading branch information
TartanMalcolm committed Oct 3, 2024
1 parent de91c0f commit cb18df6
Show file tree
Hide file tree
Showing 6 changed files with 400 additions and 1 deletion.
12 changes: 12 additions & 0 deletions info/global-definitions.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,12 @@
# Gobal Definitions

The following are the definitions to use. The supercede any other expectations you may have.

AGENT: A system prompt for an AI.
TEST FORMAT: The format detailed below. All TESTS must follow this format.
TARGET: the AGENT against which the TESTS are run. TARGETS are to carry out the ACTIONS detailed in the TESTS.
ASSESSOR: [test-file-runner](agents/test-assessor.md)
FILE-RUNNER: [test-file-runner](agents/test-file-runner.md)
EXPECTATIONS: A description of the required state of the TARGET and its data after the TEST has been run. If the actual result is different from this description, it fails. Otherwise, it passes.
PROMT: A natural language interaction with the TARGET. A PROMPT has an EXPECATION as to the result of running the PROMPT against the TARGET.
PRONT CHAIN: A list of PROMPTS which are, in the sequence they're given, carried out one after the other against a TARGET. PROMPT CHAINS are only ever compared to their EXPECTATION after the last PROMPT in the PROMPT CHAIN.
5 changes: 5 additions & 0 deletions info/test-agents.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,5 @@

- `agents/test-file-runner.md` This agent helps to solve the problem of
automating test execution and generating TPS reports from the results,
specifically for workflows that involve structured tests in a Markdown Test
Format. It addresses several challenges:
Loading

0 comments on commit cb18df6

Please sign in to comment.