Skip to content

Commit

Permalink
删掉重复的“测试结果”
Browse files Browse the repository at this point in the history
  • Loading branch information
ErnestinaQiu authored Jan 26, 2024
1 parent 0592931 commit b1a65a9
Showing 1 changed file with 0 additions and 11 deletions.
11 changes: 0 additions & 11 deletions pipelines/examples/tree-of-thought/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -176,17 +176,6 @@ python run.py \
*``tot/tasks/`` 中设置一个新的任务类和任务文件在 ``tot/data/`` 中。查看 ``tot/tasks/game24.py`` 以获取示例。将任务添加到 ``tot/tasks/__init__.py`` 中。
*``tot/prompts/`` 中设置任务特定的提示。查看 ``tot/prompts/game24.py`` 以获取示例。根据任务的性质,选择 ``--method_generate`` (choices=[``sample``, ``propose``]) 和 ``--method_evaluate`` (choices=[``value``, ``vote``]) 及其相应的提示。

## 测试结果
本测试采用的是paddlenlp中facebook/llama-2-7b-chat 和 facebook/llama-2-13b-chat.使用的参数为 temperature=0.6, decode_strategy为"greedy_search",max_new_tokens=512,结果如下
|model|method|acc|
|----|----|----|
|llama-2-7b-chat|cot|0|
|llama-2-7b-chat|standard sampling| 0|
|llama-2-7b-chat|ToT| 3%|
|llama-2-13b-chat|cot|0|
|llama-2-13b-chat|standard sampling|0|
|llama-2-13b-chat|ToT|2%|


## 致谢

Expand Down

0 comments on commit b1a65a9

Please sign in to comment.