Update Action Graph Solver Version 0.1 #1428

didiforgithub · 2024-07-31T10:24:30Z

Features

update action graph solver's basic Implement

codecov-commenter · 2024-07-31T10:32:59Z

⚠️ Please install the to ensure uploads and comments are reliably processed by Codecov.

Codecov Report

Attention: Patch coverage is 4.08163% with 141 lines in your changes missing coverage. Please review.

Project coverage is 35.57%. Comparing base (5446c7e) to head (d671e6c).

Files	Patch %	Lines
metagpt/actions/code_sanitize.py	3.96%	121 Missing ⚠️
metagpt/actions/action_node.py	4.76%	20 Missing ⚠️

❗ Your organization needs to install the Codecov GitHub app to enable full functionality.

Additional details and impacted files

@@                Coverage Diff                @@
##           action_graph    #1428       +/-   ##
=================================================
- Coverage         62.34%   35.57%   -26.78%     
=================================================
  Files               283      284        +1     
  Lines             17371    17518      +147     
=================================================
- Hits              10830     6232     -4598     
- Misses             6541    11286     +4745

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

examples/ags/benchmark/hotpotQA.py

examples/ags/benchmark/humaneval.py

examples/ags/w_action_node/graph.py

examples/ags/w_action_node/prompt.py

metagpt/actions/code_sanitize.py

examples/ags/benchmark/gsm8k.py

metagpt/actions/code_sanitize.py

examples/ags/w_action_node/graph.py

test.py

better629 · 2024-07-31T11:05:25Z

examples/ags/benchmark/data/gsm8k_main_test.jsonl

@@ -0,0 +1,1319 @@
+{"question":"Janet\u2019s ducks lay 16 eggs per day. She eats three for breakfast every morning and bakes muffins for her friends every day with four. She sells the remainder at the farmers' market daily for $2 per fresh duck egg. How much in dollars does she make every day at the farmers' market?","answer":"Janet sells 16 - 3 - 4 = <<16-3-4=9>>9 duck eggs a day.\nShe makes 9 * 2 = $<<9*2=18>>18 every day at the farmer\u2019s market.\n#### 18"}


why not load hf dataset directly

有关HotPotQA与GSM8k数据集评测的内容之后@issacjinyu来再做一次提交

examples/ags/benchmark/gsm8k.py

examples/ags/benchmark/hotpotQA.py

examples/ags/benchmark/humaneval.py

examples/ags/w_action_node/operator.py

examples/ags/w_action_node/prompt.py

better629 · 2024-07-31T11:37:05Z

examples/ags/w_action_node/utils.py

+
+    return test_cases
+
+async def llm_extract_test_case(id, problem_description: str, file_path:str="public_test.jsonl"):


put test_case in your ut files?

metagpt/actions/action_node.py

test.py

examples/ags/w_action_node/utils.py

Update Action Graph Solver Version 0.1

686b1cd

didiforgithub had a problem deploying to unittest July 31, 2024 10:24 — with GitHub Actions Failure

didiforgithub had a problem deploying to pre-commit July 31, 2024 10:24 — with GitHub Actions Failure

stellaHSR reviewed Jul 31, 2024

View reviewed changes

geekan reviewed Jul 31, 2024

View reviewed changes

better629 reviewed Jul 31, 2024

View reviewed changes

Update Code Review

6d4c72c

didiforgithub had a problem deploying to unittest August 1, 2024 06:21 — with GitHub Actions Failure

didiforgithub temporarily deployed to pre-commit August 1, 2024 06:21 — with GitHub Actions Inactive

Update action_node.py

d671e6c

didiforgithub had a problem deploying to unittest August 1, 2024 06:24 — with GitHub Actions Failure

didiforgithub temporarily deployed to pre-commit August 1, 2024 06:24 — with GitHub Actions Inactive

geekan reviewed Aug 1, 2024

View reviewed changes

test.py Outdated Show resolved Hide resolved

examples/ags/w_action_node/utils.py Outdated Show resolved Hide resolved

Update humaneval benchmark & utils; fixs some bug in action node.

96bd310

didiforgithub had a problem deploying to unittest August 1, 2024 07:34 — with GitHub Actions Failure

didiforgithub had a problem deploying to pre-commit August 1, 2024 07:34 — with GitHub Actions Failure

geekan approved these changes Aug 1, 2024

View reviewed changes

Fix pre-commit

2a1bcc1

didiforgithub had a problem deploying to unittest August 1, 2024 07:38 — with GitHub Actions Failure

didiforgithub temporarily deployed to pre-commit August 1, 2024 07:39 — with GitHub Actions Inactive

geekan approved these changes Aug 1, 2024

View reviewed changes

geekan merged commit d867b60 into geekan:action_graph Aug 1, 2024
1 of 3 checks passed

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Update Action Graph Solver Version 0.1 #1428

Update Action Graph Solver Version 0.1 #1428

didiforgithub commented Jul 31, 2024

codecov-commenter commented Jul 31, 2024 •

edited

Loading

better629 Jul 31, 2024

didiforgithub Aug 1, 2024

better629 Jul 31, 2024

		@@ -0,0 +1,1319 @@
		{"question":"Janet\u2019s ducks lay 16 eggs per day. She eats three for breakfast every morning and bakes muffins for her friends every day with four. She sells the remainder at the farmers' market daily for $2 per fresh duck egg. How much in dollars does she make every day at the farmers' market?","answer":"Janet sells 16 - 3 - 4 = <<16-3-4=9>>9 duck eggs a day.\nShe makes 9 * 2 = $<<9*2=18>>18 every day at the farmer\u2019s market.\n#### 18"}


		return test_cases

		async def llm_extract_test_case(id, problem_description: str, file_path:str="public_test.jsonl"):

Update Action Graph Solver Version 0.1 #1428

Update Action Graph Solver Version 0.1 #1428

Conversation

didiforgithub commented Jul 31, 2024

codecov-commenter commented Jul 31, 2024 • edited Loading

Codecov Report

better629 Jul 31, 2024

Choose a reason for hiding this comment

didiforgithub Aug 1, 2024

Choose a reason for hiding this comment

better629 Jul 31, 2024

Choose a reason for hiding this comment

codecov-commenter commented Jul 31, 2024 •

edited

Loading