Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

InfiAgent-DABench #1494

Merged
merged 16 commits into from
Oct 28, 2024
Merged

InfiAgent-DABench #1494

merged 16 commits into from
Oct 28, 2024

Conversation

kithib
Copy link
Contributor

@kithib kithib commented Oct 8, 2024

Features
This PR is used to solve the InfiAgent-DABench using Data Interpreter (DI), and obtains 94.93% accuracy using gpt-4o

Feature Docs
detailed in README.md

Result
截屏2024-10-28 21 59 38

kithib and others added 4 commits October 8, 2024 23:18
1
Signed-off-by: kit <101046518@qq.com>
1
Signed-off-by: kit <101046518@qq.com>
1
Signed-off-by: kit <101046518@qq.com>
1
Signed-off-by: kit <101046518@qq.com>
@codecov-commenter
Copy link

codecov-commenter commented Oct 8, 2024

⚠️ Please install the 'codecov app svg image' to ensure uploads and comments are reliably processed by Codecov.

Codecov Report

All modified and coverable lines are covered by tests ✅

Project coverage is 62.56%. Comparing base (bdba23e) to head (0c16c32).

❗ Your organization needs to install the Codecov GitHub app to enable full functionality.

Additional details and impacted files
@@           Coverage Diff           @@
##             main    #1494   +/-   ##
=======================================
  Coverage   62.56%   62.56%           
=======================================
  Files         287      287           
  Lines       17602    17603    +1     
=======================================
+ Hits        11012    11013    +1     
  Misses       6590     6590           
Flag Coverage Δ
?

Flags with carried forward coverage won't be shown. Click here to find out more.

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

@stellaHSR
Copy link
Collaborator

Thanks. Some pre-commit checks didn't pass. Please install pre-commit locally and rerun the checks before submitting again.

kit added 2 commits October 9, 2024 21:26
1
Signed-off-by: kit <101046518@qq.com>
# Conflicts:
#	examples/di/InfiAgent-DABench/README.md
1
Signed-off-by: kit <101046518@qq.com>
@stellaHSR stellaHSR self-assigned this Oct 9, 2024
@kithib
Copy link
Contributor Author

kithib commented Oct 9, 2024

Thanks. Some pre-commit checks didn't pass. Please install pre-commit locally and rerun the checks before submitting again.
ok

kit added 2 commits October 10, 2024 13:46
1
Signed-off-by: kit <101046518@qq.com>
# Conflicts:
#	examples/di/InfiAgent-DABench/README.md
metagpt/const.py Outdated Show resolved Hide resolved
examples/di/InfiAgent-DABench/DABench.py Outdated Show resolved Hide resolved
examples/di/InfiAgent-DABench/DABench.py Outdated Show resolved Hide resolved
examples/di/InfiAgent-DABench/DABench.py Outdated Show resolved Hide resolved
examples/di/InfiAgent-DABench/DABench.py Outdated Show resolved Hide resolved
examples/di/InfiAgent-DABench/README.md Outdated Show resolved Hide resolved
examples/di/InfiAgent-DABench/run_InfiAgent-DABench.py Outdated Show resolved Hide resolved
examples/di/InfiAgent-DABench/run_InfiAgent-DABench_all.py Outdated Show resolved Hide resolved
examples/di/InfiAgent-DABench/run_InfiAgent-DABench_all.py Outdated Show resolved Hide resolved
1
Signed-off-by: kit <101046518@qq.com>
1
Signed-off-by: kit <101046518@qq.com>
examples/di/InfiAgent-DABench/README.md Outdated Show resolved Hide resolved
examples/di/InfiAgent-DABench/run_InfiAgent-DABench.py Outdated Show resolved Hide resolved
examples/di/InfiAgent-DABench/DABench.py Outdated Show resolved Hide resolved
examples/di/InfiAgent-DABench/DABench.py Outdated Show resolved Hide resolved
examples/di/InfiAgent-DABench/run_InfiAgent-DABench.py Outdated Show resolved Hide resolved
examples/di/InfiAgent-DABench/run_InfiAgent-DABench_all.py Outdated Show resolved Hide resolved
@geekan
Copy link
Owner

geekan commented Oct 27, 2024

BTW, the picture is not displayed properly.

1
Signed-off-by: kit <101046518@qq.com>
1
Signed-off-by: kit <101046518@qq.com>
@kithib
Copy link
Contributor Author

kithib commented Oct 28, 2024

BTW, the picture is not displayed properly.

截屏2024-10-28 21 59 38

@stellaHSR
Copy link
Collaborator

LGTM

1
Signed-off-by: kit <101046518@qq.com>
Copy link
Owner

@geekan geekan left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@geekan geekan merged commit 4dc1a38 into geekan:main Oct 28, 2024
1 of 3 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

5 participants