add a verbose flag to let gpt assistant print more log #717

IANTHEREAL · 2023-11-19T01:30:46Z

Why are these changes needed?

Let GPT Assistant be able to print input/output of function call using a verbose flag

Related issue number

Checks

I've included any doc changes needed for https://microsoft.github.io/autogen/. See https://microsoft.github.io/autogen/docs/Contribute#documentation to build and test documentation locally.
I've added tests (if relevant) corresponding to the changes introduced in this PR.
I've made sure all auto checks have passed.

codecov-commenter · 2023-11-19T01:33:21Z

Codecov Report

Attention: 4 lines in your changes are missing coverage. Please review.

Comparison is base (55b9d0b) 26.65% compared to head (2dbac21) 38.12%.

Files	Patch %	Lines
autogen/agentchat/contrib/gpt_assistant_agent.py	0.00%	2 Missing ⚠️
autogen/agentchat/conversable_agent.py	33.33%	1 Missing and 1 partial ⚠️

Additional details and impacted files

@@             Coverage Diff             @@
##             main     #717       +/-   ##
===========================================
+ Coverage   26.65%   38.12%   +11.46%     
===========================================
  Files          28       28               
  Lines        3722     3725        +3     
  Branches      846      847        +1     
===========================================
+ Hits          992     1420      +428     
+ Misses       2658     2182      -476     
- Partials       72      123       +51

Flag	Coverage Δ
unittests	`38.06% <20.00%> (+11.46%)`	⬆️

Flags with carried forward coverage won't be shown. Click here to find out more.

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

rickyloynd-microsoft · 2023-11-19T04:43:24Z

@gagb fyi

sonichi · 2023-11-19T18:00:46Z

Looks good. Please make sure @kevin666aa approves before merging.

gagb · 2023-11-20T18:28:52Z

@IANTHEREAL should we first get this merged and base this on it? https://github.com/microsoft/autogen/pull/665/files I worry that there are some overlaps -- it also added kwargs and added some additional logging.

IANTHEREAL · 2023-11-21T00:27:46Z

@IANTHEREAL should we first get this merged and base this on it? https://github.com/microsoft/autogen/pull/665/files I worry that there are some overlaps -- it also added kwargs and added some additional logging.

@gagb no problem

…n_print

sonichi · 2023-12-04T14:16:12Z

The user seems more urgent about this PR request: #715. I borrowed the kwargs parameter from #665, keeping the necessary parameters simple. Additionally, compared to logging output, I prefer to use a unified format in the ConversableAgent to output complete function execution information when needed by the user. This kind of output is more understandable and convenient for tracking.

@gagb @sonichi @kevin666aa PTAL

@sidhujag FYI.
@gagb @kevin666aa @LeoLjl @qingyun-wu PTAL.

qingyun-wu

LGTM!

…ith output examples.

…d to #846 (#865) * try to fix blog * modify blog * fix test error in #717; fix blog typo in installation; update blogs with output examples. * pre-commit * pre-commit * Update website/blog/2023-11-26-Agent-AutoBuild/index.mdx Co-authored-by: Qingyun Wu <qingyun.wu@psu.edu> * add future work * fix grammar --------- Co-authored-by: Jieyu Zhang <jieyuz2@cs.washington.edu> Co-authored-by: Qingyun Wu <qingyun.wu@psu.edu>

* try to fix blog * modify blog * fix test error in #717; fix blog typo in installation; update blogs with output examples. * pre-commit * pre-commit * Update website/blog/2023-11-26-Agent-AutoBuild/index.mdx Co-authored-by: Qingyun Wu <qingyun.wu@psu.edu> * add future work * fix grammar * update agent_builder --------- Co-authored-by: Jieyu Zhang <jieyuz2@cs.washington.edu> Co-authored-by: Qingyun Wu <qingyun.wu@psu.edu>

…tion (#944) * try to fix blog * modify blog * fix test error in #717; fix blog typo in installation; update blogs with output examples. * pre-commit * pre-commit * Update website/blog/2023-11-26-Agent-AutoBuild/index.mdx Co-authored-by: Qingyun Wu <qingyun.wu@psu.edu> * add future work * fix grammar * update agent_builder * solve #941; add detailed debug info; support json string config * pre-commit * solve #954 * pre-commit --------- Co-authored-by: Jieyu Zhang <jieyuz2@cs.washington.edu> Co-authored-by: Qingyun Wu <qingyun.wu@psu.edu>

Co-authored-by: Qingyun Wu <qingyun.wu@psu.edu>

…d to microsoft#846 (microsoft#865) * try to fix blog * modify blog * fix test error in microsoft#717; fix blog typo in installation; update blogs with output examples. * pre-commit * pre-commit * Update website/blog/2023-11-26-Agent-AutoBuild/index.mdx Co-authored-by: Qingyun Wu <qingyun.wu@psu.edu> * add future work * fix grammar --------- Co-authored-by: Jieyu Zhang <jieyuz2@cs.washington.edu> Co-authored-by: Qingyun Wu <qingyun.wu@psu.edu>

…osoft#917) * try to fix blog * modify blog * fix test error in microsoft#717; fix blog typo in installation; update blogs with output examples. * pre-commit * pre-commit * Update website/blog/2023-11-26-Agent-AutoBuild/index.mdx Co-authored-by: Qingyun Wu <qingyun.wu@psu.edu> * add future work * fix grammar * update agent_builder --------- Co-authored-by: Jieyu Zhang <jieyuz2@cs.washington.edu> Co-authored-by: Qingyun Wu <qingyun.wu@psu.edu>

…tion (microsoft#944) * try to fix blog * modify blog * fix test error in microsoft#717; fix blog typo in installation; update blogs with output examples. * pre-commit * pre-commit * Update website/blog/2023-11-26-Agent-AutoBuild/index.mdx Co-authored-by: Qingyun Wu <qingyun.wu@psu.edu> * add future work * fix grammar * update agent_builder * solve microsoft#941; add detailed debug info; support json string config * pre-commit * solve microsoft#954 * pre-commit --------- Co-authored-by: Jieyu Zhang <jieyuz2@cs.washington.edu> Co-authored-by: Qingyun Wu <qingyun.wu@psu.edu>

…ng agent descriptions (#1039) * try to fix blog * modify blog * fix test error in #717; fix blog typo in installation; update blogs with output examples. * pre-commit * pre-commit * Update website/blog/2023-11-26-Agent-AutoBuild/index.mdx Co-authored-by: Qingyun Wu <qingyun.wu@psu.edu> * add future work * fix grammar * update agent_builder * solve #941; add detailed debug info; support json string config * pre-commit * solve #954 * pre-commit * [new feature] build group chat agents from library. * pre-commit * add authors' info in notebook; add a new notebook for build_from_library; reduce prompt effort * update test and example for build_from_library * pre-commit * add notebook; update docs * change notebook name * change description for notebook and doc * remove default value for default_llm_config * add embedding similarity agent selection * pre-commit * update test * add dependency installation in github workflow * update test * pre-commit * update notebook * support directly json as library; support customize embedding model * update test * pre-commit * update github test workflow * Update autobuild_agent_library.ipynb * add agent description * refine prompt; update notebook * pre-commit * update test example * update test * update test * update test * change `config_path` to `config_path_or_env`; update test * pre-commit * update test * update test * update test: add config_file_location * change `config_path_or_env` to `config_file_or_env` * update test * solve noqa * fix import error for conftest * fix test error * pre-commit * * update error message in `_create_agent`. * replace `gpt-4-1106-preview` to `gpt-4` in test file. * add comment on local server creation; modify notebook; update contrib-openai.yml for test; add autobuild option in setup.py; add autotest model name statement * move import huggingface_hub to _create_agent * pre-commit * add uncover comment in the endpoint creation code block * recover contrib-openai.yml for merge --------- Co-authored-by: Jieyu Zhang <jieyuz2@cs.washington.edu> Co-authored-by: Qingyun Wu <qingyun.wu@psu.edu>

* try to fix blog * modify blog * fix test error in #717; fix blog typo in installation; update blogs with output examples. * pre-commit * pre-commit * Update website/blog/2023-11-26-Agent-AutoBuild/index.mdx Co-authored-by: Qingyun Wu <qingyun.wu@psu.edu> * add future work * fix grammar * update agent_builder * solve #941; add detailed debug info; support json string config * pre-commit * solve #954 * pre-commit * [new feature] build group chat agents from library. * pre-commit * add authors' info in notebook; add a new notebook for build_from_library; reduce prompt effort * update test and example for build_from_library * pre-commit * add notebook; update docs * change notebook name * change description for notebook and doc * remove default value for default_llm_config * add embedding similarity agent selection * pre-commit * update test * add dependency installation in github workflow * update test * pre-commit * update notebook * support directly json as library; support customize embedding model * update test * pre-commit * update github test workflow * Update autobuild_agent_library.ipynb * add agent description * refine prompt; update notebook * pre-commit * update test example * update test * update test * update test * change `config_path` to `config_path_or_env`; update test * pre-commit * update test * update test * update test: add config_file_location * change `config_path_or_env` to `config_file_or_env` * update test * solve noqa * fix import error for conftest * fix test error * pre-commit * * update error message in `_create_agent`. * replace `gpt-4-1106-preview` to `gpt-4` in test file. * add comment on local server creation; modify notebook; update contrib-openai.yml for test; add autobuild option in setup.py; add autotest model name statement * move import huggingface_hub to _create_agent * pre-commit * add uncover comment in the endpoint creation code block * recover contrib-openai.yml for merge * remove TERMINATE assertion for sys msg * remove TERMINATE assertion --------- Co-authored-by: Jieyu Zhang <jieyuz2@cs.washington.edu> Co-authored-by: Qingyun Wu <qingyun.wu@psu.edu>

Co-authored-by: Qingyun Wu <qingyun.wu@psu.edu>

…d to microsoft#846 (microsoft#865) * try to fix blog * modify blog * fix test error in microsoft#717; fix blog typo in installation; update blogs with output examples. * pre-commit * pre-commit * Update website/blog/2023-11-26-Agent-AutoBuild/index.mdx Co-authored-by: Qingyun Wu <qingyun.wu@psu.edu> * add future work * fix grammar --------- Co-authored-by: Jieyu Zhang <jieyuz2@cs.washington.edu> Co-authored-by: Qingyun Wu <qingyun.wu@psu.edu>

…osoft#917) * try to fix blog * modify blog * fix test error in microsoft#717; fix blog typo in installation; update blogs with output examples. * pre-commit * pre-commit * Update website/blog/2023-11-26-Agent-AutoBuild/index.mdx Co-authored-by: Qingyun Wu <qingyun.wu@psu.edu> * add future work * fix grammar * update agent_builder --------- Co-authored-by: Jieyu Zhang <jieyuz2@cs.washington.edu> Co-authored-by: Qingyun Wu <qingyun.wu@psu.edu>

…tion (microsoft#944) * try to fix blog * modify blog * fix test error in microsoft#717; fix blog typo in installation; update blogs with output examples. * pre-commit * pre-commit * Update website/blog/2023-11-26-Agent-AutoBuild/index.mdx Co-authored-by: Qingyun Wu <qingyun.wu@psu.edu> * add future work * fix grammar * update agent_builder * solve microsoft#941; add detailed debug info; support json string config * pre-commit * solve microsoft#954 * pre-commit --------- Co-authored-by: Jieyu Zhang <jieyuz2@cs.washington.edu> Co-authored-by: Qingyun Wu <qingyun.wu@psu.edu>

…ng agent descriptions (microsoft#1039) * try to fix blog * modify blog * fix test error in microsoft#717; fix blog typo in installation; update blogs with output examples. * pre-commit * pre-commit * Update website/blog/2023-11-26-Agent-AutoBuild/index.mdx Co-authored-by: Qingyun Wu <qingyun.wu@psu.edu> * add future work * fix grammar * update agent_builder * solve microsoft#941; add detailed debug info; support json string config * pre-commit * solve microsoft#954 * pre-commit * [new feature] build group chat agents from library. * pre-commit * add authors' info in notebook; add a new notebook for build_from_library; reduce prompt effort * update test and example for build_from_library * pre-commit * add notebook; update docs * change notebook name * change description for notebook and doc * remove default value for default_llm_config * add embedding similarity agent selection * pre-commit * update test * add dependency installation in github workflow * update test * pre-commit * update notebook * support directly json as library; support customize embedding model * update test * pre-commit * update github test workflow * Update autobuild_agent_library.ipynb * add agent description * refine prompt; update notebook * pre-commit * update test example * update test * update test * update test * change `config_path` to `config_path_or_env`; update test * pre-commit * update test * update test * update test: add config_file_location * change `config_path_or_env` to `config_file_or_env` * update test * solve noqa * fix import error for conftest * fix test error * pre-commit * * update error message in `_create_agent`. * replace `gpt-4-1106-preview` to `gpt-4` in test file. * add comment on local server creation; modify notebook; update contrib-openai.yml for test; add autobuild option in setup.py; add autotest model name statement * move import huggingface_hub to _create_agent * pre-commit * add uncover comment in the endpoint creation code block * recover contrib-openai.yml for merge --------- Co-authored-by: Jieyu Zhang <jieyuz2@cs.washington.edu> Co-authored-by: Qingyun Wu <qingyun.wu@psu.edu>

* try to fix blog * modify blog * fix test error in microsoft#717; fix blog typo in installation; update blogs with output examples. * pre-commit * pre-commit * Update website/blog/2023-11-26-Agent-AutoBuild/index.mdx Co-authored-by: Qingyun Wu <qingyun.wu@psu.edu> * add future work * fix grammar * update agent_builder * solve microsoft#941; add detailed debug info; support json string config * pre-commit * solve microsoft#954 * pre-commit * [new feature] build group chat agents from library. * pre-commit * add authors' info in notebook; add a new notebook for build_from_library; reduce prompt effort * update test and example for build_from_library * pre-commit * add notebook; update docs * change notebook name * change description for notebook and doc * remove default value for default_llm_config * add embedding similarity agent selection * pre-commit * update test * add dependency installation in github workflow * update test * pre-commit * update notebook * support directly json as library; support customize embedding model * update test * pre-commit * update github test workflow * Update autobuild_agent_library.ipynb * add agent description * refine prompt; update notebook * pre-commit * update test example * update test * update test * update test * change `config_path` to `config_path_or_env`; update test * pre-commit * update test * update test * update test: add config_file_location * change `config_path_or_env` to `config_file_or_env` * update test * solve noqa * fix import error for conftest * fix test error * pre-commit * * update error message in `_create_agent`. * replace `gpt-4-1106-preview` to `gpt-4` in test file. * add comment on local server creation; modify notebook; update contrib-openai.yml for test; add autobuild option in setup.py; add autotest model name statement * move import huggingface_hub to _create_agent * pre-commit * add uncover comment in the endpoint creation code block * recover contrib-openai.yml for merge * remove TERMINATE assertion for sys msg * remove TERMINATE assertion --------- Co-authored-by: Jieyu Zhang <jieyuz2@cs.washington.edu> Co-authored-by: Qingyun Wu <qingyun.wu@psu.edu>

add a verbose flag to print more information of runtime

e50f4c0

IANTHEREAL had a problem deploying to openai1 November 19, 2023 01:30 — with GitHub Actions Failure

IANTHEREAL changed the title ~~add a verbose flag to print more log~~ add a verbose flag to let gpt assistant print more log Nov 19, 2023

thatbreezeofmine approved these changes Nov 19, 2023

View reviewed changes

sonichi requested review from gagb, AaronWard, yiranwu0 and a team November 19, 2023 17:57

sonichi added function/tool suggestion and execution of function/tool call openai-assistant Issues related to assistants from OpenAI labels Nov 19, 2023

gagb mentioned this pull request Nov 21, 2023

Support openai assistant api #602

Closed

Merge branch 'main' into agent_function_print

c671179

qingyun-wu had a problem deploying to openai1 November 22, 2023 21:27 — with GitHub Actions Failure

IANTHEREAL mentioned this pull request Dec 4, 2023

[ENH] accessing the run steps with GPTAssistantAgent #715

Closed

Merge remote-tracking branch 'remotes/origin/main' into agent_functio…

8f86574

…n_print

IANTHEREAL had a problem deploying to openai1 December 4, 2023 08:44 — with GitHub Actions Failure

IANTHEREAL temporarily deployed to openai1 December 4, 2023 08:44 — with GitHub Actions Inactive

sonichi requested a review from sidhujag December 4, 2023 14:14

sonichi requested a review from LeoLjl December 4, 2023 14:16

qingyun-wu approved these changes Dec 4, 2023

View reviewed changes

yiranwu0 approved these changes Dec 4, 2023

View reviewed changes

qingyun-wu added this pull request to the merge queue Dec 4, 2023

Merged via the queue into microsoft:main with commit 26f6e0c Dec 4, 2023
80 of 84 checks passed

LinxinS97 added a commit that referenced this pull request Dec 4, 2023

fix test error in #717; fix blog typo in installation; update blogs w…

4b85616

…ith output examples.

IANTHEREAL deleted the agent_function_print branch December 5, 2023 00:57

rlam3 pushed a commit to rlam3/autogen that referenced this pull request Dec 19, 2023

add a verbose flag to print more information of runtime (microsoft#717)

ba39f1b

Co-authored-by: Qingyun Wu <qingyun.wu@psu.edu>

whiskyboy pushed a commit to whiskyboy/autogen that referenced this pull request Apr 17, 2024

add a verbose flag to print more information of runtime (microsoft#717)

079ba1a

Co-authored-by: Qingyun Wu <qingyun.wu@psu.edu>

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

add a verbose flag to let gpt assistant print more log #717

add a verbose flag to let gpt assistant print more log #717

IANTHEREAL commented Nov 19, 2023 •

edited

Loading

codecov-commenter commented Nov 19, 2023 •

edited

Loading

rickyloynd-microsoft commented Nov 19, 2023

sonichi commented Nov 19, 2023

gagb commented Nov 20, 2023

IANTHEREAL commented Nov 21, 2023

sonichi commented Dec 4, 2023

qingyun-wu left a comment

add a verbose flag to let gpt assistant print more log #717

add a verbose flag to let gpt assistant print more log #717

Conversation

IANTHEREAL commented Nov 19, 2023 • edited Loading

Why are these changes needed?

Related issue number

Checks

codecov-commenter commented Nov 19, 2023 • edited Loading

Codecov Report

rickyloynd-microsoft commented Nov 19, 2023

sonichi commented Nov 19, 2023

gagb commented Nov 20, 2023

IANTHEREAL commented Nov 21, 2023

sonichi commented Dec 4, 2023

qingyun-wu left a comment

Choose a reason for hiding this comment

IANTHEREAL commented Nov 19, 2023 •

edited

Loading

codecov-commenter commented Nov 19, 2023 •

edited

Loading