Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Update bug_report.yml [Invite users to explicitly state what model they are using that resulted in the issue] #1811

Merged
merged 1 commit into from
Mar 1, 2024

Conversation

victordibia
Copy link
Collaborator

@victordibia victordibia commented Feb 28, 2024

What

This modification updates the "create bug" interface and asks the user to explicitly mention the model used in their experiments.

Why

Frequently, many issues can be better understood by reviewing the model used. For example, small models have limitations in their ability to generate code in code blocks or follow complex instructions leading to errors.

Before/after
image

Why are these changes needed?

Related issue number

Checks

## What
This modification asks the user to explicitly mention the model used in their experiments. 


## Why
Frequently, many issues can be better understood by reviewing the model used. For example, small models have limitations in their ability to generate code in code blocks or follow complex instructions leading to errors.
@victordibia victordibia changed the title Update bug_report.yml Update bug_report.yml [Invite users to explicitly state what model they are using that resulted in the issue] Feb 28, 2024
@victordibia
Copy link
Collaborator Author

@gagb .. wdyt

Copy link
Contributor

@abhaymathur21 abhaymathur21 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

That's a good idea. I think your before and after pictures attached are mixed up though right?

@abhaymathur21
Copy link
Contributor

Do you think it would also be helpful if we asked them to specify which OS/environment they're working in as well? A lot of the time bugs are caused due to platform incompatibility as well.

@victordibia victordibia added this pull request to the merge queue Mar 1, 2024
Merged via the queue into main with commit 2b8b55b Mar 1, 2024
22 checks passed
@archit15singh
Copy link

Thanks for this!

@sonichi sonichi deleted the victordibia-addmodel-issuetemplate branch March 1, 2024 15:00
whiskyboy pushed a commit to whiskyboy/autogen that referenced this pull request Apr 17, 2024
## What
This modification asks the user to explicitly mention the model used in their experiments. 


## Why
Frequently, many issues can be better understood by reviewing the model used. For example, small models have limitations in their ability to generate code in code blocks or follow complex instructions leading to errors.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants