Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Support offline batch inference mode #68

Closed
zqhuang211 opened this issue Aug 5, 2024 · 1 comment
Closed

Support offline batch inference mode #68

zqhuang211 opened this issue Aug 5, 2024 · 1 comment
Assignees
@liPatrick

Comments

@zqhuang211
Copy link
Contributor

Currently, the inference module only supports processing one sample at a time. It needs to be updated to support batch mode for both synthetic data generation (e.g., continuation) and after evaluation.
@liPatrick liPatrick mentioned this issue Aug 19, 2024
Merged
@juberti
Copy link
Contributor

juberti commented Aug 21, 2024 •
edited
Loading

Fixed in #82

@juberti juberti closed this as completed Aug 21, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@liPatrick liPatrick

Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
3 participants
@juberti @liPatrick @zqhuang211