Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

support multiple LoRAs in batched inference scenario #903

Closed
wants to merge 13 commits into from
Closed

support multiple LoRAs in batched inference scenario #903

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
13 commits
Select commit Hold shift + click to select a range
1e955fb
support multiple LoRAs in batched inference scenario
pacman100 Sep 5, 2023
e13b3e8
support `generate` method
pacman100 Sep 5, 2023
2c19e65
fix shapes
pacman100 Sep 5, 2023
5cda44d
reformatting the logic
pacman100 Sep 5, 2023
cc07f3a
reset the multi batched inference attributes
pacman100 Sep 5, 2023
66ad736
use pre-forward hook
pacman100 Sep 5, 2023
b2c402b
clean up
pacman100 Sep 5, 2023
6cdf56a
fix the bugs
pacman100 Sep 5, 2023
4ce7c96
refactoring and simplifying logic
pacman100 Sep 5, 2023
b68add4
fix errors and tests
pacman100 Sep 5, 2023
4eb412f
fix bugs and tests
pacman100 Sep 5, 2023
19364f4
fix bugs
pacman100 Sep 5, 2023
918d4c6
add example
pacman100 Sep 5, 2023
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Loading