Bump Inference APIs to Neuron 2.13 #206
Merged
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Collaborator
JingyaHuang
commented
Aug 29, 2023
•
JingyaHuang
commented
- Unblock VAE encoder
- Remove optimized cross-attention score workaround
- Unblock dynamic batching test
- Update documentation
|
The docs for this PR live here. All of your documentation changes will be reflected on that endpoint. |
philschmid
approved these changes
Aug 30, 2023
| @@ -226,6 +231,7 @@ optimum-cli export neuron --model stabilityai/stable-diffusion-2-1-base \ | |||
| --batch_size 1 \ | |||
| --height 512 `# height in pixels of generated image, eg. 512, 768` \ | |||
| --width 512 `# width in pixels of generated image, eg. 512, 768` \ | |||
| --num_image_per_prompt 4 `# number of images to generate per prompt, defaults to 1` \ | |||
There was a problem hiding this comment.
is this needed with dynamic batching support now?
There was a problem hiding this comment.
If we turn on dynamic batching, we can input any batch size / number images per prompt, but by default the dynamic batch size is turned off, so we can keep the snippet this way I think.
dacorvo
approved these changes
Aug 30, 2023
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.