Skip to content

Issues: ELS-RD/transformer-deploy

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

52 Open 69 Closed
52 Open 69 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

Encounter Error: ValueError: Message onnx.ModelProto exceeds maximum protobuf size of 2GB
#183 opened Mar 4, 2024 by illumination-k
the performance of onxx fp16 seems to be even worse than that of onnx fp32
#182 opened Nov 3, 2023 by lierer007
Unable To use batching
#180 opened Oct 13, 2023 by rahulmate
1
unable to host .onnx model on triton server
#179 opened Jul 19, 2023 by riyaj8888
GPTModelWrapper' object has no attribute 'can_generate'
#177 opened Jul 13, 2023 by jxcomeon
1
unable to do tensorrt inference
#176 opened Jul 12, 2023 by riyaj8888
No supported GPU(s) detected to run this container
#175 opened Jul 7, 2023 by sinankefeli
convert_model command not found
#173 opened May 23, 2023 by pint1022
3
Tokenizer path
#171 opened Apr 22, 2023 by vishalsrao
Llama support
#170 opened Apr 19, 2023 by michaelroyzen
2
Torch 2.0
#169 opened Apr 11, 2023 by varshith15
3
Marginal Improvement Between INT8 and FP16
#168 opened Mar 31, 2023 by alexriggio
I faced with Stub process is unhealthy and it will be restarted.
#167 opened Mar 31, 2023 by OleksandrKorovii
Occasional "CUDA error cudaErrorInvalidConfiguration:invalid configuration argument" error
#166 opened Mar 17, 2023 by zoltan-fedor
1
sharing the code for the triton models.
#165 opened Mar 17, 2023 by espoirMur
Can we support facebook/m2m100_418M model?
#164 opened Feb 17, 2023 by chi2liu
ViT serving
#162 opened Feb 1, 2023 by VoVoR
Question-Answering example not working for batch_size > 1
#159 opened Dec 23, 2022 by lakshaykc
Support for constrained beam-search in T5
#158 opened Dec 21, 2022 by junwang-wish
Attempting to run T5 ORT model in Triton inference server
#157 opened Dec 14, 2022 by samiur
1
Two GPU are slower than one
#156 opened Dec 7, 2022 by OleksandrKorovii
Tensorrt engine
#155 opened Nov 29, 2022 by imsiddhant07
1
Embedding with T5-Encoder
#153 opened Nov 2, 2022 by DA-L3
1
Unable to optimize microsoft/deberta-v3-small model
#150 opened Oct 27, 2022 by hlkong323
2
Zero copy may lead to wrong text generation results bug Something isn't working
#145 opened Sep 30, 2022 by brevity2021
6
ProTip! no:milestone will show everything without a milestone.