Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

TRT Problem #3

Open
SwEngine opened this issue Mar 3, 2023 · 0 comments
Open

TRT Problem #3

SwEngine opened this issue Mar 3, 2023 · 0 comments

Comments

@SwEngine
Copy link

SwEngine commented Mar 3, 2023

When I run onnx2trt, I got the output below:

[03/03/2023-06:51:38] [W] [TRT] CUDA lazy loading is not enabled. Enabling it can significantly reduce device memory usage. See `CUDA_MODULE_LOADING` in https://docs.nvidia.com/cuda/cuda-c-programming-guide/index.html#env-vars
[03/03/2023-06:51:38] [W] [TRT] onnx2trt_utils.cpp:377: Your ONNX model has been generated with INT64 weights, while TensorRT does not natively support INT64. Attempting to cast down to INT32.
[03/03/2023-06:51:38] [W] [TRT] onnx2trt_utils.cpp:403: One or more weights outside the range of INT32 was clamped
[03/03/2023-06:51:38] [W] [TRT] onnx2trt_utils.cpp:403: One or more weights outside the range of INT32 was clamped
[03/03/2023-06:51:38] [W] [TRT] onnx2trt_utils.cpp:403: One or more weights outside the range of INT32 was clamped
[03/03/2023-06:51:38] [W] [TRT] onnx2trt_utils.cpp:403: One or more weights outside the range of INT32 was clamped
[03/03/2023-06:51:38] [W] [TRT] onnx2trt_utils.cpp:403: One or more weights outside the range of INT32 was clamped
[03/03/2023-06:51:39] [W] [TRT] onnx2trt_utils.cpp:403: One or more weights outside the range of INT32 was clamped
[03/03/2023-07:02:44] [W] [TRT] TensorRT encountered issues when converting weights between types and that could affect accuracy.
[03/03/2023-07:02:44] [W] [TRT] If this is not the desired behavior, please modify the weights or retrain with regularization to adjust the magnitude of the weights.
[03/03/2023-07:02:44] [W] [TRT] Check verbose logs for the list of affected weights.
[03/03/2023-07:02:44] [W] [TRT] - 76 weights are affected by this issue: Detected subnormal FP16 values.
[03/03/2023-07:02:44] [E] [TRT] 3: [builder.cpp::~Builder::307] Error Code 3: API Usage Error (Parameter check failed at: optimizer/api/builder.cpp::~Builder::307, condition: mObjectCounter.use_count() == 1. Destroying a builder object before destroying objects it created leads to undefined behavior.
)
convert seccuss!

And When I run yolov7-face, I got the output below:

[03/03/2023-07:11:03] [E] [TRT] 3: [runtime.cpp::deserializeCudaEngine::36] Error Code 3: API Usage Error (Parameter check failed at: runtime/rt/runtime.cpp::deserializeCudaEngine::36, condition: (blob) != nullptr
)
yolov7_face: /content/yolov7-face-tensorrt/yolov7-face.cpp:116: int main(int, char**): Assertion `engine_det != nullptr' failed.

What can be the problem?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant