Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

转ONNX操作 #3

Open
iwanggp opened this issue May 25, 2023 · 3 comments
Open

转ONNX操作 #3

iwanggp opened this issue May 25, 2023 · 3 comments

Comments

@iwanggp
Copy link

iwanggp commented May 25, 2023

你这转ONNX需要添加什么操作吗？需要添加batch和dynamic吗
@Li-Hongda
Copy link
Owner

@iwanggp 你好，现阶段还不支持动态shape，之后我会针对这一点再做改进。转ONNX时，batch可以先设为1，动态batch即将更新。

@iwanggp
Copy link
Author

iwanggp commented May 26, 2023

那现在支持批处理吗？能一次推理多张图片吗

@Li-Hongda
Copy link
Owner

@iwanggp 你好，我刚刚更新了支持动态batch的ONNX模型转TRT模型和相应的推理。但需要注意的是在相同的batchsize设置下，动态维度的模型推理速度是低于静态模型的。所以可以尝试静态的multi-batch推理~

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@iwanggp @Li-Hongda