Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

openvino量化后,无法推理 #584

Open
gogocoded opened this issue Nov 14, 2024 · 0 comments
Open

openvino量化后,无法推理 #584

gogocoded opened this issue Nov 14, 2024 · 0 comments

Comments

@gogocoded
Copy link

请教一个问题,我使用例子量化yolov5s模型,导出到openvino平台无法推理,错误提示如下:
Traceback (most recent call last):
File "D:\v6sp3_sp_quan\ProgramEntrance_openvino.py", line 63, in
model = openvino_executor.read_model(model="model_int8.onnx"), device_name="CPU")
File "D:\anaconda3\lib\site-packages\openvino\runtime\ie_api.py", line 511, in read_model
return Model(super().read_model(model))
RuntimeError: Exception from src\inference\src\core.cpp:85:
Check 'error_message.empty()' failed at src\frontends\onnx\frontend\src\frontend.cpp:124:
Errors during ONNX translation:
Check '(data_et.is_static())' failed at src\frontends\onnx\frontend\src\op\quantize_linear.cpp:56:
While validating ONNX node '<Node(QuantizeLinear): PPQ_Operation_318>':
"x" input data type must be static.
While validating ONNX node '<Node(Conv): /model.9/cv1/conv/Conv>':
Check 'data.get_partial_shape().rank().is_static()' failed at src\frontends\onnx\frontend\src\op\conv.cpp:44:
The input data tensor's rank has to be known (static)
Check '(data_et.is_static())' failed at src\frontends\onnx\frontend\src\op\quantize_linear.cpp:56:
While validating ONNX node '<Node(QuantizeLinear): PPQ_Operation_310>':
"x" input data type must be static.
While validating ONNX node '<Node(Conv): /model.8/cv3/conv/Conv>':
Check 'data.get_partial_shape().rank().is_static()' failed at src\frontends\onnx\frontend\src\op\conv.cpp:44:
The input data tensor's rank has to be known (static)
Check '(data_et.is_static())' failed at src\frontends\onnx\frontend\src\op\quantize_linear.cpp:56:
While validating ONNX node '<Node(QuantizeLinear): PPQ_Operation_296>':
"x" input data type must be static.
While validating ONNX node '<Node(Conv): /model.8/cv2/conv/Conv>':
Check 'data.get_partial_shape().rank().is_static()' failed at src\frontends\onnx\frontend\src\op\conv.cpp:44:
The input data tensor's rank has to be known (static)
Check '(data_et.is_static())' failed at src\frontends\onnx\frontend\src\op\quantize_linear.cpp:56:
While validating ONNX node '<Node(QuantizeLinear): PPQ_Operation_258>':
"x" input data type must be static.
。。。。

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant