Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Onnxruntime compiling stuck , cannot exit. #607

Open
Jay19751103 opened this issue Jul 12, 2024 · 1 comment
Open

Onnxruntime compiling stuck , cannot exit. #607

Jay19751103 opened this issue Jul 12, 2024 · 1 comment

Comments

@Jay19751103
Copy link

Describe the issue
When use test data to do ort.InferenceSession, takes time and not exit

To reproduce
use the onnx file put in google drive
https://drive.google.com/file/d/1y-evMcenYe-Q0JpyQvuwO0YHBX8gSSBE/view?usp=sharing
import numpy as np
import onnxruntime as ort

EP_list = ['DmlExecutionProvider']
sess_opt = ort.SessionOptions()
sess_opt.log_severity_level = 0
sess_opt.graph_optimization_level = ort.GraphOptimizationLevel.ORT_ENABLE_BASIC
sess = ort.InferenceSession("text_encoder_3.onnx", sess_opt, providers=EP_list)

use win debug see that the system is doing TryCreateCompiledOperator (see attached picture)
No matter use Nvida 3080TI or AMD 7900XTX, the problem is same.

image

@Jay19751103 Jay19751103 changed the title Onnxruntime compiling stuck Onnxruntime compiling stuck , cannot exit. Jul 12, 2024
@Jay19751103
Copy link
Author

Hi directML team

We need the fusion can work on SD3 text encoder 3.
clone the issue from microsoft/onnxruntime#21255

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant