Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Clarification Needed on Diffusion Process #6

Open
fairchildfzc opened this issue Jul 6, 2024 · 2 comments
Open

Clarification Needed on Diffusion Process #6

fairchildfzc opened this issue Jul 6, 2024 · 2 comments

Comments

@fairchildfzc
Copy link

fairchildfzc commented Jul 6, 2024

Hi authors,

Thank you for your fascinating paper. However, I have a question regarding the diffusion process as illustrated in Figure 3 (https://github.com/czg1225/AsyncDiff/blob/main/assets/fig2.png?raw=true).

From the image and the paper, it appears that $x_{T-5}$ is generated directly from $x_{T-1}$. I am curious about the role of $x_{T-2}$ through $x_{T-4}$ in the calculation of $x_{T-5}$. Are these intermediate steps involved in the generation of $x_{T-5}$? If not, does this imply that $x_{T-2}$ to $x_{T-4}$ can be skipped, eliminating the need to compute them?

Thank you for your clarification.

@czg1225
Copy link
Owner

czg1225 commented Jul 8, 2024

@fairchildfzc ,
In fact, the output of the UNet is the predicted noise for the current timestep. Essentially, we can only obtain $x_{T-5}$ after obtaining $x_{T-4}$ and $noise_{T-4}$. The core of our method is that noise predictions at different time steps can now be performed in parallel rather than sequentially. However, the predicted noise at each step still needs to be obtained.

@fairchildfzc
Copy link
Author

Thank you very much for your clarification! I did not notice that you use different time embeddings in different pipeline stage.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants