Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

About DPT depth scale and shift initialization #4

Open
K-nowing opened this issue Apr 20, 2023 · 1 comment
Open

About DPT depth scale and shift initialization #4

K-nowing opened this issue Apr 20, 2023 · 1 comment

Comments

@K-nowing
Copy link

Hi, thank you for code release

In the default config file, you used checkpoint "dpt_hybrid-midas", but why did you use the scale and shift value of checkpoint "dpt_hybrid-nyu" for preprocessing?
I think the initial values of DPT depth affects the performance.

@bianwenjing
Copy link
Collaborator

bianwenjing commented Apr 26, 2023

Hi, thanks for your interest and thanks for identifying this problem.
For the DPT model, we simply took the first model provided in their code and use a set of parameters they provided that can recover depth. It could probably be better if you use the corresponding fine-tuned checkpoint instead. You can also try other depth estimations as long as the depths are in reasonable scales within the sampling range.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants