Progress Callback for Downloading Models

[fakerybakery]

Hi,
Is there any way to capture the progress while a pipeline is downloading a model?
Thanks!

[bmaxdk]

Yes, you can use huggingface_hub.snapshot_download to capture the progress while a pipeline is downloading a model. It automatically shows a progress bar using tqdm
here is a link

[fakerybakery]

Thanks!
Is there a way to use a custom callback for downloads?

[bmaxdk]

Yes, you can use your own custom calllback. in that case, you can use hf_hub_download.

hf_hub_download(repo_id=repo_id, filename=filename, progress_callback=progress_callback)

hf_hub_download suposrt hf_hub_download function does support a your own progress_callback parameter to track download progress

[fakerybakery]

Thanks!