Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

proxy model download through model server/central #735

Open
ebamberg opened this issue Mar 9, 2021 · 0 comments
Open

proxy model download through model server/central #735

ebamberg opened this issue Mar 9, 2021 · 0 comments
Labels
enhancement New feature or request

Comments

@ebamberg
Copy link
Contributor

ebamberg commented Mar 9, 2021

Description

At the moment every web-client/browser needs access through firewalls/proxies to download the model using central from the original URL as well as to central.
Instead of that it would be possible that just the central-server is configured to access all necessary network-resources.
The client could just call an URL of the central-server and the server would stream the model-download to the client

This would open the door to some future improvements like:

Authentication/Authorisation of downloads managed by central. (OAuth-plugin, Kerberos-plugin)
central could be used as a Mirror or for Caching of remote models - similar to how Nexus can be configured when using maven. Nexus is used often this way for caching or to control which artifacts are used inside of a company.
uploading models with central without granting access for all web-clients to whatever storage central is using. so different storage strategies would be possible.
single point to configure firewall access. Would also be nice for cloud based services using models.
just a few ideas from a DevOp perspective

Will this change the current api? How?

Who will benefit from this enhancement?

References

  • list reference and related literature
  • list known implementations
@ebamberg ebamberg added the enhancement New feature or request label Mar 9, 2021
Lokiiiiii pushed a commit to Lokiiiiii/djl that referenced this issue Oct 10, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

1 participant