Skip to content

Commit

Permalink
server: reduce max connections used in download (ollama#6347)
Browse files Browse the repository at this point in the history
The previous value of 64 was WAY too high and unnecessary. It reached
diminishing returns and blew past it. This is a more reasonable number
for _most_ normal cases. For users on cloud servers with excellent
network quality, this will keep screaming for them, without hitting our
CDN limits. For users with relatively poor network quality, this will
keep them from saturating their network and causing other issues.
  • Loading branch information
bmizerany authored Aug 13, 2024
1 parent eda8a32 commit 8e1050f
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion server/download.go
Original file line number Diff line number Diff line change
Expand Up @@ -94,7 +94,7 @@ func (p *blobDownloadPart) UnmarshalJSON(b []byte) error {
}

const (
numDownloadParts = 64
numDownloadParts = 16
minDownloadPartSize int64 = 100 * format.MegaByte
maxDownloadPartSize int64 = 1000 * format.MegaByte
)
Expand Down

0 comments on commit 8e1050f

Please sign in to comment.