search

storj / team-metainfo

GNU Affero General Public License v3.0
0 stars 0 forks source link

download request should only allocate requested range amount #37

Open mniewrzal opened 2 years ago

mniewrzal commented 2 years ago

Download requests currently allocate the size of the segment requested, regardless of the range request. We should only allocate what was requested.

This needs two fixes: -1. ensure that DownloadObject only allocates what’s needed.- (done)

  1. ensure that DownloadSegment contains necessary information to select the correct limit for downloading.
    Migrated from https://storjlabs.atlassian.net/browse/PG-222
mniewrzal commented 2 years ago

Commented by Egon Elbre

One part of the implementation is in https://review.dev.storj.io/c/storj/storj/+/4782

mniewrzal commented 2 years ago

Commented by Egon Elbre

Currently we fixed that the first segment we download using DownloadObject uses the proper range request. This will handle most of the cases.

However, we still have to ensure that the lazily loaded segments (not the first one) use the proper limit.