storj / team-metainfo

GNU Affero General Public License v3.0
0 stars 0 forks source link

Listing without metadata broke object size #20

Open mniewrzal opened 2 years ago

mniewrzal commented 2 years ago

We have an issue where objects uploaded with older versions of libuplink are returning 0 size while listing. The problem is related to the way how we are keeping plain size of object. In the past we were storing this information inside metadata encrypted by user. Now we have direct access to plain size without need for decrypting anything.

The issue is visible when we are listing object without metadata (custom metadata). In such case objects uploaded with older libuplink have size information inside this metadata that we are filtering from listing results.

Potential solutions:

wthorp commented 1 year ago

Can we determine the size from the stream size and repair the metadata, but do it once rather than have the overhead at listing time?

mniewrzal commented 1 year ago

Can we determine the size from the stream size and repair the metadata, but do it once rather than have the overhead at listing time?

Issue is related to older uplinks. Those days we had plain size encrypted in metadata so we would need to be able to decrypt metadata and that is not possible. Alternative would be provide tool for customer to fix bad objects.