storj / team-metainfo

GNU Affero General Public License v3.0
0 stars 0 forks source link

Adjust Gateway to store metadata at the beginning of MPU #104

Closed mniewrzal closed 2 years ago

mniewrzal commented 2 years ago

Currently, gateway (st/mt) cannot store metadata at the beginning. Because of that metadata provided by user is not preserved and it breaks some tools like rclone. We need to extend metainfo protocol to be able to store metadata at the beginning and at the end of MPU process. At the moment we need this just for gateway so we don't want to extend public API with this feature.

Steps to do that: https://github.com/storj/team-metainfo/issues/105:

https://github.com/storj/team-metainfo/issues/106

Its worth mentioning that to fix storing metadata with gateway for some time we will need to introduce additional round trip to satellite to get existing metadata before committing object. Later we need to implement https://github.com/storj/team-metainfo/milestone/3 to resolve this problem.

Acceptance Criteria:

kmoore134 commented 2 years ago

Fantastic! I'll be happy to give this some testing when the fixes land. Thank you!

storjBuildBot commented 2 years ago

Change https://review.dev.storj.io/c/storj/gateway/+/7381 mentions this issue.