[INGEST] Storage manifest transfer method (Discussion)

CDLUC3 / mrt-doc

Documentation and Information regarding the Merritt repository

8 stars 4 forks source link

Open mreyescdl opened 1 year ago

mreyescdl commented 1 year ago

Ingest calls Storage with a manifest it wants to preserve. There are two methods of transfer:

If manifest is < 1MB in size, POST manifest data as a form parameter
Else, then POST the manifest location URL as a form parameter and Storage will pull it (off ZFS)

Is this the best approach? Maybe always handing Storage the URL is more stable.

Also, whatever method is decided upon, let's document the behavior.

dloy commented 9 months ago

Right now either technique works in storage regardless of size. No problem either approach being used regardless of size.