Item granularity

[rhysrevans3]

Option 1: STAC compliant, internal > external consistency

A STAC Item represents only one file/asset. Multi-level collections.

Pro:

• STAC compliant.
• File search without asset search.
• Internal consistency: all items represent the same level granularity.

Con:

• External inconsistency: our item granularity may not match for similar data that already exists. (flights)

Option 2: STAC compliant, internal < external consistency

A STAC Item represents a group of files/assets. But if too many assets the item should be subdivided. Multi-level collections.

Pro:

• STAC compliant.
• External consistency: for items with not too many assets we can match with similar external catalogs.

Con:

• Internal inconsistency: as larger items will need to be broken up items won't represent the same granularity for all areas of the archive. Would also require different collection levels.
• Requires separate file level search.

Option 3: STAC defiant internal + external consistency

A STAC Item represents a group of files/assets. Extension to allow for large number of assets.

Pro:

• Internal consistency: all items represent the same level granularity.
• External consistency: can configure items to match with external data.

Con:

• STAC in-compliant: requires an extension to allow for large number of assets.
• Requires separate file level search.