irods / irods_capability_storage_tiering

BSD 3-Clause "New" or "Revised" License
5 stars 10 forks source link

Error when trying to restage data that has not yet been tiered #162

Open JustinKyleJames opened 3 years ago

JustinKyleJames commented 3 years ago

I am getting an error like the following when storage tiering kicks off. According to Jason this is because the data object has not tiered yet and therefore doesn't have metadata attached to it.

Feb 23 14:31:41 pid:15851 NOTICE: Failed to restage data object [/zone/home/user1/iget_tiny] for resource [col01_ufs_resc] Exception: [iRODS Exception:
    file: /irods_plugin/storage_tiering.cpp
    function: std::string irods::storage_tiering::get_group_name_by_replica_number(rcComm_t *, const std::string &, const std::string &, const std::string &)
    line: 773
    code: -808000 (CAT_NO_ROWS_FOUND)
    message:
        failed to fetch group name by resource and replica number

Here is the relevant metadata on the UFS resource:

$ imeta ls -R col01_ufs_resc
AVUs defined for resource col01_ufs_resc:
attribute: irods::storage_tiering::group
value: col01_tier_group
units: 0
----
attribute: irods::storage_tiering::object_limit
value: 50
units: 
----
attribute: irods::storage_tiering::query
value: col01_archive_query
units: specific
----
attribute: irods::storage_tiering::time
value: 3600
units: 

Here is the metadata on the tier 1 resource:

$ imeta ls -R s3_resc
AVUs defined for resource s3_resc:
attribute: irods::storage_tiering::group
value: col01_tier_group
units: 1
----
attribute: irods::storage_tiering::group
value: por01_tier_group
units: 1
----
attribute: irods::storage_tiering::preserve_replicas
value: true
units: 

Here is the metadata on the data object:


$ imeta ls -d /zone/home/user1
AVUs defined for dataObj /zone/home/user1:
attribute: irods::access_time
value: 1614081551
units: