irods / irods_capability_automated_ingest

Other

12 stars 15 forks source link

Allow modification of destination path #151

Open holtgrewe opened 3 years ago

holtgrewe commented 3 years ago

It would be extremely useful to provide users a way to manipulate the destination collection based on the source path.

For example, in the case of illumina sequencing runs, the start date is part of the folder that is in the ingest source directory:

- $icai_src
    - 210119_xxx

where 210119 encodes for January 19, 2021. I'd like to ingest this into the sub folder 2021 (IOW creating $icai_dst/2021/210119_xxx).

As run folders consist of tens of thousands of file, a post ingest imv will be relatively expensive.

trel commented 2 years ago

Similar in some part to #166 for direct character-to-character conversions.

I'm not too sure how to make this request a generic mapping function though.

trel commented 1 year ago

166 has been completed and merged.

@holtgrewe can you please look at this again with the new character_map implemented?

i'm still not convinced it solves your request - but it may give you some control over what you are desiring to do.