search

ARPA-SIMC / arkimet

A set of tools to organize, archive and distribute data files.
Other
14 stars 5 forks source link

Importing old ODIM files in archived sections #319

Open brancomat opened 9 months ago

brancomat commented 9 months ago

Scenario: we needed to import some old ODIM files for a reftime that's already been archived.

This is the workflow we adopted:

  1. edit the dataset config removing the archive age line
  2. arki-query --summary-short --dump '' $file_to_be_imported (to see the data reftime, i.e.: 2023-06-20 6:00)
  3. arki-check --unarchive 2023/06-20.odimh5 $dataset (to unarchive that day)
  4. arki-scan --dump --status --summary --dispatch $configuration $file_to_be_imported
  5. restore the archive age line
  6. arki-check -f -r

Question: is the 3rd step necessary, or would the repack harmonize unarchived and archived data with no need to unarchive that day?