DOI-USGS / ISIS3

Integrated Software for Imagers and Spectrometers v3. ISIS3 is a digital image processing software package to manipulate imagery collected by current and past NASA and International planetary missions.
https://isis.astrogeology.usgs.gov
Other
200 stars 169 forks source link

JUNO SPK Kernels Missing #5633

Closed KrisBecker closed 1 week ago

KrisBecker commented 1 month ago

ISIS version(s) affected: all

No LSB modules are available.
Distributor ID: Ubuntu
Description:    Ubuntu 22.04.5 LTS
Release:        22.04
Codename:       jammy

Description
There are apparently some JUNO SPK kernels missing after running downloadIsisData. Here is the complete summary reported by isisdataeval for just the JUNO kernels:

isisdataeval preferences=$ISISROOT/IsisPreferences datadir=$PWD/isisdata/juno isisdata=$PWD/isisdata toerrors=isisdataeval_juno_errors_20241011.csv toissues=isisdataeval_juno_issues_20241011.csv toinventory=isisdataeval_juno_inventory_20241011.csv verify=true

Object = isisdataeval
  IsisVersion       = "8.3.0  | 2024-09-13"
  ProgramVersion    = 2023-01-09
  ProgramPath       = $ISISROOT/bin
  ExecutionDateTime = 2024-10-11T10:40:20
  HostName          = x86_64-conda-linux-gnu
  UserName          = kbecker
  Description       = "Evaluate ISISDATA structure and validity"

  Group = UserParameters
    PREFERENCES = $ISISROOT/IsisPreferences
    DATADIR     = $ISISDATA/juno
    ISISDATA    = $ISISDATA
    TOISSUES    = isisdataeval_juno_issues_20241011.csv
    TOINVENTORY = isisdataeval_juno_inventory_20241011.csv
    TOERRORS    = isisdataeval_juno_errors_20241011.csv
    VERIFY      = true
    HASH        = NOHASH
    HASHBUFFER  = 256
  End_Group

  ########################################################
  # Customize the location of mission specific data
  # files (calibration and spice kernels).  Usually this
  # should be left to the Isis administrator
  ########################################################
  Group = DataDirectory
    # Backwards compatability for versions prior to 4.1.0
    ISIS3DATA    = $ISISDATA
    Apollo15     = $ISISDATA/apollo15
    Apollo16     = $ISISDATA/apollo16
    Apollo17     = $ISISDATA/apollo17
    Base         = $ISISDATA/base
    Cassini      = $ISISDATA/cassini
    Chan1        = $ISISDATA/chan1
    Chandrayaan1 = $ISISDATA/chandrayaan1
    Clementine1  = $ISISDATA/clementine1
    Clipper      = $ISISDATA/../datalocal/clipper
    Control      = $ISISDATA/control
    Dawn         = $ISISDATA/dawn
    Galileo      = $ISISDATA/galileo
    Hayabusa     = $ISISDATA/hayabusa
    Hayabusa2    = $ISISDATA/hayabusa2
    Juno         = $ISISDATA/juno
    Kaguya       = $ISISDATA/kaguya
    Lo           = $ISISDATA/lo
    Lro          = $ISISDATA/lro
    Mariner10    = $ISISDATA/mariner10
    Mer          = $ISISDATA/mer
    Mex          = $ISISDATA/mex
    Messenger    = $ISISDATA/messenger
    Mgs          = $ISISDATA/mgs
    Mro          = $ISISDATA/mro
    Near         = $ISISDATA/near
    NewHorizons  = $ISISDATA/newhorizons
    Odyssey      = $ISISDATA/odyssey
    OsirisRex    = $ISISDATA/osirisrex
    Rolo         = $ISISDATA/rolo
    Rosetta      = $ISISDATA/rosetta
    Smart1       = $ISISDATA/smart1
    Tgo          = $ISISDATA/tgo
    Viking1      = $ISISDATA/viking1
    Viking2      = $ISISDATA/viking2
    Voyager1     = $ISISDATA/voyager1
    Voyager2     = $ISISDATA/voyager2
    Temporary    = .
    ISISDATA     = $ISISDATA
  End_Group

Validation Complete...12 issues found!
status, filespec, sourcespec, source, target, category
missing,$juno/kernels/ck/juno_sc_raw_221215_221229.bc,$ISISDATA/juno/kernels/ck/kernels.????.db,$ISISDATA/juno/kernels/ck/kernels.0111.db,$ISISDATA/juno/kernels/ck/kernels.0111.db,Predicted
missing,$juno/kernels/spk/juno_rec_210925_211108_211115.bsp,$ISISDATA/juno/kernels/spk/kernels.????.db,$ISISDATA/juno/kernels/spk/kernels.0111.db,$ISISDATA/juno/kernels/spk/kernels.0111.db,Reconstructed
missing,$juno/kernels/spk/juno_rec_211108_211222_220104.bsp,$ISISDATA/juno/kernels/spk/kernels.????.db,$ISISDATA/juno/kernels/spk/kernels.0111.db,$ISISDATA/juno/kernels/spk/kernels.0111.db,Reconstructed
missing,$juno/kernels/spk/juno_rec_211222_220204_220210.bsp,$ISISDATA/juno/kernels/spk/kernels.????.db,$ISISDATA/juno/kernels/spk/kernels.0111.db,$ISISDATA/juno/kernels/spk/kernels.0111.db,Reconstructed
missing,$juno/kernels/spk/juno_rec_220204_220319_220330.bsp,$ISISDATA/juno/kernels/spk/kernels.????.db,$ISISDATA/juno/kernels/spk/kernels.0111.db,$ISISDATA/juno/kernels/spk/kernels.0111.db,Reconstructed
missing,$juno/kernels/spk/juno_rec_220319_220502_220510.bsp,$ISISDATA/juno/kernels/spk/kernels.????.db,$ISISDATA/juno/kernels/spk/kernels.0111.db,$ISISDATA/juno/kernels/spk/kernels.0111.db,Reconstructed
missing,$juno/kernels/spk/juno_rec_220502_220614_220622.bsp,$ISISDATA/juno/kernels/spk/kernels.????.db,$ISISDATA/juno/kernels/spk/kernels.0111.db,$ISISDATA/juno/kernels/spk/kernels.0111.db,Reconstructed
missing,$juno/kernels/spk/juno_rec_220614_220728_220805.bsp,$ISISDATA/juno/kernels/spk/kernels.????.db,$ISISDATA/juno/kernels/spk/kernels.0111.db,$ISISDATA/juno/kernels/spk/kernels.0111.db,Reconstructed
missing,$juno/kernels/spk/juno_rec_220728_220909_220913.bsp,$ISISDATA/juno/kernels/spk/kernels.????.db,$ISISDATA/juno/kernels/spk/kernels.0111.db,$ISISDATA/juno/kernels/spk/kernels.0111.db,Reconstructed
missing,$juno/kernels/spk/juno_rec_220909_221019_221027.bsp,$ISISDATA/juno/kernels/spk/kernels.????.db,$ISISDATA/juno/kernels/spk/kernels.0111.db,$ISISDATA/juno/kernels/spk/kernels.0111.db,Reconstructed
missing,$juno/kernels/spk/juno_rec_221019_221127_221208.bsp,$ISISDATA/juno/kernels/spk/kernels.????.db,$ISISDATA/juno/kernels/spk/kernels.0111.db,$ISISDATA/juno/kernels/spk/kernels.0111.db,Reconstructed
missing,$juno/kernels/spk/juno_rec_221127_230104_230111.bsp,$ISISDATA/juno/kernels/spk/kernels.????.db,$ISISDATA/juno/kernels/spk/kernels.0111.db,$ISISDATA/juno/kernels/spk/kernels.0111.db,Reconstructed

Running inventory ...

Inventory Complete...0 issues found!

Group = Results
  ISISDATA            = $ISISDATA
  DATADIR             = $ISISDATA/-
                        juno
  EmptyKernelDBs      = 0
  MissingKernelDBs    = 12
  SymlinkKernelFiles  = 0
  ExternalKernelFiles = 0
  ErrorKernelFiles    = 0
  TotalDBConfigFiles  = 0 <conf>
  TotalKernelDBFiles  = 8 <db>
  TotalDirectories    = 10
  TotalDataFiles      = 2491
  TotalInstallSize    = 45105247938 <bytes>
  TotalVolumeSize     = 42.007535638288 <GB>
  MissingInInventory  = 0
  SymlinkInInventory  = 0
  ExternalToInventory = 0
  ErrorInInventory    = 0
End_Group

How to reproduce

Possible Solution

Additional context

chkim-usgs commented 2 weeks ago

Hi @KrisBecker, it looks like isisdataeval returned 0 missing kernels for me, could you verify as well? Thanks.

KrisBecker commented 2 weeks ago

Hi @chkim-usgs was anything changed on your end? Should I first redownload?

chkim-usgs commented 2 weeks ago

Hi @KrisBecker, I did not manually change anything as I did not run into any missing JUNO kernels so it is possible that our nightly ISIS data area update may have added them sometime recently. I recommend redownloading and giving it another try.

KrisBecker commented 2 weeks ago

Reran the complete ISISDATA inventory and the problem still exists.

I cloned ISIS3 dev today, copied downloadIsisData and rclone.conf to the local volume and reran the complete ISISDATA download on my Mac.

NOTE: I noticed all the kernel DB files have yesterday's date so they have apparently been regenerated recently.

Here is the result of the download shown for JUNO only:

% ./downloadIsisData all $PWD/isisdata --config=$PWD/rclone.conf -v  --log-file=isisdata_20241107.log

2024/11/07 16:50:14 ERROR : Local file system at /Volumes/ISISDATA/isisdata/juno: Ignoring --track-renames as the source and destination do not have a common hash
2024/11/07 16:50:14 ERROR : Local file system at /Volumes/ISISDATA/isisdata/juno: Ignoring --track-renames as it doesn't work with copy or move, only sync
2024/11/07 16:50:16 INFO  : kernels/sclk/JNO_SCLKSCET.00177.tsc: Copied (new)
2024/11/07 16:50:16 INFO  : kernels/sclk/JNO_SCLKSCET.00174.tsc: Copied (new)
2024/11/07 16:50:16 INFO  : kernels/sclk/JNO_SCLKSCET.00176.tsc: Copied (new)
2024/11/07 16:50:16 INFO  : kernels/sclk/JNO_SCLKSCET.00175.tsc: Copied (new)
2024/11/07 16:50:21 INFO  : kernels/spk/kernels.0101.db: Copied (new)
2024/11/07 16:50:21 INFO  : kernels/spk/kernels.0102.db: Copied (new)
2024/11/07 16:50:21 INFO  : kernels/spk/kernels.0098.db: Copied (new)
2024/11/07 16:50:21 INFO  : kernels/spk/kernels.0099.db: Copied (new)
2024/11/07 16:50:21 INFO  : kernels/spk/kernels.0103.db: Copied (new)
2024/11/07 16:50:21 INFO  : kernels/spk/kernels.0100.db: Copied (new)
2024/11/07 16:50:21 INFO  : kernels/spk/kernels.0105.db: Copied (new)
2024/11/07 16:50:21 INFO  : kernels/spk/kernels.0107.db: Copied (new)
2024/11/07 16:50:21 INFO  : kernels/spk/kernels.0104.db: Copied (new)
2024/11/07 16:50:21 INFO  : kernels/spk/kernels.0106.db: Copied (new)
2024/11/07 16:50:21 INFO  : kernels/spk/kernels.0110.db: Copied (new)
2024/11/07 16:50:21 INFO  : kernels/spk/kernels.0112.db: Copied (new)
2024/11/07 16:50:21 INFO  : kernels/spk/kernels.0111.db: Copied (new)
2024/11/07 16:50:21 INFO  : kernels/spk/kernels.0113.db: Copied (new)
2024/11/07 16:50:21 INFO  : kernels/spk/kernels.0108.db: Copied (new)
2024/11/07 16:50:21 INFO  : kernels/spk/kernels.0109.db: Copied (new)
2024/11/07 16:50:21 INFO  : kernels/spk/kernels.0116.db: Copied (new)
2024/11/07 16:50:21 INFO  : kernels/spk/kernels.0117.db: Copied (new)
2024/11/07 16:50:21 INFO  : kernels/spk/kernels.0115.db: Copied (new)
2024/11/07 16:50:21 INFO  : kernels/spk/kernels.0114.db: Copied (new)
2024/11/07 16:50:21 INFO  : kernels/spk/kernels.0118.db: Copied (new)
2024/11/07 16:50:21 INFO  : kernels/spk/kernels.0121.db: Copied (new)
2024/11/07 16:50:21 INFO  : kernels/spk/kernels.0122.db: Copied (new)
2024/11/07 16:50:21 INFO  : kernels/spk/kernels.0119.db: Copied (new)
2024/11/07 16:50:21 INFO  : kernels/spk/kernels.0120.db: Copied (new)
2024/11/07 16:50:21 INFO  : kernels/spk/juno_pred_orbit.orb: Copied (replaced existing)
2024/11/07 16:50:21 INFO  : kernels/spk/spk_pre_240716_241127_240911_otm65_f.bsp: Copied (new)
2024/11/07 16:50:21 INFO  : kernels/spk/spk_pre_240819_241230_241011_jm0670.bsp: Copied (new)
2024/11/07 16:50:21 INFO  : kernels/spk/spk_pre_240920_241230_241030_apo66_f.bsp: Copied (new)
2024/11/07 16:50:21 INFO  : kernels/spk/spk_pre_240819_241127_240930_apo65_f.bsp: Copied (new)
2024/11/07 16:50:21 INFO  : kernels/spk/spk_pre_240819_241127_240926_apo65_p.bsp: Copied (new)
2024/11/07 16:50:22 INFO  : kernels/spk/spk_pre_240920_241230_241028_apo66_p.bsp: Copied (new)
2024/11/07 16:50:22 INFO  : kernels/spk/spk_rec_240904_241007_241014.bsp: Copied (new)
2024/11/07 16:50:23 INFO  : kernels/ck/juno_sc_prl_241123_241226_jm0670a_v01.bc: Copied (new)
2024/11/07 16:50:23 INFO  : kernels/ck/juno_sc_prl_241021_241123_jm0660rp_v01.bc: Copied (new)
2024/11/07 16:50:23 INFO  : kernels/spk/spk_rec_240802_240904_240910.bsp: Copied (new)
2024/11/07 16:50:26 INFO  : kernels/ck/juno_sc_rec_240922_240928_v01.bc: Copied (new)
2024/11/07 16:50:26 INFO  : kernels/ck/juno_sc_rec_240919_240920_v01.bc: Copied (new)
2024/11/07 16:50:26 INFO  : kernels/ck/juno_sc_prl_241123_241226_jm0670rp_v01.bc: Copied (new)
2024/11/07 16:50:28 INFO  : kernels/ck/juno_sc_rec_240901_240907_v01.bc: Copied (new)
2024/11/07 16:50:28 INFO  : kernels/ck/juno_sc_rec_240929_241005_v01.bc: Copied (new)
2024/11/07 16:50:29 INFO  : kernels/ck/juno_sc_rec_241021_241023_v01.bc: Copied (new)
2024/11/07 16:50:29 INFO  : kernels/ck/juno_sc_rec_241013_241019_v01.bc: Copied (new)
2024/11/07 16:50:29 INFO  : kernels/ck/juno_uvs_rec_240307_240614_v01.bc: Copied (new)
2024/11/07 16:50:29 INFO  : kernels/ck/juno_sc_rec_241021_241023_v02.bc: Copied (new)
2024/11/07 16:50:29 INFO  : kernels/ck/juno_sc_prl_241021_241123_jm0660a_v01.bc: Copied (new)
2024/11/07 16:50:30 INFO  : kernels/ck/kernels.0098.db: Copied (new)
2024/11/07 16:50:30 INFO  : kernels/ck/kernels.0099.db: Copied (new)
2024/11/07 16:50:30 INFO  : kernels/ck/kernels.0100.db: Copied (new)
2024/11/07 16:50:30 INFO  : kernels/spk/juno_pred_orbit.bsp: Copied (replaced existing)
2024/11/07 16:50:30 INFO  : kernels/ck/kernels.0102.db: Copied (new)
2024/11/07 16:50:30 INFO  : kernels/ck/kernels.0101.db: Copied (new)
2024/11/07 16:50:30 INFO  : kernels/ck/juno_sc_rec_240908_240914_v01.bc: Copied (new)
2024/11/07 16:50:30 INFO  : kernels/ck/kernels.0103.db: Copied (new)
2024/11/07 16:50:30 INFO  : kernels/ck/kernels.0105.db: Copied (new)
2024/11/07 16:50:30 INFO  : kernels/ck/kernels.0106.db: Copied (new)
2024/11/07 16:50:30 INFO  : kernels/ck/kernels.0104.db: Copied (new)
2024/11/07 16:50:31 INFO  : kernels/ck/kernels.0109.db: Copied (new)
2024/11/07 16:50:31 INFO  : kernels/ck/kernels.0107.db: Copied (new)
2024/11/07 16:50:31 INFO  : kernels/ck/kernels.0112.db: Copied (new)
2024/11/07 16:50:31 INFO  : kernels/ck/kernels.0110.db: Copied (new)
2024/11/07 16:50:31 INFO  : kernels/ck/kernels.0111.db: Copied (new)
2024/11/07 16:50:31 INFO  : kernels/ck/kernels.0113.db: Copied (new)
2024/11/07 16:50:31 INFO  : kernels/ck/kernels.0108.db: Copied (new)
2024/11/07 16:50:31 INFO  : kernels/ck/kernels.0114.db: Copied (new)
2024/11/07 16:50:31 INFO  : kernels/ck/kernels.0117.db: Copied (new)
2024/11/07 16:50:31 INFO  : kernels/ck/kernels.0115.db: Copied (new)
2024/11/07 16:50:31 INFO  : kernels/ck/juno_sc_rec_241027_241102_v01.bc: Copied (new)
2024/11/07 16:50:31 INFO  : kernels/ck/kernels.0119.db: Copied (new)
2024/11/07 16:50:31 INFO  : kernels/ck/juno_sc_rec_240915_240921_v01.bc: Copied (new)
2024/11/07 16:50:31 INFO  : kernels/ck/kernels.0118.db: Copied (new)
2024/11/07 16:50:31 INFO  : kernels/spk/juno_rec_orbit.orb: Copied (replaced existing)
2024/11/07 16:50:31 INFO  : kernels/ck/kernels.0116.db: Copied (new)
2024/11/07 16:50:32 INFO  : kernels/spk/kernels.0008.db: Copied (replaced existing)
2024/11/07 16:50:32 INFO  : kernels/spk/kernels.0009.db: Copied (replaced existing)
2024/11/07 16:50:32 INFO  : kernels/ck/kernels.0121.db: Copied (new)
2024/11/07 16:50:32 INFO  : kernels/spk/kernels.0010.db: Copied (replaced existing)
2024/11/07 16:50:32 INFO  : kernels/spk/kernels.0011.db: Copied (replaced existing)
2024/11/07 16:50:32 INFO  : kernels/ck/kernels.0122.db: Copied (new)
2024/11/07 16:50:32 INFO  : kernels/spk/kernels.0012.db: Copied (replaced existing)
2024/11/07 16:50:32 INFO  : kernels/spk/kernels.0013.db: Copied (replaced existing)
2024/11/07 16:50:32 INFO  : kernels/spk/kernels.0014.db: Copied (replaced existing)
2024/11/07 16:50:32 INFO  : kernels/spk/kernels.0015.db: Copied (replaced existing)
2024/11/07 16:50:32 INFO  : kernels/spk/kernels.0018.db: Copied (replaced existing)
2024/11/07 16:50:32 INFO  : kernels/spk/kernels.0016.db: Copied (replaced existing)
2024/11/07 16:50:32 INFO  : kernels/spk/kernels.0019.db: Copied (replaced existing)
2024/11/07 16:50:32 INFO  : kernels/spk/kernels.0022.db: Copied (replaced existing)
2024/11/07 16:50:32 INFO  : kernels/spk/kernels.0024.db: Copied (replaced existing)
2024/11/07 16:50:32 INFO  : kernels/spk/kernels.0021.db: Copied (replaced existing)
2024/11/07 16:50:32 INFO  : kernels/spk/kernels.0020.db: Copied (replaced existing)
2024/11/07 16:50:32 INFO  : kernels/spk/kernels.0023.db: Copied (replaced existing)
2024/11/07 16:50:32 INFO  : kernels/spk/kernels.0017.db: Copied (replaced existing)
2024/11/07 16:50:32 INFO  : kernels/ck/juno_sc_rec_241006_241012_v01.bc: Copied (new)
2024/11/07 16:50:32 INFO  : kernels/ck/kernels.0120.db: Copied (new)
2024/11/07 16:50:32 INFO  : kernels/spk/kernels.0026.db: Copied (replaced existing)
2024/11/07 16:50:32 INFO  : kernels/spk/kernels.0025.db: Copied (replaced existing)
2024/11/07 16:50:32 INFO  : kernels/spk/kernels.0029.db: Copied (replaced existing)
2024/11/07 16:50:32 INFO  : kernels/spk/kernels.0028.db: Copied (replaced existing)
2024/11/07 16:50:32 INFO  : kernels/spk/kernels.0027.db: Copied (replaced existing)
2024/11/07 16:50:32 INFO  : kernels/spk/kernels.0032.db: Copied (replaced existing)
2024/11/07 16:50:32 INFO  : kernels/spk/kernels.0035.db: Copied (replaced existing)
2024/11/07 16:50:32 INFO  : kernels/spk/kernels.0031.db: Copied (replaced existing)
2024/11/07 16:50:32 INFO  : kernels/spk/kernels.0036.db: Copied (replaced existing)
2024/11/07 16:50:32 INFO  : kernels/spk/kernels.0033.db: Copied (replaced existing)
2024/11/07 16:50:32 INFO  : kernels/spk/kernels.0037.db: Copied (replaced existing)
2024/11/07 16:50:32 INFO  : kernels/spk/kernels.0030.db: Copied (replaced existing)
2024/11/07 16:50:32 INFO  : kernels/spk/kernels.0034.db: Copied (replaced existing)
2024/11/07 16:50:32 INFO  : kernels/spk/kernels.0038.db: Copied (replaced existing)
2024/11/07 16:50:32 INFO  : kernels/spk/kernels.0039.db: Copied (replaced existing)
2024/11/07 16:50:32 INFO  : kernels/spk/kernels.0041.db: Copied (replaced existing)
2024/11/07 16:50:32 INFO  : kernels/spk/kernels.0040.db: Copied (replaced existing)
2024/11/07 16:50:32 INFO  : kernels/spk/kernels.0043.db: Copied (replaced existing)
2024/11/07 16:50:32 INFO  : kernels/spk/kernels.0042.db: Copied (replaced existing)
2024/11/07 16:50:32 INFO  : kernels/spk/kernels.0046.db: Copied (replaced existing)
2024/11/07 16:50:32 INFO  : kernels/spk/kernels.0045.db: Copied (replaced existing)
2024/11/07 16:50:32 INFO  : kernels/spk/kernels.0048.db: Copied (replaced existing)
2024/11/07 16:50:32 INFO  : kernels/spk/kernels.0049.db: Copied (replaced existing)
2024/11/07 16:50:32 INFO  : kernels/spk/kernels.0047.db: Copied (replaced existing)
2024/11/07 16:50:32 INFO  : kernels/spk/kernels.0053.db: Copied (replaced existing)
2024/11/07 16:50:32 INFO  : kernels/spk/kernels.0044.db: Copied (replaced existing)
2024/11/07 16:50:32 INFO  : kernels/spk/kernels.0051.db: Copied (replaced existing)
2024/11/07 16:50:32 INFO  : kernels/spk/kernels.0050.db: Copied (replaced existing)
2024/11/07 16:50:32 INFO  : kernels/spk/kernels.0055.db: Copied (replaced existing)
2024/11/07 16:50:32 INFO  : kernels/spk/kernels.0056.db: Copied (replaced existing)
2024/11/07 16:50:32 INFO  : kernels/spk/kernels.0052.db: Copied (replaced existing)
2024/11/07 16:50:32 INFO  : kernels/spk/kernels.0054.db: Copied (replaced existing)
2024/11/07 16:50:32 INFO  : kernels/spk/kernels.0058.db: Copied (replaced existing)
2024/11/07 16:50:32 INFO  : kernels/spk/kernels.0057.db: Copied (replaced existing)
2024/11/07 16:50:32 INFO  : kernels/spk/kernels.0059.db: Copied (replaced existing)
2024/11/07 16:50:32 INFO  : kernels/spk/kernels.0063.db: Copied (replaced existing)
2024/11/07 16:50:32 INFO  : kernels/spk/kernels.0064.db: Copied (replaced existing)
2024/11/07 16:50:32 INFO  : kernels/spk/kernels.0062.db: Copied (replaced existing)
2024/11/07 16:50:32 INFO  : kernels/spk/kernels.0061.db: Copied (replaced existing)
2024/11/07 16:50:33 INFO  : kernels/spk/kernels.0065.db: Copied (replaced existing)
2024/11/07 16:50:33 INFO  : kernels/spk/kernels.0069.db: Copied (replaced existing)
2024/11/07 16:50:33 INFO  : kernels/spk/kernels.0066.db: Copied (replaced existing)
2024/11/07 16:50:33 INFO  : kernels/spk/kernels.0060.db: Copied (replaced existing)
2024/11/07 16:50:33 INFO  : kernels/spk/kernels.0068.db: Copied (replaced existing)
2024/11/07 16:50:33 INFO  : kernels/spk/kernels.0067.db: Copied (replaced existing)
2024/11/07 16:50:33 INFO  : kernels/spk/kernels.0075.db: Copied (replaced existing)
2024/11/07 16:50:33 INFO  : kernels/spk/kernels.0071.db: Copied (replaced existing)
2024/11/07 16:50:33 INFO  : kernels/spk/kernels.0072.db: Copied (replaced existing)
2024/11/07 16:50:33 INFO  : kernels/spk/kernels.0070.db: Copied (replaced existing)
2024/11/07 16:50:33 INFO  : kernels/spk/kernels.0078.db: Copied (replaced existing)
2024/11/07 16:50:33 INFO  : kernels/spk/kernels.0076.db: Copied (replaced existing)
2024/11/07 16:50:33 INFO  : kernels/spk/kernels.0074.db: Copied (replaced existing)
2024/11/07 16:50:33 INFO  : kernels/spk/kernels.0073.db: Copied (replaced existing)
2024/11/07 16:50:33 INFO  : kernels/spk/kernels.0083.db: Copied (replaced existing)
2024/11/07 16:50:33 INFO  : kernels/spk/kernels.0080.db: Copied (replaced existing)
2024/11/07 16:50:33 INFO  : kernels/spk/kernels.0082.db: Copied (replaced existing)
2024/11/07 16:50:33 INFO  : kernels/spk/kernels.0085.db: Copied (replaced existing)
2024/11/07 16:50:33 INFO  : kernels/spk/kernels.0079.db: Copied (replaced existing)
2024/11/07 16:50:33 INFO  : kernels/spk/kernels.0084.db: Copied (replaced existing)
2024/11/07 16:50:33 INFO  : kernels/spk/kernels.0077.db: Copied (replaced existing)
2024/11/07 16:50:33 INFO  : kernels/spk/kernels.0087.db: Copied (replaced existing)
2024/11/07 16:50:33 INFO  : kernels/spk/kernels.0096.db: Copied (replaced existing)
2024/11/07 16:50:33 INFO  : kernels/spk/kernels.0081.db: Copied (replaced existing)
2024/11/07 16:50:33 INFO  : kernels/spk/kernels.0086.db: Copied (replaced existing)
2024/11/07 16:50:33 INFO  : kernels/spk/kernels.0088.db: Copied (replaced existing)
2024/11/07 16:50:33 INFO  : kernels/spk/kernels.0092.db: Copied (replaced existing)
2024/11/07 16:50:33 INFO  : kernels/spk/kernels.0089.db: Copied (replaced existing)
2024/11/07 16:50:33 INFO  : kernels/spk/kernels.0090.db: Copied (replaced existing)
2024/11/07 16:50:33 INFO  : kernels/spk/kernels.0095.db: Copied (replaced existing)
2024/11/07 16:50:33 INFO  : kernels/spk/kernels.0093.db: Copied (replaced existing)
2024/11/07 16:50:33 INFO  : kernels/spk/kernels.0094.db: Copied (replaced existing)
2024/11/07 16:50:33 INFO  : kernels/spk/kernels.0091.db: Copied (replaced existing)
2024/11/07 16:50:33 INFO  : kernels/spk/kernels.0097.db: Copied (replaced existing)
2024/11/07 16:50:33 INFO  : kernels/ck/kernels.0008.db: Copied (replaced existing)
2024/11/07 16:50:33 INFO  : kernels/ck/kernels.0014.db: Copied (replaced existing)
2024/11/07 16:50:33 INFO  : kernels/ck/kernels.0009.db: Copied (replaced existing)
2024/11/07 16:50:33 INFO  : kernels/ck/kernels.0010.db: Copied (replaced existing)
2024/11/07 16:50:33 INFO  : kernels/ck/kernels.0011.db: Copied (replaced existing)
2024/11/07 16:50:33 INFO  : kernels/ck/kernels.0015.db: Copied (replaced existing)
2024/11/07 16:50:33 INFO  : kernels/ck/kernels.0012.db: Copied (replaced existing)
2024/11/07 16:50:33 INFO  : kernels/ck/kernels.0016.db: Copied (replaced existing)
2024/11/07 16:50:33 INFO  : kernels/ck/kernels.0013.db: Copied (replaced existing)
2024/11/07 16:50:33 INFO  : kernels/ck/kernels.0019.db: Copied (replaced existing)
2024/11/07 16:50:33 INFO  : kernels/ck/kernels.0021.db: Copied (replaced existing)
2024/11/07 16:50:33 INFO  : kernels/ck/kernels.0018.db: Copied (replaced existing)
2024/11/07 16:50:33 INFO  : kernels/ck/kernels.0020.db: Copied (replaced existing)
2024/11/07 16:50:33 INFO  : kernels/ck/kernels.0017.db: Copied (replaced existing)
2024/11/07 16:50:33 INFO  : kernels/ck/kernels.0026.db: Copied (replaced existing)
2024/11/07 16:50:33 INFO  : kernels/ck/kernels.0024.db: Copied (replaced existing)
2024/11/07 16:50:33 INFO  : kernels/ck/kernels.0025.db: Copied (replaced existing)
2024/11/07 16:50:34 INFO  : kernels/ck/kernels.0027.db: Copied (replaced existing)
2024/11/07 16:50:34 INFO  : kernels/ck/kernels.0023.db: Copied (replaced existing)
2024/11/07 16:50:34 INFO  : kernels/ck/kernels.0036.db: Copied (replaced existing)
2024/11/07 16:50:34 INFO  : kernels/ck/kernels.0022.db: Copied (replaced existing)
2024/11/07 16:50:34 INFO  : kernels/ck/kernels.0028.db: Copied (replaced existing)
2024/11/07 16:50:34 INFO  : kernels/ck/kernels.0034.db: Copied (replaced existing)
2024/11/07 16:50:34 INFO  : kernels/ck/kernels.0032.db: Copied (replaced existing)
2024/11/07 16:50:34 INFO  : kernels/ck/kernels.0030.db: Copied (replaced existing)
2024/11/07 16:50:34 INFO  : kernels/ck/kernels.0035.db: Copied (replaced existing)
2024/11/07 16:50:34 INFO  : kernels/ck/kernels.0037.db: Copied (replaced existing)
2024/11/07 16:50:34 INFO  : kernels/ck/kernels.0029.db: Copied (replaced existing)
2024/11/07 16:50:34 INFO  : kernels/ck/kernels.0033.db: Copied (replaced existing)
2024/11/07 16:50:34 INFO  : kernels/ck/kernels.0031.db: Copied (replaced existing)
2024/11/07 16:50:34 INFO  : kernels/ck/kernels.0039.db: Copied (replaced existing)
2024/11/07 16:50:34 INFO  : kernels/ck/kernels.0046.db: Copied (replaced existing)
2024/11/07 16:50:34 INFO  : kernels/ck/kernels.0038.db: Copied (replaced existing)
2024/11/07 16:50:34 INFO  : kernels/ck/kernels.0041.db: Copied (replaced existing)
2024/11/07 16:50:34 INFO  : kernels/ck/kernels.0042.db: Copied (replaced existing)
2024/11/07 16:50:34 INFO  : kernels/ck/kernels.0043.db: Copied (replaced existing)
2024/11/07 16:50:34 INFO  : kernels/ck/kernels.0047.db: Copied (replaced existing)
2024/11/07 16:50:34 INFO  : kernels/ck/kernels.0040.db: Copied (replaced existing)
2024/11/07 16:50:34 INFO  : kernels/ck/kernels.0044.db: Copied (replaced existing)
2024/11/07 16:50:34 INFO  : kernels/ck/kernels.0045.db: Copied (replaced existing)
2024/11/07 16:50:34 INFO  : kernels/ck/kernels.0049.db: Copied (replaced existing)
2024/11/07 16:50:34 INFO  : kernels/ck/kernels.0048.db: Copied (replaced existing)
2024/11/07 16:50:34 INFO  : kernels/ck/kernels.0051.db: Copied (replaced existing)
2024/11/07 16:50:34 INFO  : kernels/ck/kernels.0057.db: Copied (replaced existing)
2024/11/07 16:50:34 INFO  : kernels/ck/kernels.0053.db: Copied (replaced existing)
2024/11/07 16:50:34 INFO  : kernels/ck/kernels.0052.db: Copied (replaced existing)
2024/11/07 16:50:34 INFO  : kernels/ck/kernels.0056.db: Copied (replaced existing)
2024/11/07 16:50:34 INFO  : kernels/ck/kernels.0054.db: Copied (replaced existing)
2024/11/07 16:50:34 INFO  : kernels/ck/kernels.0050.db: Copied (replaced existing)
2024/11/07 16:50:34 INFO  : kernels/ck/kernels.0055.db: Copied (replaced existing)
2024/11/07 16:50:34 INFO  : kernels/ck/kernels.0061.db: Copied (replaced existing)
2024/11/07 16:50:34 INFO  : kernels/ck/kernels.0059.db: Copied (replaced existing)
2024/11/07 16:50:34 INFO  : kernels/ck/kernels.0058.db: Copied (replaced existing)
2024/11/07 16:50:34 INFO  : kernels/ck/kernels.0065.db: Copied (replaced existing)
2024/11/07 16:50:34 INFO  : kernels/ck/kernels.0062.db: Copied (replaced existing)
2024/11/07 16:50:34 INFO  : kernels/ck/kernels.0066.db: Copied (replaced existing)
2024/11/07 16:50:34 INFO  : kernels/ck/kernels.0063.db: Copied (replaced existing)
2024/11/07 16:50:35 INFO  : kernels/ck/kernels.0064.db: Copied (replaced existing)
2024/11/07 16:50:35 INFO  : kernels/ck/kernels.0060.db: Copied (replaced existing)
2024/11/07 16:50:35 INFO  : kernels/ck/kernels.0077.db: Copied (replaced existing)
2024/11/07 16:50:35 INFO  : kernels/ck/kernels.0067.db: Copied (replaced existing)
2024/11/07 16:50:35 INFO  : kernels/ck/kernels.0071.db: Copied (replaced existing)
2024/11/07 16:50:35 INFO  : kernels/ck/kernels.0068.db: Copied (replaced existing)
2024/11/07 16:50:35 INFO  : kernels/ck/kernels.0070.db: Copied (replaced existing)
2024/11/07 16:50:35 INFO  : kernels/ck/kernels.0076.db: Copied (replaced existing)
2024/11/07 16:50:35 INFO  : kernels/ck/kernels.0072.db: Copied (replaced existing)
2024/11/07 16:50:35 INFO  : kernels/ck/kernels.0069.db: Copied (replaced existing)
2024/11/07 16:50:35 INFO  : kernels/ck/kernels.0073.db: Copied (replaced existing)
2024/11/07 16:50:35 INFO  : kernels/ck/kernels.0074.db: Copied (replaced existing)
2024/11/07 16:50:35 INFO  : kernels/ck/kernels.0075.db: Copied (replaced existing)
2024/11/07 16:50:35 INFO  : kernels/ck/kernels.0080.db: Copied (replaced existing)
2024/11/07 16:50:35 INFO  : kernels/ck/kernels.0082.db: Copied (replaced existing)
2024/11/07 16:50:35 INFO  : kernels/ck/kernels.0087.db: Copied (replaced existing)
2024/11/07 16:50:35 INFO  : kernels/ck/kernels.0086.db: Copied (replaced existing)
2024/11/07 16:50:35 INFO  : kernels/ck/kernels.0083.db: Copied (replaced existing)
2024/11/07 16:50:35 INFO  : kernels/ck/kernels.0081.db: Copied (replaced existing)
2024/11/07 16:50:35 INFO  : kernels/ck/kernels.0078.db: Copied (replaced existing)
2024/11/07 16:50:35 INFO  : kernels/ck/kernels.0084.db: Copied (replaced existing)
2024/11/07 16:50:35 INFO  : kernels/ck/kernels.0085.db: Copied (replaced existing)
2024/11/07 16:50:35 INFO  : kernels/ck/kernels.0079.db: Copied (replaced existing)
2024/11/07 16:50:35 INFO  : kernels/ck/kernels.0091.db: Copied (replaced existing)
2024/11/07 16:50:35 INFO  : kernels/ck/kernels.0097.db: Copied (replaced existing)
2024/11/07 16:50:35 INFO  : kernels/ck/kernels.0092.db: Copied (replaced existing)
2024/11/07 16:50:35 INFO  : kernels/ck/juno_sc_rec_241020_241026_v01.bc: Copied (new)
2024/11/07 16:50:35 INFO  : kernels/ck/kernels.0095.db: Copied (replaced existing)
2024/11/07 16:50:35 INFO  : kernels/ck/kernels.0094.db: Copied (replaced existing)
2024/11/07 16:50:35 INFO  : kernels/ck/kernels.0090.db: Copied (replaced existing)
2024/11/07 16:50:35 INFO  : kernels/ck/kernels.0089.db: Copied (replaced existing)
2024/11/07 16:50:35 INFO  : kernels/ck/kernels.0088.db: Copied (replaced existing)
2024/11/07 16:50:35 INFO  : kernels/ck/kernels.0093.db: Copied (replaced existing)
2024/11/07 16:50:35 INFO  : kernels/ck/kernels.0096.db: Copied (replaced existing)
2024/11/07 16:50:35 INFO  : kernels/spk/juno_rec_orbit.bsp: Copied (replaced existing)
Transferred:      578.522 MiB / 578.522 MiB, 100%, 29.239 MiB/s, ETA 0s
Checks:              2449 / 2449, 100%
Transferred:          263 / 263, 100%
Elapsed time:        21.4s
2024/11/07 16:50:35 INFO  : 
Transferred:      578.522 MiB / 578.522 MiB, 100%, 29.239 MiB/s, ETA 0s
Checks:              2449 / 2449, 100%
Transferred:          263 / 263, 100%
Elapsed time:        21.4s

Here is the ISISDATA inventory run:

% isisdataeval preferences=$ISISROOT/IsisPreferences datadir=$PWD/isisdata/juno isisdata=$PWD/isisdata verify=true

DATAROOT = /Volumes/ISISDATA/isisdata/juno
DATAROOT = /Volumes/ISISDATA/isisdata/juno

ISISDATA = /opt/isis4/data
ISISDATA = /Volumes/ISISDATA/isisdata
ISISDATA reset by user!

########################################################
# Customize the location of mission specific data
# files (calibration and spice kernels).  Usually this
# should be left to the Isis administrator
########################################################
Group = DataDirectory
  # Backwards compatability for versions prior to 4.1.0
  ISIS3DATA    = $ISISDATA
  Apollo15     = $ISISDATA/apollo15
  Apollo16     = $ISISDATA/apollo16
  Apollo17     = $ISISDATA/apollo17
  Base         = $ISISDATA/base
  Cassini      = $ISISDATA/cassini
  Chan1        = $ISISDATA/chan1
  Chandrayaan1 = $ISISDATA/chandrayaan1
  Clementine1  = $ISISDATA/clementine1
  Clipper      = $ISISDATA/../datalocal/clipper
  Control      = $ISISDATA/control
  Dawn         = $ISISDATA/dawn
  Galileo      = $ISISDATA/galileo
  Hayabusa     = $ISISDATA/hayabusa
  Hayabusa2    = $ISISDATA/hayabusa2
  Juno         = $ISISDATA/juno
  Kaguya       = $ISISDATA/kaguya
  Lo           = $ISISDATA/lo
  Lro          = $ISISDATA/lro
  Mariner10    = $ISISDATA/mariner10
  Mer          = $ISISDATA/mer
  Mex          = $ISISDATA/mex
  Messenger    = $ISISDATA/messenger
  Mgs          = $ISISDATA/mgs
  Mro          = $ISISDATA/mro
  Near         = $ISISDATA/near
  NewHorizons  = $ISISDATA/newhorizons
  Odyssey      = $ISISDATA/odyssey
  OsirisRex    = $ISISDATA/osirisrex
  Rolo         = $ISISDATA/rolo
  Rosetta      = $ISISDATA/rosetta
  Smart1       = $ISISDATA/smart1
  Tgo          = $ISISDATA/tgo
  Viking1      = $ISISDATA/viking1
  Viking2      = $ISISDATA/viking2
  Voyager1     = $ISISDATA/voyager1
  Voyager2     = $ISISDATA/voyager2
  Temporary    = .
  ISISDATA     = /Volumes/ISISDATA/isisdata
End_Group

Validation Complete...12 issues found!
status, filespec, sourcespec, source, target, category
missing,$juno/kernels/ck/juno_sc_raw_221215_221229.bc,/Volumes/ISISDATA/isisdata/juno/kernels/ck/kernels.????.db,/Volumes/ISISDATA/isisdata/juno/kernels/ck/kernels.0122.db,/Volumes/ISISDATA/isisdata/juno/kernels/ck/kernels.0122.db,Predicted
missing,$juno/kernels/spk/juno_rec_210925_211108_211115.bsp,/Volumes/ISISDATA/isisdata/juno/kernels/spk/kernels.????.db,/Volumes/ISISDATA/isisdata/juno/kernels/spk/kernels.0122.db,/Volumes/ISISDATA/isisdata/juno/kernels/spk/kernels.0122.db,Reconstructed
missing,$juno/kernels/spk/juno_rec_211108_211222_220104.bsp,/Volumes/ISISDATA/isisdata/juno/kernels/spk/kernels.????.db,/Volumes/ISISDATA/isisdata/juno/kernels/spk/kernels.0122.db,/Volumes/ISISDATA/isisdata/juno/kernels/spk/kernels.0122.db,Reconstructed
missing,$juno/kernels/spk/juno_rec_211222_220204_220210.bsp,/Volumes/ISISDATA/isisdata/juno/kernels/spk/kernels.????.db,/Volumes/ISISDATA/isisdata/juno/kernels/spk/kernels.0122.db,/Volumes/ISISDATA/isisdata/juno/kernels/spk/kernels.0122.db,Reconstructed
missing,$juno/kernels/spk/juno_rec_220204_220319_220330.bsp,/Volumes/ISISDATA/isisdata/juno/kernels/spk/kernels.????.db,/Volumes/ISISDATA/isisdata/juno/kernels/spk/kernels.0122.db,/Volumes/ISISDATA/isisdata/juno/kernels/spk/kernels.0122.db,Reconstructed
missing,$juno/kernels/spk/juno_rec_220319_220502_220510.bsp,/Volumes/ISISDATA/isisdata/juno/kernels/spk/kernels.????.db,/Volumes/ISISDATA/isisdata/juno/kernels/spk/kernels.0122.db,/Volumes/ISISDATA/isisdata/juno/kernels/spk/kernels.0122.db,Reconstructed
missing,$juno/kernels/spk/juno_rec_220502_220614_220622.bsp,/Volumes/ISISDATA/isisdata/juno/kernels/spk/kernels.????.db,/Volumes/ISISDATA/isisdata/juno/kernels/spk/kernels.0122.db,/Volumes/ISISDATA/isisdata/juno/kernels/spk/kernels.0122.db,Reconstructed
missing,$juno/kernels/spk/juno_rec_220614_220728_220805.bsp,/Volumes/ISISDATA/isisdata/juno/kernels/spk/kernels.????.db,/Volumes/ISISDATA/isisdata/juno/kernels/spk/kernels.0122.db,/Volumes/ISISDATA/isisdata/juno/kernels/spk/kernels.0122.db,Reconstructed
missing,$juno/kernels/spk/juno_rec_220728_220909_220913.bsp,/Volumes/ISISDATA/isisdata/juno/kernels/spk/kernels.????.db,/Volumes/ISISDATA/isisdata/juno/kernels/spk/kernels.0122.db,/Volumes/ISISDATA/isisdata/juno/kernels/spk/kernels.0122.db,Reconstructed
missing,$juno/kernels/spk/juno_rec_220909_221019_221027.bsp,/Volumes/ISISDATA/isisdata/juno/kernels/spk/kernels.????.db,/Volumes/ISISDATA/isisdata/juno/kernels/spk/kernels.0122.db,/Volumes/ISISDATA/isisdata/juno/kernels/spk/kernels.0122.db,Reconstructed
missing,$juno/kernels/spk/juno_rec_221019_221127_221208.bsp,/Volumes/ISISDATA/isisdata/juno/kernels/spk/kernels.????.db,/Volumes/ISISDATA/isisdata/juno/kernels/spk/kernels.0122.db,/Volumes/ISISDATA/isisdata/juno/kernels/spk/kernels.0122.db,Reconstructed
missing,$juno/kernels/spk/juno_rec_221127_230104_230111.bsp,/Volumes/ISISDATA/isisdata/juno/kernels/spk/kernels.????.db,/Volumes/ISISDATA/isisdata/juno/kernels/spk/kernels.0122.db,/Volumes/ISISDATA/isisdata/juno/kernels/spk/kernels.0122.db,Reconstructed

Running inventory ...

Inventory Complete...0 issues found!

Group = Results
  ISISDATA            = /Volumes/ISISDATA/isisdata
  DATADIR             = /Volumes/ISISDATA/isisdata/juno
  EmptyKernelDBs      = 0
  MissingKernelDBs    = 12
  SymlinkKernelFiles  = 0
  ExternalKernelFiles = 0
  ErrorKernelFiles    = 0
  TotalDBConfigFiles  = 0 <conf>
  TotalKernelDBFiles  = 8 <db>
  TotalDirectories    = 10
  TotalDataFiles      = 2543
  TotalInstallSize    = 45323128173 <bytes>
  TotalVolumeSize     = 42.210452419706 <GB>
  MissingInInventory  = 0
  SymlinkInInventory  = 0
  ExternalToInventory = 0
  ErrorInInventory    = 0
End_Group

I confirmed they indeed do not exist in the directory.

chkim-usgs commented 2 weeks ago

Ok, I re-added these files to the ISIS data area. The kernel.db should be regenerated with these files once the nightly build is run which may be in about two days. I will check back in early next week to verify and may ask you to verify once again. Thanks.

chkim-usgs commented 1 week ago

Hi @KrisBecker, I have re-downloaded the area as well and got the same output after running isisdataeval. However, these kernels were actually downloaded and existing when running isisdataeval. I checked the latest kernel db kernels.0124.db and found that these kernels were in the database as well. We find it highly possible that the issue may lie with the isisdataeval script itself as it seems the kernels are available and the database has been updated appropriately.

KrisBecker commented 1 week ago

Hi @chkim-usgs, as I mentioned in my last post, the reported files are missing. Here is the confirmation that they do not exist in my ISISDATA download:

% for f in `cut -d, -f 2 juno_missing_list.txt |tr -d "$"`;do echo "$f"; done

juno/kernels/ck/juno_sc_raw_221215_221229.bc
juno/kernels/spk/juno_rec_210925_211108_211115.bsp
juno/kernels/spk/juno_rec_211108_211222_220104.bsp
juno/kernels/spk/juno_rec_211222_220204_220210.bsp
juno/kernels/spk/juno_rec_220204_220319_220330.bsp
juno/kernels/spk/juno_rec_220319_220502_220510.bsp
juno/kernels/spk/juno_rec_220502_220614_220622.bsp
juno/kernels/spk/juno_rec_220614_220728_220805.bsp
juno/kernels/spk/juno_rec_220728_220909_220913.bsp
juno/kernels/spk/juno_rec_220909_221019_221027.bsp
juno/kernels/spk/juno_rec_221019_221127_221208.bsp
juno/kernels/spk/juno_rec_221127_230104_230111.bsp

% for f in `cut -d, -f 2 juno_missing_list.txt |tr -d "$"`;do ls -l "isisdata/$f"; done

ls: isisdata/juno/kernels/ck/juno_sc_raw_221215_221229.bc: No such file or directory
ls: isisdata/juno/kernels/spk/juno_rec_210925_211108_211115.bsp: No such file or directory
ls: isisdata/juno/kernels/spk/juno_rec_211108_211222_220104.bsp: No such file or directory
ls: isisdata/juno/kernels/spk/juno_rec_211222_220204_220210.bsp: No such file or directory
ls: isisdata/juno/kernels/spk/juno_rec_220204_220319_220330.bsp: No such file or directory
ls: isisdata/juno/kernels/spk/juno_rec_220319_220502_220510.bsp: No such file or directory
ls: isisdata/juno/kernels/spk/juno_rec_220502_220614_220622.bsp: No such file or directory
ls: isisdata/juno/kernels/spk/juno_rec_220614_220728_220805.bsp: No such file or directory
ls: isisdata/juno/kernels/spk/juno_rec_220728_220909_220913.bsp: No such file or directory
ls: isisdata/juno/kernels/spk/juno_rec_220909_221019_221027.bsp: No such file or directory
ls: isisdata/juno/kernels/spk/juno_rec_221019_221127_221208.bsp: No such file or directory
ls: isisdata/juno/kernels/spk/juno_rec_221127_230104_230111.bsp: No such file or directory

rclone also reports the files are not found at the destination:

% ./downloadIsisData all $PWD/isisdata --config=$PWD/rclone.conf -vv --log-file=isisdata_20241114.log

2024/11/14 07:26:14 DEBUG : kernels/spk/juno_rec_210925_211108_211115.bsp: Need to transfer - File not found at Destination
2024/11/14 07:26:14 DEBUG : kernels/spk/juno_rec_211108_211222_220104.bsp: Need to transfer - File not found at Destination
2024/11/14 07:26:14 DEBUG : kernels/spk/juno_rec_211222_220204_220210.bsp: Need to transfer - File not found at Destination
2024/11/14 07:26:14 DEBUG : kernels/spk/juno_rec_220204_220319_220330.bsp: Need to transfer - File not found at Destination
2024/11/14 07:26:14 DEBUG : kernels/spk/juno_rec_220319_220502_220510.bsp: Need to transfer - File not found at Destination
2024/11/14 07:26:14 DEBUG : kernels/spk/juno_rec_220502_220614_220622.bsp: Need to transfer - File not found at Destination
2024/11/14 07:26:14 DEBUG : kernels/spk/juno_rec_220614_220728_220805.bsp: Need to transfer - File not found at Destination
2024/11/14 07:26:14 DEBUG : kernels/spk/juno_rec_220728_220909_220913.bsp: Need to transfer - File not found at Destination
2024/11/14 07:26:14 DEBUG : kernels/spk/juno_rec_220909_221019_221027.bsp: Need to transfer - File not found at Destination
2024/11/14 07:26:14 DEBUG : kernels/spk/juno_rec_221019_221127_221208.bsp: Need to transfer - File not found at Destination
2024/11/14 07:26:14 DEBUG : kernels/spk/juno_rec_221127_230104_230111.bsp: Need to transfer - File not found at Destination
2024/11/14 07:26:14 DEBUG : kernels/spk/kernels.0124.db: Need to transfer - File not found at Destination
2024/11/14 07:26:14 DEBUG : kernels/spk/kernels.0125.db: Need to transfer - File not found at Destination
2024/11/14 07:26:14 DEBUG : kernels/spk/spk_pre_240920_250131_241107_jm0680.bsp: Need to transfer - File not found at Destination

And the files (a few show here) were then logged as copied:

2024/11/14 07:26:14 INFO  : kernels/spk/juno_rec_211222_220204_220210.bsp: Copied (new)
2024/11/14 07:26:14 INFO  : kernels/spk/juno_rec_220319_220502_220510.bsp: Copied (new)
2024/11/14 07:26:14 INFO  : kernels/spk/juno_rec_220502_220614_220622.bsp: Copied (new)

isisdataeval now reports all is well:

 % isisdataeval preferences=$ISISROOT/IsisPreferences datadir=$PWD/isisdata/juno isisdata=$PWD/isisdata verify=true

DATAROOT = /Volumes/ISISDATA/isisdata/juno
DATAROOT = /Volumes/ISISDATA/isisdata/juno

ISISDATA = /opt/isis4/data
ISISDATA = /Volumes/ISISDATA/isisdata
ISISDATA reset by user!
...

Validation Complete...0 issues found!

Running inventory ...

Inventory Complete...0 issues found!

Group = Results
  ISISDATA            = /Volumes/ISISDATA/isisdata
  DATADIR             = /Volumes/ISISDATA/isisdata/juno
  EmptyKernelDBs      = 0
  MissingKernelDBs    = 0
  SymlinkKernelFiles  = 0
  ExternalKernelFiles = 0
  ErrorKernelFiles    = 0
  TotalDBConfigFiles  = 0 <conf>
  TotalKernelDBFiles  = 8 <db>
  TotalDirectories    = 10
  TotalDataFiles      = 2563
  TotalInstallSize    = 45385895422 <bytes>
  TotalVolumeSize     = 42.268908975646 <GB>
  MissingInInventory  = 0
  SymlinkInInventory  = 0
  ExternalToInventory = 0
  ErrorInInventory    = 0
End_Group

isisdataeval was not the problem.

So the only thing I did different was upgrade rclone from version 1.67.0 to 1.68.1. Perhaps that was the problem all along.

I consider this issue resolved now.

Thank you!

KrisBecker commented 1 week ago

The last thing to note is that the timestamp on these kernels is Nov 11, all created at the same time, which indicates they were recently changed/copied at the source:

 % for f in `cut -d, -f 2 juno_missing_list.txt |tr -d "$"`;do ls -l "isisdata/$f"; done
-rw-r--r--  1 kbecker  staff  230400 Nov 11 09:19 isisdata/juno/kernels/ck/juno_sc_raw_221215_221229.bc
-rw-r--r--  1 kbecker  staff  1301504 Nov 11 09:19 isisdata/juno/kernels/spk/juno_rec_210925_211108_211115.bsp
-rw-r--r--  1 kbecker  staff  346112 Nov 11 09:19 isisdata/juno/kernels/spk/juno_rec_211108_211222_220104.bsp
-rw-r--r--  1 kbecker  staff  2676736 Nov 11 09:19 isisdata/juno/kernels/spk/juno_rec_211222_220204_220210.bsp
-rw-r--r--  1 kbecker  staff  399360 Nov 11 09:19 isisdata/juno/kernels/spk/juno_rec_220204_220319_220330.bsp
-rw-r--r--  1 kbecker  staff  1825792 Nov 11 09:19 isisdata/juno/kernels/spk/juno_rec_220319_220502_220510.bsp
-rw-r--r--  1 kbecker  staff  1776640 Nov 11 09:19 isisdata/juno/kernels/spk/juno_rec_220502_220614_220622.bsp
-rw-r--r--  1 kbecker  staff  1696768 Nov 11 09:19 isisdata/juno/kernels/spk/juno_rec_220614_220728_220805.bsp
-rw-r--r--  1 kbecker  staff  3588096 Nov 11 09:19 isisdata/juno/kernels/spk/juno_rec_220728_220909_220913.bsp
-rw-r--r--  1 kbecker  staff  2899968 Nov 11 09:19 isisdata/juno/kernels/spk/juno_rec_220909_221019_221027.bsp
-rw-r--r--  1 kbecker  staff  2342912 Nov 11 09:19 isisdata/juno/kernels/spk/juno_rec_221019_221127_221208.bsp
-rw-r--r--  1 kbecker  staff  2417664 Nov 11 09:19 isisdata/juno/kernels/spk/juno_rec_221127_230104_230111.bsp