clrussell90404
commented
2 weeks ago Hi Jim,
Each GMAG station data is downloaded into GMAG mirrored directories. Those files are located at:
/disks/themisdata/thg/mirrors/mag/nnn (where nnn is the network name/type)
and includes the networks
aari_ascii, lrv_ascii, magstar_csv, uatha_ascii, falcon_rmd, maccs_ascii, mcmac_rmd, uatha_rmd, fmi_ascii, step_ascii, ucalgary_rmd, greenland_ascii, ualaska_netcdf, ucla_rmd, intermagnet_ascii, ualberta_ascii usgs_ascii
Downloaded data formats are varied and depend on which network is being downloaded. Some are in ascii, csv, and or rmd formats.
All L2 CDF GMAG data (except Greenland) is located at:
/disks/themisdata/thg/l2/mag/sss/yyyy (where sss = 3 or 4 character site name, and yyyy = year)
The exception to the L2 CDF GMAG location is the Greenland data. It is in its own directory.
/disks/themisdata/thg/greenland_gmag/l2/sss (where sss is the 3 character site name)
I think Greenland was one of the first networks added to the THEMIS GBO and EPO network (by Pat Cruce and Lydia Philpott). The Greenland code is very old, and it was probably decided at the time it would be kept separate from the THEMIS data.
Hope this helps.
Cindy
From: Jim Lewis @.> Sent: Monday, November 4, 2024 12:07 PM To: spedas/bleeding_edge @.> Cc: Russell, Cindy @.>; Assign @.> Subject: [spedas/bleeding_edge] Refine product_volume.ksh script (ASI and GMAG downloads, versus products processed locally) (Issue #197)
This script produces reports of data volume for a given time period in several different categories: data retrieved from THEMIS probes and GBO stations; processed data (L0/L1/L2 products, orbit and summary plots, ASI images, movies, and mosaics), and data archived at SPDF (probe L0/L1/L2, GMAG CDFs, but not ASI products).
I had a little trouble figuring out which GMAG and ASI data was retrieved from the GBO sites, versus what we processed after it was downloaded.
Nick and Cindy: What directories should I be looking at to find the downloaded ASI and GMAG data for the THEMIS GBO sites? I need to be able to find all of it going back to the start of the mission -- is it all in the same place, or did some of it go to different directories as our download/processing scripts evolved over time?
— Reply to this email directly, view it on GitHubhttps://github.com/spedas/bleeding_edge/issues/197, or unsubscribehttps://github.com/notifications/unsubscribe-auth/A5NNFAT324DW625OHEHH77TZ66ZVBAVCNFSM6AAAAABRE5OPM6VHI2DSMVQWIX3LMV43ASLTON2WKOZSGYZTGNRSGA2TGMQ. You are receiving this because you were assigned.Message ID: @.***>
nickssl
This script produces reports of data volume for a given time period in several different categories: data retrieved from THEMIS probes and GBO stations; processed data (L0/L1/L2 products, orbit and summary plots, ASI images, movies, and mosaics), and data archived at SPDF (probe L0/L1/L2, GMAG CDFs, but not ASI products).
I had a little trouble figuring out which GMAG and ASI data was retrieved from the GBO sites, versus what we processed after it was downloaded.
Nick and Cindy: What directories should I be looking at to find the downloaded ASI and GMAG data for the THEMIS GBO sites? I need to be able to find all of it going back to the start of the mission -- is it all in the same place, or did some of it go to different directories as our download/processing scripts evolved over time?