search

SuperDARNCanada / data_flow

Scripts related to data flow and management
0 stars 3 forks source link

Optimize DMAP file generation #38

Open RemingtonRohel opened 1 year ago

RemingtonRohel commented 1 year ago

Currently the dataflow for rawacf files on site-linux computers is:

  1. Convert .site structured files to .array structured files
  2. If --dmap specified, use the .array structured file to create a DMAP file.

However, the first thing pyDARNio does to convert an array file to DMAP is convert the array file to .site structure in memory. We can cut out the middleman and do this directly before converting to .array structure. See site-linux/convert_and_restructure lines 110-121