USF-IMARS / wv-land-cover

:earth_americas: Processing scripts for decision-tree land use classification on worldview 2 imagery
5 stars 5 forks source link

fl_se, monroe, fl_ne confusion #12

Closed 7yl4r closed 5 years ago

7yl4r commented 5 years ago

Some files have come in with the wrong region names:

  1. all *fl_se* should be *monroe*
  2. all *fl_ne* from 02:15 on should be *fl_se*

Theoretical fix:

# [root@cozumel ]#
cd /cozumel/imars_objects/ftp-ingest
# (1) 
find ./ \
    -name "wv*_fl_se_*_0.zip" \
    -exec bash -c 'mv $0 ${0/fl_se/monroe}' {} \;

# (2) 
find ./ \
    -name "wv[2-3]_2018_09_17T0[2-3]*_fl_ne_*_0.zip" \
    -exec bash -c 'mv $0 ${0/fl_ne/fl_se}' {} \;
7yl4r commented 5 years ago

files that were renamed:

-rw-r--r--. 1 imars imars  17G Oct 23 07:09 wv2_2018_10_08T115750_monroe_058523212_10_0.zip
-rw-r--r--. 1 imars imars 2.6G Oct 22 16:54 wv2_2018_10_08T115959_monroe_058523220_10_0.zip
-rw-r--r--. 1 imars imars 2.8G Oct 22 16:58 wv2_2018_10_08T120029_monroe_058523218_10_0.zip
-rw-r--r--. 1 imars imars  12G Oct 23 03:00 wv2_2018_10_08T120342_monroe_058523215_10_0.zip
-rw-r--r--. 1 imars imars  18G Oct 23 06:09 wv2_2018_10_08T120409_monroe_058523217_10_0.zip
-rw-r--r--. 1 imars imars 2.9G Oct 22 17:01 wv2_2018_10_08T120444_monroe_058523213_10_0.zip
-rw-r--r--. 1 imars imars 2.9G Oct 22 18:16 wv2_2018_10_08T120506_monroe_058523214_10_0.zip
-rw-r--r--. 1 imars imars 3.0G Oct 22 18:15 wv2_2018_10_08T120524_monroe_058523216_10_0.zip
-rw-r--r--. 1 imars imars 9.5G Oct 23 00:20 wv2_2018_10_08T120542_monroe_058523219_10_0.zip
-rw-r--r--. 1 imars imars  17G Oct 23 09:41 wv2_2018_10_08T120601_monroe_058523207_10_0.zip
-rw-r--r--. 1 imars imars  18G Oct 23 07:42 wv2_2018_10_08T120826_monroe_058523211_10_0.zip
-rw-r--r--. 1 imars imars  13G Oct 23 03:33 wv2_2018_10_08T120843_monroe_058523209_10_0.zip
-rw-r--r--. 1 imars imars  10G Oct 23 01:25 wv2_2018_10_08T120910_monroe_058523204_10_0.zip
-rw-r--r--. 1 imars imars  16G Oct 23 09:03 wv2_2018_10_08T120932_monroe_058523208_10_0.zip
-rw-r--r--. 1 imars imars  15G Oct 23 08:33 wv2_2018_10_08T120954_monroe_058523203_10_0.zip
-rw-r--r--. 1 imars imars  15G Oct 23 08:12 wv2_2018_10_08T121011_monroe_058523202_10_0.zip
-rw-r--r--. 1 imars imars  13G Oct 23 07:09 wv2_2018_10_08T121027_monroe_058523206_10_0.zip
-rw-r--r--. 1 imars imars  22G Oct 23 10:48 wv2_2018_10_08T121039_monroe_058523205_10_0.zip
-rw-r--r--. 1 imars imars 9.0G Oct 27 05:48 wv2_2018_10_08T121059_monroe_058586585_10_0.zip
-rw-r--r--. 1 imars imars  17G Oct 23 07:50 wv2_2018_10_08T121830_monroe_058523201_10_0.zip
-rw-r--r--. 1 imars imars  16G Oct 23 09:07 wv2_2018_10_08T121859_monroe_058523199_10_0.zip
-rw-r--r--. 1 imars imars  17G Oct 23 09:19 wv2_2018_10_08T121919_monroe_058523198_10_0.zip
-rw-r--r--. 1 imars imars  11G Oct 24 13:27 wv2_2018_10_08T122525_monroe_058526507_10_0.zip
-rw-r--r--. 1 imars imars  14G Oct 24 15:14 wv2_2018_10_08T122555_monroe_058526506_10_0.zip
-rw-r--r--. 1 imars imars  15G Oct 24 15:18 wv2_2018_10_08T122613_monroe_058526505_10_0.zip
-rw-r--r--. 1 imars imars  12G Oct 24 01:25 wv2_2018_10_08T122626_monroe_058526504_10_0.zip
-rw-r--r--. 1 imars imars  15G Oct 24 18:23 wv2_2018_10_08T122640_monroe_058526502_10_0.zip
-rw-r--r--. 1 imars imars  24G Oct 24 19:13 wv2_2018_10_08T122656_monroe_058526503_10_0.zip
-rw-r--r--. 1 imars imars  15G Oct 24 16:04 wv2_2018_10_08T122714_monroe_058526500_10_0.zip
-rw-r--r--. 1 imars imars  12G Oct 24 14:18 wv2_2018_10_08T122731_monroe_058526499_10_0.zip
-rw-r--r--. 1 imars imars  18G Oct 24 17:44 wv2_2018_10_08T122749_monroe_058526501_10_0.zip
-rw-r--r--. 1 imars imars  14G Oct 24 15:19 wv2_2018_10_08T122807_monroe_058526497_10_0.zip
-rw-r--r--. 1 imars imars  12G Oct 24 14:14 wv2_2018_10_08T122835_monroe_058526498_10_0.zip
-rw-r--r--. 1 imars imars 7.1G Oct 24 09:50 wv2_2018_10_08T122852_monroe_058526496_10_0.zip
-rw-r--r--. 1 imars imars 6.5G Oct 24 09:09 wv2_2018_10_08T122908_monroe_058526495_10_0.zip
-rw-r--r--. 1 imars imars 4.2G Oct 24 01:00 wv2_2018_10_08T122924_monroe_058526494_10_0.zip
-rw-r--r--. 1 imars imars 6.8G Oct 24 09:39 wv2_2018_10_08T122945_monroe_058526493_10_0.zip
-rw-r--r--. 1 imars imars 7.3G Oct 24 10:00 wv2_2018_10_08T122958_monroe_058526491_10_0.zip
-rw-r--r--. 1 imars imars  15G Oct 24 15:30 wv2_2018_10_08T123014_monroe_058526490_10_0.zip
-rw-r--r--. 1 imars imars  11G Oct 24 17:26 wv2_2018_10_08T123028_monroe_058526492_10_0.zip
-rw-r--r--. 1 imars imars  17G Oct 24 17:11 wv2_2018_10_08T123044_monroe_058526489_10_0.zip
-rw-r--r--. 1 imars imars  11G Oct 24 13:38 wv2_2018_10_08T123101_monroe_058526488_10_0.zip
-rw-r--r--. 1 imars imars  17G Oct 27 11:00 wv2_2018_10_08T124320_monroe_058586856_10_0.zip
-rw-r--r--. 1 imars imars 7.5G Oct 27 03:48 wv2_2018_10_08T124337_monroe_058586861_10_0.zip
-rw-r--r--. 1 imars imars  18G Oct 27 11:07 wv2_2018_10_08T124818_monroe_058586863_10_0.zip
-rw-r--r--. 1 imars imars 4.9G Oct 27 01:50 wv2_2018_10_08T124835_monroe_058586858_10_0.zip
-rw-r--r--. 1 imars imars 9.8G Oct 27 06:18 wv2_2018_10_08T124851_monroe_058586857_10_0.zip
-rw-r--r--. 1 imars imars  16G Oct 27 10:05 wv2_2018_10_08T124909_monroe_058586862_10_0.zip
-rw-r--r--. 1 imars imars  15G Oct 27 09:06 wv2_2018_10_08T124924_monroe_058586859_10_0.zip
-rw-r--r--. 1 imars imars  10G Oct 27 05:13 wv2_2018_10_08T124939_monroe_058586860_10_0.zip
-rw-r--r--. 1 imars imars  23G Oct 27 13:32 wv2_2018_10_08T124954_monroe_058586855_10_0.zip
-rw-r--r--. 1 imars imars  25G Oct 27 13:40 wv2_2018_10_08T125016_monroe_058586854_10_0.zip
-rw-r--r--. 1 imars imars  14G Oct 27 09:12 wv2_2018_10_08T125029_monroe_058586853_10_0.zip
-rw-r--r--. 1 imars imars  19G Oct 27 11:33 wv2_2018_10_08T125049_monroe_058586851_10_0.zip
-rw-r--r--. 1 imars imars  16G Oct 27 09:59 wv2_2018_10_08T125113_monroe_058586852_10_0.zip
-rw-r--r--. 1 imars imars  16G Oct 27 10:20 wv2_2018_10_08T125140_monroe_058586850_10_0.zip

-rw-r--r--. 1 imars imars 1.8G Sep 27 15:31 wv2_2018_09_17T021742_fl_se_058468392_10_0.zip
-rw-r--r--. 1 imars imars 2.5G Sep 27 16:06 wv2_2018_09_17T022002_fl_se_058468395_10_0.zip
-rw-r--r--. 1 imars imars 2.5G Sep 27 16:06 wv2_2018_09_17T022022_fl_se_058468393_10_0.zip
-rw-r--r--. 1 imars imars 2.2G Sep 27 15:37 wv2_2018_09_17T022041_fl_se_058468400_10_0.zip
-rw-r--r--. 1 imars imars 2.2G Sep 27 15:52 wv2_2018_09_17T022120_fl_se_058468397_10_0.zip
-rw-r--r--. 1 imars imars 2.1G Sep 27 15:43 wv2_2018_09_17T022136_fl_se_058468394_10_0.zip
-rw-r--r--. 1 imars imars 2.5G Sep 27 16:05 wv2_2018_09_17T022153_fl_se_058468399_10_0.zip
-rw-r--r--. 1 imars imars 2.2G Sep 27 15:49 wv2_2018_09_17T022210_fl_se_058468398_10_0.zip
-rw-r--r--. 1 imars imars 9.6G Sep 27 21:29 wv2_2018_09_17T022259_fl_se_058468390_10_0.zip
-rw-r--r--. 1 imars imars  14G Sep 29 15:24 wv2_2018_09_17T022325_fl_se_058468389_10_0.zip
-rw-r--r--. 1 imars imars  18G Oct  2 06:11 wv2_2018_09_17T022411_fl_se_058473680_10_0.zip
-rw-r--r--. 1 imars imars 2.2G Sep 27 20:57 wv2_2018_09_17T022429_fl_se_058473684_10_0.zip
-rw-r--r--. 1 imars imars  15G Sep 29 15:50 wv2_2018_09_17T022509_fl_se_058473683_10_0.zip
-rw-r--r--. 1 imars imars  15G Sep 29 15:58 wv2_2018_09_17T022536_fl_se_058473685_10_0.zip
-rw-r--r--. 1 imars imars  17G Sep 29 15:57 wv2_2018_09_17T022619_fl_se_058473687_10_0.zip
-rw-r--r--. 1 imars imars  18G Sep 29 16:56 wv2_2018_09_17T022633_fl_se_058473686_10_0.zip
-rw-r--r--. 1 imars imars  12G Sep 29 14:25 wv2_2018_09_17T022647_fl_se_058473682_10_0.zip
-rw-r--r--. 1 imars imars  17G Oct  3 08:23 wv2_2018_09_17T022701_fl_se_058473681_10_0.zip
-rw-r--r--. 1 imars imars  12G Oct  2 01:42 wv2_2018_09_17T022715_fl_se_058473679_10_0.zip
-rw-r--r--. 1 imars imars  21G Oct  3 11:37 wv2_2018_09_17T022730_fl_se_058473678_10_0.zip
-rw-r--r--. 1 imars imars  21G Oct  3 09:57 wv2_2018_09_17T022744_fl_se_058473676_10_0.zip
-rw-r--r--. 1 imars imars  19G Oct  3 10:24 wv2_2018_09_17T022801_fl_se_058473677_10_0.zip
-rw-r--r--. 1 imars imars  17G Oct  2 05:02 wv2_2018_09_17T022811_fl_se_058473675_10_0.zip
-rw-r--r--. 1 imars imars  17G Oct  3 07:28 wv2_2018_09_17T022827_fl_se_058473674_10_0.zip
-rw-r--r--. 1 imars imars  17G Oct  2 05:45 wv2_2018_09_17T023426_fl_se_058473673_10_0.zip
-rw-r--r--. 1 imars imars  17G Oct  2 05:12 wv2_2018_09_17T023450_fl_se_058473670_10_0.zip
-rw-r--r--. 1 imars imars  19G Oct  2 06:02 wv2_2018_09_17T023502_fl_se_058473666_10_0.zip
-rw-r--r--. 1 imars imars  16G Oct  2 04:40 wv2_2018_09_17T023508_fl_se_058473671_10_0.zip
-rw-r--r--. 1 imars imars  17G Oct  2 05:33 wv2_2018_09_17T023531_fl_se_058473672_10_0.zip
-rw-r--r--. 1 imars imars  16G Oct  2 05:01 wv2_2018_09_17T023542_fl_se_058473669_10_0.zip
-rw-r--r--. 1 imars imars  20G Oct  3 11:06 wv2_2018_09_17T023617_fl_se_058473668_10_0.zip
-rw-r--r--. 1 imars imars  15G Oct  2 03:52 wv2_2018_09_17T023632_fl_se_058473667_10_0.zip
-rw-r--r--. 1 imars imars  15G Oct  2 04:13 wv2_2018_09_17T023648_fl_se_058473665_10_0.zip
-rw-r--r--. 1 imars imars  13G Oct  2 02:38 wv2_2018_09_17T023709_fl_se_058473664_10_0.zip
-rw-r--r--. 1 imars imars 8.0G Oct  1 22:51 wv2_2018_09_17T023724_fl_se_058473663_10_0.zip
-rw-r--r--. 1 imars imars 7.0G Oct  1 22:16 wv2_2018_09_17T023735_fl_se_058473662_10_0.zip
-rw-r--r--. 1 imars imars 1.6G Oct  2 16:36 wv2_2018_09_17T023751_fl_se_058473661_10_0.zip
-rw-r--r--. 1 imars imars  34G Oct  3 19:10 wv3_2018_09_17T031648_fl_se_058473658_10_0.zip
-rw-r--r--. 1 imars imars  30G Oct  3 17:04 wv3_2018_09_17T031840_fl_se_058473659_10_0.zip
-rw-r--r--. 1 imars imars  32G Oct  3 18:46 wv3_2018_09_17T032030_fl_se_058473660_10_0.zip
-rw-r--r--. 1 imars imars  15G Oct  3 06:12 wv3_2018_09_17T032117_fl_se_058487818_10_0.zip
-rw-r--r--. 1 imars imars  15G Oct  3 06:38 wv3_2018_09_17T032136_fl_se_058487817_10_0.zip
-rw-r--r--. 1 imars imars  24G Oct  3 15:04 wv3_2018_09_17T032202_fl_se_058487813_10_0.zip
-rw-r--r--. 1 imars imars  28G Oct  3 22:50 wv3_2018_09_17T032221_fl_se_058487814_10_0.zip
-rw-r--r--. 1 imars imars  26G Oct  3 22:22 wv3_2018_09_17T032234_fl_se_058487812_10_0.zip
-rw-r--r--. 1 imars imars  28G Oct  3 15:19 wv3_2018_09_17T032255_fl_se_058487810_10_0.zip
-rw-r--r--. 1 imars imars  21G Oct  3 10:42 wv3_2018_09_17T032317_fl_se_058487811_10_0.zip
-rw-r--r--. 1 imars imars  24G Oct  3 13:39 wv3_2018_09_17T032333_fl_se_058487815_10_0.zip
-rw-r--r--. 1 imars imars  29G Oct  3 23:16 wv3_2018_09_17T032347_fl_se_058487816_10_0.zip
-rw-r--r--. 1 imars imars  19G Oct  3 09:33 wv3_2018_09_17T032403_fl_se_058487809_10_0.zip
-rw-r--r--. 1 imars imars  32G Oct  6 01:06 wv3_2018_09_17T032423_fl_se_058493432_10_0.zip
-rw-r--r--. 1 imars imars  27G Oct  5 19:12 wv3_2018_09_17T032440_fl_se_058493436_10_0.zip
-rw-r--r--. 1 imars imars  38G Oct  6 05:38 wv3_2018_09_17T032453_fl_se_058493438_10_0.zip
-rw-r--r--. 1 imars imars  19G Oct  5 13:19 wv3_2018_09_17T032508_fl_se_058493430_10_0.zip
-rw-r--r--. 1 imars imars  33G Oct  6 03:09 wv3_2018_09_17T032530_fl_se_058493435_10_0.zip
-rw-r--r--. 1 imars imars  17G Oct  5 10:55 wv3_2018_09_17T032542_fl_se_058493439_10_0.zip
-rw-r--r--. 1 imars imars  21G Oct  5 13:21 wv3_2018_09_17T032643_fl_se_058493434_10_0.zip
-rw-r--r--. 1 imars imars  28G Oct  5 19:49 wv3_2018_09_17T032703_fl_se_058493431_10_0.zip
-rw-r--r--. 1 imars imars  38G Oct  6 05:35 wv3_2018_09_17T032720_fl_se_058493429_10_0.zip
-rw-r--r--. 1 imars imars  17G Oct  5 10:50 wv3_2018_09_17T032737_fl_se_058493427_10_0.zip
-rw-r--r--. 1 imars imars  24G Oct  5 17:47 wv3_2018_09_17T032752_fl_se_058493426_10_0.zip
-rw-r--r--. 1 imars imars  29G Oct  5 21:09 wv3_2018_09_17T032807_fl_se_058493425_10_0.zip
-rw-r--r--. 1 imars imars  30G Oct  5 22:54 wv3_2018_09_17T032823_fl_se_058493424_10_0.zip
-rw-r--r--. 1 imars imars  14G Oct  5 06:48 wv3_2018_09_17T032839_fl_se_058493423_10_0.zip
-rw-r--r--. 1 imars imars  21G Oct  6 12:09 wv3_2018_09_17T032854_fl_se_058502544_10_0.zip
-rw-r--r--. 1 imars imars  20G Oct  6 11:44 wv3_2018_09_17T032909_fl_se_058502541_10_0.zip
-rw-r--r--. 1 imars imars  16G Oct  6 07:38 wv3_2018_09_17T032929_fl_se_058502543_10_0.zip
-rw-r--r--. 1 imars imars  24G Oct  6 11:34 wv3_2018_09_17T032943_fl_se_058502537_10_0.zip
-rw-r--r--. 1 imars imars  20G Oct  6 09:45 wv3_2018_09_17T033000_fl_se_058502539_10_0.zip
-rw-r--r--. 1 imars imars  21G Oct  6 11:39 wv3_2018_09_17T033019_fl_se_058502538_10_0.zip
-rw-r--r--. 1 imars imars  24G Oct  6 10:50 wv3_2018_09_17T033035_fl_se_058502536_10_0.zip
-rw-r--r--. 1 imars imars 1.7G Oct  5 19:14 wv3_2018_09_17T033051_fl_se_058502540_10_0.zip
-rw-r--r--. 1 imars imars  28G Oct  6 13:58 wv3_2018_09_17T033106_fl_se_058502547_10_0.zip
-rw-r--r--. 1 imars imars  27G Oct  6 12:43 wv3_2018_09_17T033131_fl_se_058502535_10_0.zip
-rw-r--r--. 1 imars imars 2.2G Oct  5 17:12 wv3_2018_09_17T033345_fl_se_058502533_10_0.zip
-rw-r--r--. 1 imars imars 2.6G Oct  5 17:32 wv3_2018_09_17T033442_fl_se_058502534_10_0.zip
-rw-r--r--. 1 imars imars 2.7G Oct  5 19:29 wv3_2018_09_17T033605_fl_se_058502532_10_0.zip
-rw-r--r--. 1 imars imars 2.0G Oct  5 16:53 wv3_2018_09_17T033619_fl_se_058502531_10_0.zip
-rw-r--r--. 1 imars imars 2.5G Oct  4 21:02 wv3_2018_09_17T033628_fl_se_058493437_10_0.zip
-rw-r--r--. 1 imars imars 1.8G Oct  5 16:38 wv3_2018_09_17T033635_fl_se_058502530_10_0.zip
7yl4r commented 5 years ago

last few:

# test 
[root@cozumel ftp-ingest]# find ./ \
    -name "wv[2-3]_2018_10*fl_se_*_0.zip" \
    -exec bash -c 'echo rename $0 to ${0/fl_se/monroe}' {} \;
rename ./wv2_2018_10_08T125418_fl_se_058613071_10_0.zip to ./wv2_2018_10_08T125418_monroe_058613071_10_0.zip
rename ./wv2_2018_10_08T125243_fl_se_058613079_10_0.zip to ./wv2_2018_10_08T125243_monroe_058613079_10_0.zip
rename ./wv2_2018_10_08T125312_fl_se_058613077_10_0.zip to ./wv2_2018_10_08T125312_monroe_058613077_10_0.zip
rename ./wv2_2018_10_08T125228_fl_se_058613080_10_0.zip to ./wv2_2018_10_08T125228_monroe_058613080_10_0.zip
rename ./wv2_2018_10_08T125156_fl_se_058613075_10_0.zip to ./wv2_2018_10_08T125156_monroe_058613075_10_0.zip
rename ./wv2_2018_10_08T125211_fl_se_058613076_10_0.zip to ./wv2_2018_10_08T125211_monroe_058613076_10_0.zip
rename ./wv2_2018_10_08T125341_fl_se_058613078_10_0.zip to ./wv2_2018_10_08T125341_monroe_058613078_10_0.zip
rename ./wv2_2018_10_08T125327_fl_se_058613074_10_0.zip to ./wv2_2018_10_08T125327_monroe_058613074_10_0.zip
rename ./wv2_2018_10_08T125403_fl_se_058613072_10_0.zip to ./wv2_2018_10_08T125403_monroe_058613072_10_0.zip
rename ./wv2_2018_10_08T125258_fl_se_058613073_10_0.zip to ./wv2_2018_10_08T125258_monroe_058613073_10_0.zip

# actual rename:
[root@cozumel ftp-ingest]# find ./ \
    -name "wv[2-3]_2018_10*fl_se_*_0.zip" \
    -exec bash -c 'mv $0 ${0/fl_se/monroe}' {} \;
7yl4r commented 5 years ago

did I get that right, @sebastiandig ?

sebastiandig commented 5 years ago

@7yl4r yes that is the rest of them. Continuing, the next downloads will have the correct region

7yl4r commented 5 years ago

:beers: