search

heyyy / espa

Automatically exported from code.google.com/p/espa
0 stars 0 forks source link

Error processing l1t for processing with customized input products #177

Closed GoogleCodeExporter closed 9 years ago

GoogleCodeExporter commented 9 years ago 
Error processing level 1 input product with customized options:

scene: LT50460282002042EDC01

{"include_sr_browse": false, "utm_zone": null, "longitude_pole": null, 
"central_meridian": null, "pixel_size_units": "meters", "include_sr_evi": 
false, "include_sr_nbr2": false, "std_parallel_1": null, "std_parallel_2": 
null, "target_projection": "", "minx": "", "datum": "wgs84", 
"include_source_metadata": false, "false_northing": null, "include_sr_thermal": 
false, "include_sr_toa": false, "latitude_true_scale": null, "pixel_size": 30, 
"reproject": false, "include_source_data": false, 
"include_customized_source_data": true, "maxx": "", "maxy": "", 
"image_extents": false, "resample_method": "near", "include_cfmask": false, 
"include_sr_savi": false, "include_sr_nbr": false, "include_sr_ndmi": false, 
"include_sr": false, "include_sr_msavi": false, "miny": "", 
"include_solr_index": false, "resize": true, "utm_north_south": null, 
"false_easting": null, "include_sr_ndvi": false, "output_format": "envi", 
"origin_lat": null}

Failure message is:
2014-07-14 13:31.52 16180 [cdr_ecv_mapper.py]:80 Processing 
rdilley@usgs.gov-07112014-170553:LT50460282002042EDC01
2014-07-14 13:31.53 16180 [cdr_ecv_mapper.py]:122 Processing cdr_ecv with 
[--orderid "rdilley@usgs.gov-07112014-170553" --scene "LT50460282002042EDC01" 
--datum "wgs84" --minx "" --miny "" --destination_pw "v2vZzhN%24coG3" --maxx "" 
--maxy "" --resize --output_format "envi" --destination_username "espadev" 
--pixel_size_units "meters" --include_customized_source_data --pixel_size "30" 
--source_username "espadev" --source_pw "v2vZzhN%24coG3" --resample_method 
"near" --target_projection ""]
2014-07-14 13:31.53 16180 [transfer.py]:279 Transfering 
[edclxs67p:/data/standard_l1t/tm/46/28/2002/LT50460282002042EDC01.tar.gz] to 
[localhost:/data/espadev/mapred/local/taskTracker/espadev/jobcache/job_201407090
958_0011/attempt_201407090958_0011_m_000001_0/work/rdilley@usgs.gov-07112014-170
553/LT50460282002042EDC01/stage/LT50460282002042EDC01.tar.gz]
2014-07-14 13:31.53 16180 [transfer.py]:112 Transferring file from 
ftp://edclxs67p//data/standard_l1t/tm/46/28/2002/LT50460282002042EDC01.tar.gz 
to 
/data/espadev/mapred/local/taskTracker/espadev/jobcache/job_201407090958_0011/at
tempt_201407090958_0011_m_000001_0/work/rdilley@usgs.gov-07112014-170553/LT50460
282002042EDC01/stage/LT50460282002042EDC01.tar.gz
2014-07-14 13:31.53 16180 [transfer.py]:128 Transfer complete - FTP
2014-07-14 13:31.53 16180 [staging.py]:66 Unpacking 
[/data/espadev/mapred/local/taskTracker/espadev/jobcache/job_201407090958_0011/a
ttempt_201407090958_0011_m_000001_0/work/rdilley@usgs.gov-07112014-170553/LT5046
0282002042EDC01/stage/LT50460282002042EDC01.tar.gz] to 
[/data/espadev/mapred/local/taskTracker/espadev/jobcache/job_201407090958_0011/a
ttempt_201407090958_0011_m_000001_0/work/rdilley@usgs.gov-07112014-170553/LT5046
0282002042EDC01/work]
2014-07-14 13:31.58 16180 [staging.py]:76 /bin/sh: module: line 1: syntax 
error: unexpected end of file
/bin/sh: error importing function definition for `module'
LT50460282002042EDC01_B1.TIF
LT50460282002042EDC01_B2.TIF
LT50460282002042EDC01_B3.TIF
LT50460282002042EDC01_B4.TIF
LT50460282002042EDC01_B5.TIF
LT50460282002042EDC01_B6.TIF
LT50460282002042EDC01_B7.TIF
LT50460282002042EDC01_GCP.txt
LT50460282002042EDC01_MTL.txt
LT50460282002042EDC01_VER.jpg
LT50460282002042EDC01_VER.txt
README.GTF

2014-07-14 13:31.58 16180 [metadata.py]:40 Located MTL 
file:LT50460282002042EDC01_MTL.txt
2014-07-14 13:31.58 16180 [science.py]:250 CONVERT LPGS TO ESPA COMMAND: 
convert_lpgs_to_espa --mtl LT50460282002042EDC01_MTL.txt --xml 
LT50460282002042EDC01.xml --del_src_files
2014-07-14 13:31.58 16180 [science.py]:259 /bin/sh: module: line 1: syntax 
error: unexpected end of file
/bin/sh: error importing function definition for `module'
  Band 0: LT50460282002042EDC01_B1.TIF to LT50460282002042EDC01_B1.img
  Removing LT50460282002042EDC01_B1.TIF
  Band 1: LT50460282002042EDC01_B2.TIF to LT50460282002042EDC01_B2.img
  Removing LT50460282002042EDC01_B2.TIF
  Band 2: LT50460282002042EDC01_B3.TIF to LT50460282002042EDC01_B3.img
  Removing LT50460282002042EDC01_B3.TIF
  Band 3: LT50460282002042EDC01_B4.TIF to LT50460282002042EDC01_B4.img
  Removing LT50460282002042EDC01_B4.TIF
  Band 4: LT50460282002042EDC01_B5.TIF to LT50460282002042EDC01_B5.img
  Removing LT50460282002042EDC01_B5.TIF
  Band 5: LT50460282002042EDC01_B6.TIF to LT50460282002042EDC01_B6.img
  Removing LT50460282002042EDC01_B6.TIF
  Band 6: LT50460282002042EDC01_B7.TIF to LT50460282002042EDC01_B7.img
  Removing LT50460282002042EDC01_B7.TIF

2014-07-14 13:31.58 16180 [science.py]:446 REMOVING INTERMEDIATE DATA COMMAND: 
rm -rf LT50460282002042EDC01_MTL.txt.old LT50460282002042EDC01_MTL.txt 
LT50460282002042EDC01_VER.jpg LT50460282002042EDC01_VER.txt 
LT50460282002042EDC01_GCP.txt
2014-07-14 13:31.58 16180 [science.py]:455 /bin/sh: module: line 1: syntax 
error: unexpected end of file
/bin/sh: error importing function definition for `module'

2014-07-14 13:31.58 16180 [warp.py]:880 Processing LT50460282002042EDC01_B1.img
2014-07-14 13:31.59 16180 [warp.py]:392 Warping LT50460282002042EDC01_B1.img 
with gdalwarp -wm 2048 -multi -of envi -tr 30.0 30.0 -r near -srcnodata 0 
-dstnodata 0 LT50460282002042EDC01_B1.img tmp-LT50460282002042EDC01_B1.img
2014-07-14 13:32.00 16180 [warp.py]:394 /bin/sh: module: line 1: syntax error: 
unexpected end of file
/bin/sh: error importing function definition for `module'
ERROR 6: SetNoDataValue() not supported for this dataset.
ERROR 6: tmp-LT50460282002042EDC01_B1.img, band 1: SetNoDataValue() not 
supported for this dataset.
Creating output file that is 7951P x 7321L.
Processing input file LT50460282002042EDC01_B1.img.
0...10...20...30...40...50...60...70...80...90...100 - done.

2014-07-14 13:32.00 16180 [warp.py]:880 Processing LT50460282002042EDC01_B2.img
2014-07-14 13:32.00 16180 [warp.py]:392 Warping LT50460282002042EDC01_B2.img 
with gdalwarp -wm 2048 -multi -of envi -tr 30.0 30.0 -r near -srcnodata 0 
-dstnodata 0 LT50460282002042EDC01_B2.img tmp-LT50460282002042EDC01_B2.img
2014-07-14 13:32.02 16180 [warp.py]:394 /bin/sh: module: line 1: syntax error: 
unexpected end of file
/bin/sh: error importing function definition for `module'
ERROR 6: SetNoDataValue() not supported for this dataset.
ERROR 6: tmp-LT50460282002042EDC01_B2.img, band 1: SetNoDataValue() not 
supported for this dataset.
Creating output file that is 7951P x 7321L.
Processing input file LT50460282002042EDC01_B2.img.
0...10...20...30...40...50...60...70...80...90...100 - done.

2014-07-14 13:32.02 16180 [warp.py]:880 Processing LT50460282002042EDC01_B3.img
2014-07-14 13:32.02 16180 [warp.py]:392 Warping LT50460282002042EDC01_B3.img 
with gdalwarp -wm 2048 -multi -of envi -tr 30.0 30.0 -r near -srcnodata 0 
-dstnodata 0 LT50460282002042EDC01_B3.img tmp-LT50460282002042EDC01_B3.img
2014-07-14 13:32.04 16180 [warp.py]:394 /bin/sh: module: line 1: syntax error: 
unexpected end of file
/bin/sh: error importing function definition for `module'
ERROR 6: SetNoDataValue() not supported for this dataset.
ERROR 6: tmp-LT50460282002042EDC01_B3.img, band 1: SetNoDataValue() not 
supported for this dataset.
Creating output file that is 7951P x 7321L.
Processing input file LT50460282002042EDC01_B3.img.
0...10...20...30...40...50...60...70...80...90...100 - done.

2014-07-14 13:32.04 16180 [warp.py]:880 Processing LT50460282002042EDC01_B4.img
2014-07-14 13:32.04 16180 [warp.py]:392 Warping LT50460282002042EDC01_B4.img 
with gdalwarp -wm 2048 -multi -of envi -tr 30.0 30.0 -r near -srcnodata 0 
-dstnodata 0 LT50460282002042EDC01_B4.img tmp-LT50460282002042EDC01_B4.img
2014-07-14 13:32.06 16180 [warp.py]:394 /bin/sh: module: line 1: syntax error: 
unexpected end of file
/bin/sh: error importing function definition for `module'
ERROR 6: SetNoDataValue() not supported for this dataset.
ERROR 6: tmp-LT50460282002042EDC01_B4.img, band 1: SetNoDataValue() not 
supported for this dataset.
Creating output file that is 7951P x 7321L.
Processing input file LT50460282002042EDC01_B4.img.
0...10...20...30...40...50...60...70...80...90...100 - done.

2014-07-14 13:32.06 16180 [warp.py]:880 Processing LT50460282002042EDC01_B5.img
2014-07-14 13:32.06 16180 [warp.py]:392 Warping LT50460282002042EDC01_B5.img 
with gdalwarp -wm 2048 -multi -of envi -tr 30.0 30.0 -r near -srcnodata 0 
-dstnodata 0 LT50460282002042EDC01_B5.img tmp-LT50460282002042EDC01_B5.img
2014-07-14 13:32.08 16180 [warp.py]:394 /bin/sh: module: line 1: syntax error: 
unexpected end of file
/bin/sh: error importing function definition for `module'
ERROR 6: SetNoDataValue() not supported for this dataset.
ERROR 6: tmp-LT50460282002042EDC01_B5.img, band 1: SetNoDataValue() not 
supported for this dataset.
Creating output file that is 7951P x 7321L.
Processing input file LT50460282002042EDC01_B5.img.
0...10...20...30...40...50...60...70...80...90...100 - done.

2014-07-14 13:32.08 16180 [warp.py]:880 Processing LT50460282002042EDC01_B6.img
2014-07-14 13:32.08 16180 [warp.py]:392 Warping LT50460282002042EDC01_B6.img 
with gdalwarp -wm 2048 -multi -of envi -tr 30.0 30.0 -r near -srcnodata 0 
-dstnodata 0 LT50460282002042EDC01_B6.img tmp-LT50460282002042EDC01_B6.img
2014-07-14 13:32.09 16180 [warp.py]:394 /bin/sh: module: line 1: syntax error: 
unexpected end of file
/bin/sh: error importing function definition for `module'
ERROR 6: SetNoDataValue() not supported for this dataset.
ERROR 6: tmp-LT50460282002042EDC01_B6.img, band 1: SetNoDataValue() not 
supported for this dataset.
Creating output file that is 7951P x 7321L.
Processing input file LT50460282002042EDC01_B6.img.
0...10...20...30...40...50...60...70...80...90...100 - done.

2014-07-14 13:32.09 16180 [warp.py]:880 Processing LT50460282002042EDC01_B7.img
2014-07-14 13:32.09 16180 [warp.py]:392 Warping LT50460282002042EDC01_B7.img 
with gdalwarp -wm 2048 -multi -of envi -tr 30.0 30.0 -r near -srcnodata 0 
-dstnodata 0 LT50460282002042EDC01_B7.img tmp-LT50460282002042EDC01_B7.img
2014-07-14 13:32.11 16180 [warp.py]:394 /bin/sh: module: line 1: syntax error: 
unexpected end of file
/bin/sh: error importing function definition for `module'
ERROR 6: SetNoDataValue() not supported for this dataset.
ERROR 6: tmp-LT50460282002042EDC01_B7.img, band 1: SetNoDataValue() not 
supported for this dataset.
Creating output file that is 7951P x 7321L.
Processing input file LT50460282002042EDC01_B7.img.
0...10...20...30...40...50...60...70...80...90...100 - done.

2014-07-14 13:32.11 16180 [warp.py]:548 Updating XML for 
LT50460282002042EDC01_B1.img
2014-07-14 13:32.11 16180 [warp.py]:548 Updating XML for 
LT50460282002042EDC01_B2.img
2014-07-14 13:32.11 16180 [warp.py]:548 Updating XML for 
LT50460282002042EDC01_B3.img
2014-07-14 13:32.11 16180 [warp.py]:548 Updating XML for 
LT50460282002042EDC01_B4.img
2014-07-14 13:32.11 16180 [warp.py]:548 Updating XML for 
LT50460282002042EDC01_B5.img
2014-07-14 13:32.11 16180 [warp.py]:548 Updating XML for 
LT50460282002042EDC01_B6.img
2014-07-14 13:32.11 16180 [warp.py]:548 Updating XML for 
LT50460282002042EDC01_B7.img
2014-07-14 13:32.11 16180 [warp.py]:634 ---- Updating UTM Parameters
2014-07-14 13:32.11 16180 [warp.py]:809 ---- Validating XML Modifications and 
Creating Temp Output File

metadata_api Validation Error: cannot concatenate 'str' and 'NoneType' objects

Original issue reported on code.google.com by davehil...@gmail.com on 14 Jul 2014 at 6:51

GoogleCodeExporter commented 9 years ago 
changing to High priority as it causes system to be non-functional for 2.4.0 
release.

Original comment by davehil...@gmail.com on 14 Jul 2014 at 6:54

GoogleCodeExporter commented 9 years ago 
errors was caused by generated code in espa common where it was attempting to 
concatenate a str() with Nonetype but was not checking to see if the value was 
None first.

Code has been corrected and the xml parsing generated code updated on trunk.

Original comment by davehil...@gmail.com on 14 Jul 2014 at 7:43

GoogleCodeExporter commented 9 years ago

Original comment by davehil...@gmail.com on 14 Jul 2014 at 8:49

GoogleCodeExporter commented 9 years ago 
verified

Original comment by davehil...@gmail.com on 31 Jul 2014 at 6:41