Open gerritholl opened 5 years ago
gerritholl
commented
5 years ago The NotImplementedError: Deep space calculations not supported is caused by
from where it continues in pyorbital in
then self.mode gets set to SGDP4_DEEP_NORM because self.period > 225:
which finally is considered not supported:
According to git blame most of this code is very old so I don't yet understand if and how this may have worked in the past.
gerritholl
commented
5 years ago Geostationary satellites are not supported in pyorbital... see this email exchange from 2015. Then how does fogpy try to use pyorbital?
It appears that what is being SetUp in this test, does not correspond to anything used inside pyorbital at all?
gerritholl
commented
5 years ago The table failures appear to be due a missing trollbufr configuration.
gerritholl
commented
5 years ago When applying #2 and #3, the tests still fail but in a different way. The tables are now found, but:
testfilter.apply() for test_cloud_motion_filter gives AttributeError: 'CloudMotionFilter' object has no attribute 'cv2'KeyError: '20131112080000' or similartest_algorithms.py setUp results in NotImplementedError: Deep space calculations not supported, because pyorbital does not support geostationary satellites.test_fogpy.py setting up fails because the area definition germ is not found in the areas.yaml that I could findtest_spatial_homogenity_filter_highsd fails with AssertionError: 98 != 56======================================================================
ERROR: test_fls_algorithm (fogpy.test.test_algorithms.Test_DayFogLowStratusAlgorithm)
----------------------------------------------------------------------
Traceback (most recent call last):
File "/home/gholl/checkouts/fogpy/fogpy/test/test_algorithms.py", line 202, in test_fls_algorithm
stationfile, bgimg=self.input['ir108'])
File "/home/gholl/checkouts/fogpy/fogpy/utils/add_synop.py", line 124, in add_to_image
currentstations = stations[time.strftime("%Y%m%d%H0000")]
KeyError: '20131112080000'
-------------------- >> begin captured logging << --------------------
fogpy.algorithms: INFO: Starting fog and low cloud detection algorithm in daytime mode
fogpy.filters: INFO: Applying Cloud Filter
fogpy.filters: DEBUG: Histogram range for cloudy/clear sky pixels: -19.7446861967 - 1.11645277953
fogpy.filters: DEBUG: Cloud mask difference threshold set to -3.51935588185
fogpy.filters: INFO: Filter results for CloudFilter
Cloud filtering for satellite images.
Array size: 42018
Masking: 20551
Previous masked: 0
New filtered: 20551
Remaining: 21467
trollimage.image: DEBUG: Applying stretch crude with parameters {}
trollimage.image: DEBUG: Applying invert with parameters True
trollimage.image: DEBUG: Applying stretch crude with parameters {}
trollimage.image: DEBUG: Applying invert with parameters True
fogpy.filters: INFO: CloudFilter results are plotted to: /tmp/FLS/CloudFilter_201311120830.png
trollimage.image: DEBUG: Applying stretch crude with parameters {}
trollimage.image: WARNING: Nothing to stretch !
trollimage.image: DEBUG: Applying invert with parameters True
fogpy.filters: INFO: Applying Snow Filter
fogpy.filters: INFO: Filter results for SnowFilter
Snow filtering for satellite images.
Array size: 42018
Masking: 577
Previous masked: 20551
New filtered: 0
Remaining: 21467
trollimage.image: DEBUG: Applying stretch crude with parameters {}
trollimage.image: DEBUG: Applying invert with parameters True
trollimage.image: DEBUG: Applying stretch crude with parameters {}
trollimage.image: DEBUG: Applying invert with parameters True
fogpy.filters: INFO: SnowFilter results are plotted to: /tmp/FLS/SnowFilter_201311120830.png
trollimage.image: DEBUG: Applying stretch crude with parameters {}
trollimage.image: WARNING: Nothing to stretch !
trollimage.image: DEBUG: Applying invert with parameters True
fogpy.filters: INFO: Applying Snow Filter
fogpy.filters: INFO: Filter results for IceCloudFilter
Ice cloud filtering for satellite images.
Array size: 42018
Masking: 36632
Previous masked: 20551
New filtered: 16473
Remaining: 4994
trollimage.image: DEBUG: Applying stretch crude with parameters {}
trollimage.image: DEBUG: Applying invert with parameters True
trollimage.image: DEBUG: Applying stretch crude with parameters {}
trollimage.image: DEBUG: Applying invert with parameters True
fogpy.filters: INFO: IceCloudFilter results are plotted to: /tmp/FLS/IceCloudFilter_201311120830.png
trollimage.image: DEBUG: Applying stretch crude with parameters {}
trollimage.image: WARNING: Nothing to stretch !
trollimage.image: DEBUG: Applying invert with parameters True
fogpy.filters: INFO: Applying Cirrus Filter
fogpy.filters: DEBUG: Found solar zenith angles from 71.45427646160117 to 81.94458529861542°
fogpy.filters: DEBUG: Set BT difference thresholds for cirrus: 1.1 to 2.3 K
fogpy.filters: INFO: Filter results for CirrusCloudFilter
Thin cirrus cloud filtering for satellite images.
Array size: 42018
Masking: 9398
Previous masked: 37024
New filtered: 7
Remaining: 4987
trollimage.image: DEBUG: Applying stretch crude with parameters {}
trollimage.image: DEBUG: Applying invert with parameters True
trollimage.image: DEBUG: Applying stretch crude with parameters {}
trollimage.image: DEBUG: Applying invert with parameters True
fogpy.filters: INFO: CirrusCloudFilter results are plotted to: /tmp/FLS/CirrusCloudFilter_201311120830.png
trollimage.image: DEBUG: Applying stretch crude with parameters {}
trollimage.image: WARNING: Nothing to stretch !
trollimage.image: DEBUG: Applying invert with parameters True
fogpy.filters: INFO: Applying Water Cloud Filter
fogpy.filters: DEBUG: Mean latitudinal threshold for cloudfree areas: 271.07 K
fogpy.filters: INFO: Filter results for WaterCloudFilter
Water cloud filtering for satellite images.
Array size: 42018
Masking: 19857
Previous masked: 37031
New filtered: 112
Remaining: 4875
trollimage.image: DEBUG: Applying stretch crude with parameters {}
trollimage.image: DEBUG: Applying invert with parameters True
trollimage.image: DEBUG: Applying stretch crude with parameters {}
trollimage.image: DEBUG: Applying invert with parameters True
fogpy.filters: INFO: WaterCloudFilter results are plotted to: /tmp/FLS/WaterCloudFilter_201311120830.png
trollimage.image: DEBUG: Applying stretch crude with parameters {}
trollimage.image: WARNING: Nothing to stretch !
trollimage.image: DEBUG: Applying invert with parameters True
fogpy.algorithms: INFO: Clustering low clouds
fogpy.algorithms: DEBUG: Number of spatial coherent fog cloud clusters: 151
trollimage.image: DEBUG: Applying stretch crude with parameters {}
fogpy.algorithms: INFO: DayFogLowStratusAlgorithm results are plotted to: /tmp/FLS
fogpy.filters: INFO: Applying Spatial Cloud Top Height Filter
fogpy.filters: INFO: Filter results for SpatialCloudTopHeightFilter
Filtering cloud clusters by height for satellite images.
Array size: 42018
Masking: 17144
Previous masked: 37143
New filtered: 514
Remaining: 4361
trollimage.image: DEBUG: Applying stretch crude with parameters {}
trollimage.image: DEBUG: Applying invert with parameters True
trollimage.image: DEBUG: Applying stretch crude with parameters {}
trollimage.image: DEBUG: Applying invert with parameters True
fogpy.filters: INFO: SpatialCloudTopHeightFilter results are plotted to: /tmp/FLS/SpatialCloudTopHeightFilter_201311120830.png
trollimage.image: DEBUG: Applying stretch crude with parameters {}
trollimage.image: WARNING: Nothing to stretch !
trollimage.image: DEBUG: Applying invert with parameters True
fogpy.algorithms: INFO: Clustering low clouds
fogpy.algorithms: DEBUG: Number of spatial coherent fog cloud clusters: 91
fogpy.filters: INFO: Applying Spatial Clustering Inhomogeneity Filter
fogpy.filters: INFO: Filter results for SpatialHomogeneityFilter
Filtering cloud clusters by StDev for satellite images.
Array size: 42018
Masking: 37657
Previous masked: 37657
New filtered: 0
Remaining: 4361
trollimage.image: DEBUG: Applying stretch crude with parameters {}
trollimage.image: DEBUG: Applying invert with parameters True
trollimage.image: DEBUG: Applying stretch crude with parameters {}
trollimage.image: DEBUG: Applying invert with parameters True
fogpy.filters: INFO: SpatialHomogeneityFilter results are plotted to: /tmp/FLS/SpatialHomogeneityFilter_201311120830.png
trollimage.image: DEBUG: Applying stretch crude with parameters {}
trollimage.image: WARNING: Nothing to stretch !
trollimage.image: DEBUG: Applying invert with parameters True
fogpy.filters: INFO: Applying Spatial Clustering Inhomogenity Filter
fogpy.filters: INFO: Filter results for CloudPhysicsFilter
Filtering cloud microphysics for satellite images.
Array size: 42018
Masking: 14340
Previous masked: 37657
New filtered: 568
Remaining: 3793
trollimage.image: DEBUG: Applying stretch crude with parameters {}
trollimage.image: DEBUG: Applying invert with parameters True
trollimage.image: DEBUG: Applying stretch crude with parameters {}
trollimage.image: DEBUG: Applying invert with parameters True
fogpy.filters: INFO: CloudPhysicsFilter results are plotted to: /tmp/FLS/CloudPhysicsFilter_201311120830.png
trollimage.image: DEBUG: Applying stretch crude with parameters {}
trollimage.image: WARNING: Nothing to stretch !
trollimage.image: DEBUG: Applying invert with parameters True
fogpy.algorithms: INFO: Clustering low clouds
fogpy.algorithms: DEBUG: Number of spatial coherent fog cloud clusters: 117
fogpy.filters: INFO: Applying Low Cloud Filter
fogpy.filters: INFO: Run low cloud models for single cells
fogpy.filters: INFO: 3787 Tasks Remaining --- 0.16 % Complete
fogpy.filters: INFO: 3771 Tasks Remaining --- 0.58 % Complete
fogpy.filters: INFO: 3752 Tasks Remaining --- 1.08 % Complete
fogpy.filters: INFO: 3737 Tasks Remaining --- 1.48 % Complete
fogpy.filters: INFO: 3722 Tasks Remaining --- 1.87 % Complete
fogpy.filters: INFO: 3707 Tasks Remaining --- 2.27 % Complete
fogpy.filters: INFO: 3694 Tasks Remaining --- 2.61 % Complete
fogpy.filters: INFO: 3683 Tasks Remaining --- 2.90 % Complete
fogpy.filters: INFO: 3665 Tasks Remaining --- 3.37 % Complete
fogpy.filters: INFO: 3654 Tasks Remaining --- 3.66 % Complete
fogpy.filters: INFO: 3643 Tasks Remaining --- 3.95 % Complete
fogpy.filters: INFO: 3629 Tasks Remaining --- 4.32 % Complete
fogpy.filters: INFO: 3617 Tasks Remaining --- 4.64 % Complete
fogpy.filters: INFO: 3606 Tasks Remaining --- 4.93 % Complete
fogpy.filters: INFO: 3592 Tasks Remaining --- 5.30 % Complete
fogpy.filters: INFO: 3578 Tasks Remaining --- 5.67 % Complete
fogpy.filters: INFO: 3565 Tasks Remaining --- 6.01 % Complete
fogpy.filters: INFO: 3550 Tasks Remaining --- 6.41 % Complete
fogpy.filters: INFO: 3538 Tasks Remaining --- 6.72 % Complete
fogpy.filters: INFO: 3524 Tasks Remaining --- 7.09 % Complete
fogpy.filters: INFO: 3505 Tasks Remaining --- 7.59 % Complete
fogpy.filters: INFO: 3490 Tasks Remaining --- 7.99 % Complete
fogpy.filters: INFO: 3475 Tasks Remaining --- 8.38 % Complete
fogpy.filters: INFO: 3458 Tasks Remaining --- 8.83 % Complete
fogpy.filters: INFO: 3443 Tasks Remaining --- 9.23 % Complete
fogpy.filters: INFO: 3429 Tasks Remaining --- 9.60 % Complete
fogpy.filters: INFO: 3414 Tasks Remaining --- 9.99 % Complete
fogpy.filters: INFO: 3399 Tasks Remaining --- 10.39 % Complete
fogpy.filters: INFO: 3386 Tasks Remaining --- 10.73 % Complete
fogpy.filters: INFO: 3375 Tasks Remaining --- 11.02 % Complete
fogpy.filters: INFO: 3363 Tasks Remaining --- 11.34 % Complete
fogpy.filters: INFO: 3354 Tasks Remaining --- 11.57 % Complete
fogpy.filters: INFO: 3341 Tasks Remaining --- 11.92 % Complete
fogpy.filters: INFO: 3332 Tasks Remaining --- 12.15 % Complete
fogpy.filters: INFO: 3322 Tasks Remaining --- 12.42 % Complete
fogpy.filters: INFO: 3309 Tasks Remaining --- 12.76 % Complete
fogpy.filters: INFO: 3301 Tasks Remaining --- 12.97 % Complete
fogpy.filters: INFO: 3292 Tasks Remaining --- 13.21 % Complete
fogpy.filters: INFO: 3280 Tasks Remaining --- 13.52 % Complete
fogpy.filters: INFO: 3269 Tasks Remaining --- 13.81 % Complete
fogpy.filters: INFO: 3260 Tasks Remaining --- 14.05 % Complete
fogpy.filters: INFO: 3245 Tasks Remaining --- 14.45 % Complete
fogpy.filters: INFO: 3234 Tasks Remaining --- 14.74 % Complete
fogpy.filters: INFO: 3225 Tasks Remaining --- 14.97 % Complete
fogpy.filters: INFO: 3216 Tasks Remaining --- 15.21 % Complete
fogpy.filters: INFO: 3205 Tasks Remaining --- 15.50 % Complete
fogpy.filters: INFO: 3193 Tasks Remaining --- 15.82 % Complete
fogpy.filters: INFO: 3177 Tasks Remaining --- 16.24 % Complete
fogpy.filters: INFO: 3167 Tasks Remaining --- 16.50 % Complete
fogpy.filters: INFO: 3158 Tasks Remaining --- 16.74 % Complete
fogpy.filters: INFO: 3147 Tasks Remaining --- 17.03 % Complete
fogpy.filters: INFO: 3132 Tasks Remaining --- 17.43 % Complete
fogpy.filters: INFO: 3116 Tasks Remaining --- 17.85 % Complete
fogpy.filters: INFO: 3107 Tasks Remaining --- 18.09 % Complete
fogpy.filters: INFO: 3097 Tasks Remaining --- 18.35 % Complete
fogpy.filters: INFO: 3086 Tasks Remaining --- 18.64 % Complete
fogpy.filters: INFO: 3074 Tasks Remaining --- 18.96 % Complete
fogpy.filters: INFO: 3056 Tasks Remaining --- 19.43 % Complete
fogpy.filters: INFO: 3046 Tasks Remaining --- 19.69 % Complete
fogpy.filters: INFO: 3036 Tasks Remaining --- 19.96 % Complete
fogpy.filters: INFO: 3024 Tasks Remaining --- 20.27 % Complete
fogpy.filters: INFO: 3012 Tasks Remaining --- 20.59 % Complete
fogpy.filters: INFO: 2995 Tasks Remaining --- 21.04 % Complete
fogpy.filters: INFO: 2986 Tasks Remaining --- 21.28 % Complete
fogpy.filters: INFO: 2977 Tasks Remaining --- 21.51 % Complete
fogpy.filters: INFO: 2964 Tasks Remaining --- 21.86 % Complete
fogpy.filters: INFO: 2952 Tasks Remaining --- 22.17 % Complete
fogpy.filters: INFO: 2937 Tasks Remaining --- 22.57 % Complete
fogpy.filters: INFO: 2924 Tasks Remaining --- 22.91 % Complete
fogpy.filters: INFO: 2915 Tasks Remaining --- 23.15 % Complete
fogpy.filters: INFO: 2905 Tasks Remaining --- 23.41 % Complete
fogpy.filters: INFO: 2894 Tasks Remaining --- 23.70 % Complete
fogpy.filters: INFO: 2880 Tasks Remaining --- 24.07 % Complete
fogpy.filters: INFO: 2860 Tasks Remaining --- 24.60 % Complete
fogpy.filters: INFO: 2851 Tasks Remaining --- 24.84 % Complete
fogpy.filters: INFO: 2841 Tasks Remaining --- 25.10 % Complete
fogpy.filters: INFO: 2829 Tasks Remaining --- 25.42 % Complete
fogpy.filters: INFO: 2815 Tasks Remaining --- 25.78 % Complete
fogpy.filters: INFO: 2804 Tasks Remaining --- 26.07 % Complete
fogpy.filters: INFO: 2787 Tasks Remaining --- 26.52 % Complete
fogpy.filters: INFO: 2775 Tasks Remaining --- 26.84 % Complete
fogpy.filters: INFO: 2764 Tasks Remaining --- 27.13 % Complete
fogpy.filters: INFO: 2752 Tasks Remaining --- 27.45 % Complete
fogpy.filters: INFO: 2738 Tasks Remaining --- 27.81 % Complete
fogpy.filters: INFO: 2726 Tasks Remaining --- 28.13 % Complete
fogpy.filters: INFO: 2710 Tasks Remaining --- 28.55 % Complete
fogpy.filters: INFO: 2696 Tasks Remaining --- 28.92 % Complete
fogpy.filters: INFO: 2687 Tasks Remaining --- 29.16 % Complete
fogpy.filters: INFO: 2676 Tasks Remaining --- 29.45 % Complete
fogpy.filters: INFO: 2666 Tasks Remaining --- 29.71 % Complete
fogpy.filters: INFO: 2654 Tasks Remaining --- 30.03 % Complete
fogpy.filters: INFO: 2642 Tasks Remaining --- 30.35 % Complete
fogpy.filters: INFO: 2629 Tasks Remaining --- 30.69 % Complete
fogpy.filters: INFO: 2615 Tasks Remaining --- 31.06 % Complete
fogpy.filters: INFO: 2603 Tasks Remaining --- 31.37 % Complete
fogpy.filters: INFO: 2593 Tasks Remaining --- 31.64 % Complete
fogpy.filters: INFO: 2585 Tasks Remaining --- 31.85 % Complete
fogpy.filters: INFO: 2575 Tasks Remaining --- 32.11 % Complete
fogpy.filters: INFO: 2561 Tasks Remaining --- 32.48 % Complete
fogpy.filters: INFO: 2546 Tasks Remaining --- 32.88 % Complete
fogpy.filters: INFO: 2532 Tasks Remaining --- 33.25 % Complete
fogpy.filters: INFO: 2520 Tasks Remaining --- 33.56 % Complete
fogpy.filters: INFO: 2506 Tasks Remaining --- 33.93 % Complete
fogpy.filters: INFO: 2495 Tasks Remaining --- 34.22 % Complete
fogpy.filters: INFO: 2485 Tasks Remaining --- 34.48 % Complete
fogpy.filters: INFO: 2474 Tasks Remaining --- 34.77 % Complete
fogpy.filters: INFO: 2462 Tasks Remaining --- 35.09 % Complete
fogpy.filters: INFO: 2450 Tasks Remaining --- 35.41 % Complete
fogpy.filters: INFO: 2438 Tasks Remaining --- 35.72 % Complete
fogpy.filters: INFO: 2425 Tasks Remaining --- 36.07 % Complete
fogpy.filters: INFO: 2412 Tasks Remaining --- 36.41 % Complete
fogpy.filters: INFO: 2397 Tasks Remaining --- 36.80 % Complete
fogpy.filters: INFO: 2387 Tasks Remaining --- 37.07 % Complete
fogpy.filters: INFO: 2377 Tasks Remaining --- 37.33 % Complete
fogpy.filters: INFO: 2363 Tasks Remaining --- 37.70 % Complete
fogpy.filters: INFO: 2353 Tasks Remaining --- 37.96 % Complete
fogpy.filters: INFO: 2340 Tasks Remaining --- 38.31 % Complete
fogpy.filters: INFO: 2327 Tasks Remaining --- 38.65 % Complete
fogpy.filters: INFO: 2313 Tasks Remaining --- 39.02 % Complete
fogpy.filters: INFO: 2300 Tasks Remaining --- 39.36 % Complete
fogpy.filters: INFO: 2291 Tasks Remaining --- 39.60 % Complete
fogpy.filters: INFO: 2280 Tasks Remaining --- 39.89 % Complete
fogpy.filters: INFO: 2267 Tasks Remaining --- 40.23 % Complete
fogpy.filters: INFO: 2255 Tasks Remaining --- 40.55 % Complete
fogpy.filters: INFO: 2243 Tasks Remaining --- 40.86 % Complete
fogpy.filters: INFO: 2232 Tasks Remaining --- 41.15 % Complete
fogpy.filters: INFO: 2219 Tasks Remaining --- 41.50 % Complete
fogpy.filters: INFO: 2209 Tasks Remaining --- 41.76 % Complete
fogpy.filters: INFO: 2193 Tasks Remaining --- 42.18 % Complete
fogpy.filters: INFO: 2180 Tasks Remaining --- 42.53 % Complete
fogpy.filters: INFO: 2169 Tasks Remaining --- 42.82 % Complete
fogpy.filters: INFO: 2157 Tasks Remaining --- 43.13 % Complete
fogpy.filters: INFO: 2144 Tasks Remaining --- 43.47 % Complete
fogpy.filters: INFO: 2133 Tasks Remaining --- 43.76 % Complete
fogpy.filters: INFO: 2122 Tasks Remaining --- 44.05 % Complete
fogpy.filters: INFO: 2108 Tasks Remaining --- 44.42 % Complete
fogpy.filters: INFO: 2098 Tasks Remaining --- 44.69 % Complete
fogpy.filters: INFO: 2085 Tasks Remaining --- 45.03 % Complete
fogpy.filters: INFO: 2070 Tasks Remaining --- 45.43 % Complete
fogpy.filters: INFO: 2059 Tasks Remaining --- 45.72 % Complete
fogpy.filters: INFO: 2046 Tasks Remaining --- 46.06 % Complete
fogpy.filters: INFO: 2033 Tasks Remaining --- 46.40 % Complete
fogpy.filters: INFO: 2022 Tasks Remaining --- 46.69 % Complete
fogpy.filters: INFO: 2014 Tasks Remaining --- 46.90 % Complete
fogpy.filters: INFO: 1999 Tasks Remaining --- 47.30 % Complete
fogpy.filters: INFO: 1983 Tasks Remaining --- 47.72 % Complete
fogpy.filters: INFO: 1970 Tasks Remaining --- 48.06 % Complete
fogpy.filters: INFO: 1957 Tasks Remaining --- 48.40 % Complete
fogpy.filters: INFO: 1945 Tasks Remaining --- 48.72 % Complete
fogpy.filters: INFO: 1935 Tasks Remaining --- 48.98 % Complete
fogpy.filters: INFO: 1921 Tasks Remaining --- 49.35 % Complete
fogpy.filters: INFO: 1907 Tasks Remaining --- 49.72 % Complete
fogpy.filters: INFO: 1892 Tasks Remaining --- 50.12 % Complete
fogpy.filters: INFO: 1882 Tasks Remaining --- 50.38 % Complete
fogpy.filters: INFO: 1869 Tasks Remaining --- 50.73 % Complete
fogpy.filters: INFO: 1858 Tasks Remaining --- 51.02 % Complete
fogpy.filters: INFO: 1845 Tasks Remaining --- 51.36 % Complete
fogpy.filters: INFO: 1831 Tasks Remaining --- 51.73 % Complete
fogpy.filters: INFO: 1821 Tasks Remaining --- 51.99 % Complete
fogpy.filters: INFO: 1807 Tasks Remaining --- 52.36 % Complete
fogpy.filters: INFO: 1797 Tasks Remaining --- 52.62 % Complete
fogpy.filters: INFO: 1784 Tasks Remaining --- 52.97 % Complete
fogpy.filters: INFO: 1773 Tasks Remaining --- 53.26 % Complete
fogpy.filters: INFO: 1761 Tasks Remaining --- 53.57 % Complete
fogpy.filters: INFO: 1745 Tasks Remaining --- 53.99 % Complete
fogpy.filters: INFO: 1733 Tasks Remaining --- 54.31 % Complete
fogpy.filters: INFO: 1721 Tasks Remaining --- 54.63 % Complete
fogpy.filters: INFO: 1712 Tasks Remaining --- 54.86 % Complete
fogpy.filters: INFO: 1699 Tasks Remaining --- 55.21 % Complete
fogpy.filters: INFO: 1688 Tasks Remaining --- 55.50 % Complete
fogpy.filters: INFO: 1677 Tasks Remaining --- 55.79 % Complete
fogpy.filters: INFO: 1665 Tasks Remaining --- 56.10 % Complete
fogpy.filters: INFO: 1654 Tasks Remaining --- 56.39 % Complete
fogpy.filters: INFO: 1636 Tasks Remaining --- 56.87 % Complete
fogpy.filters: INFO: 1620 Tasks Remaining --- 57.29 % Complete
fogpy.filters: INFO: 1611 Tasks Remaining --- 57.53 % Complete
fogpy.filters: INFO: 1597 Tasks Remaining --- 57.90 % Complete
fogpy.filters: INFO: 1585 Tasks Remaining --- 58.21 % Complete
fogpy.filters: INFO: 1572 Tasks Remaining --- 58.56 % Complete
fogpy.filters: INFO: 1561 Tasks Remaining --- 58.85 % Complete
fogpy.filters: INFO: 1548 Tasks Remaining --- 59.19 % Complete
fogpy.filters: INFO: 1536 Tasks Remaining --- 59.50 % Complete
fogpy.filters: INFO: 1522 Tasks Remaining --- 59.87 % Complete
fogpy.filters: INFO: 1506 Tasks Remaining --- 60.30 % Complete
fogpy.filters: INFO: 1491 Tasks Remaining --- 60.69 % Complete
fogpy.filters: INFO: 1479 Tasks Remaining --- 61.01 % Complete
fogpy.filters: INFO: 1467 Tasks Remaining --- 61.32 % Complete
fogpy.filters: INFO: 1455 Tasks Remaining --- 61.64 % Complete
fogpy.filters: INFO: 1445 Tasks Remaining --- 61.90 % Complete
fogpy.filters: INFO: 1428 Tasks Remaining --- 62.35 % Complete
fogpy.filters: INFO: 1417 Tasks Remaining --- 62.64 % Complete
fogpy.filters: INFO: 1405 Tasks Remaining --- 62.96 % Complete
fogpy.filters: INFO: 1392 Tasks Remaining --- 63.30 % Complete
fogpy.filters: INFO: 1373 Tasks Remaining --- 63.80 % Complete
fogpy.filters: INFO: 1362 Tasks Remaining --- 64.09 % Complete
fogpy.filters: INFO: 1345 Tasks Remaining --- 64.54 % Complete
fogpy.filters: INFO: 1334 Tasks Remaining --- 64.83 % Complete
fogpy.filters: INFO: 1320 Tasks Remaining --- 65.20 % Complete
fogpy.filters: INFO: 1309 Tasks Remaining --- 65.49 % Complete
fogpy.filters: INFO: 1298 Tasks Remaining --- 65.78 % Complete
fogpy.filters: INFO: 1285 Tasks Remaining --- 66.12 % Complete
fogpy.filters: INFO: 1271 Tasks Remaining --- 66.49 % Complete
fogpy.filters: INFO: 1259 Tasks Remaining --- 66.81 % Complete
fogpy.filters: INFO: 1243 Tasks Remaining --- 67.23 % Complete
fogpy.filters: INFO: 1233 Tasks Remaining --- 67.49 % Complete
fogpy.filters: INFO: 1217 Tasks Remaining --- 67.91 % Complete
fogpy.filters: INFO: 1204 Tasks Remaining --- 68.26 % Complete
fogpy.filters: INFO: 1191 Tasks Remaining --- 68.60 % Complete
fogpy.filters: INFO: 1178 Tasks Remaining --- 68.94 % Complete
fogpy.filters: INFO: 1166 Tasks Remaining --- 69.26 % Complete
fogpy.filters: INFO: 1156 Tasks Remaining --- 69.52 % Complete
fogpy.filters: INFO: 1144 Tasks Remaining --- 69.84 % Complete
fogpy.filters: INFO: 1128 Tasks Remaining --- 70.26 % Complete
fogpy.filters: INFO: 1117 Tasks Remaining --- 70.55 % Complete
fogpy.filters: INFO: 1104 Tasks Remaining --- 70.89 % Complete
fogpy.filters: INFO: 1085 Tasks Remaining --- 71.39 % Complete
fogpy.filters: INFO: 1075 Tasks Remaining --- 71.66 % Complete
fogpy.filters: INFO: 1064 Tasks Remaining --- 71.95 % Complete
fogpy.filters: INFO: 1050 Tasks Remaining --- 72.32 % Complete
fogpy.filters: INFO: 1038 Tasks Remaining --- 72.63 % Complete
fogpy.filters: INFO: 1026 Tasks Remaining --- 72.95 % Complete
fogpy.filters: INFO: 1011 Tasks Remaining --- 73.35 % Complete
fogpy.filters: INFO: 1001 Tasks Remaining --- 73.61 % Complete
fogpy.filters: INFO: 986 Tasks Remaining --- 74.00 % Complete
fogpy.filters: INFO: 972 Tasks Remaining --- 74.37 % Complete
fogpy.filters: INFO: 960 Tasks Remaining --- 74.69 % Complete
fogpy.filters: INFO: 949 Tasks Remaining --- 74.98 % Complete
fogpy.filters: INFO: 936 Tasks Remaining --- 75.32 % Complete
fogpy.filters: INFO: 924 Tasks Remaining --- 75.64 % Complete
fogpy.filters: INFO: 908 Tasks Remaining --- 76.06 % Complete
fogpy.filters: INFO: 898 Tasks Remaining --- 76.32 % Complete
fogpy.filters: INFO: 878 Tasks Remaining --- 76.85 % Complete
fogpy.filters: INFO: 867 Tasks Remaining --- 77.14 % Complete
fogpy.filters: INFO: 857 Tasks Remaining --- 77.41 % Complete
fogpy.filters: INFO: 843 Tasks Remaining --- 77.77 % Complete
fogpy.filters: INFO: 831 Tasks Remaining --- 78.09 % Complete
fogpy.filters: INFO: 821 Tasks Remaining --- 78.35 % Complete
fogpy.filters: INFO: 807 Tasks Remaining --- 78.72 % Complete
fogpy.filters: INFO: 790 Tasks Remaining --- 79.17 % Complete
fogpy.filters: INFO: 780 Tasks Remaining --- 79.44 % Complete
fogpy.filters: INFO: 768 Tasks Remaining --- 79.75 % Complete
fogpy.filters: INFO: 756 Tasks Remaining --- 80.07 % Complete
fogpy.filters: INFO: 742 Tasks Remaining --- 80.44 % Complete
fogpy.filters: INFO: 731 Tasks Remaining --- 80.73 % Complete
fogpy.filters: INFO: 718 Tasks Remaining --- 81.07 % Complete
fogpy.filters: INFO: 702 Tasks Remaining --- 81.49 % Complete
fogpy.filters: INFO: 692 Tasks Remaining --- 81.76 % Complete
fogpy.filters: INFO: 681 Tasks Remaining --- 82.05 % Complete
fogpy.filters: INFO: 667 Tasks Remaining --- 82.41 % Complete
fogpy.filters: INFO: 659 Tasks Remaining --- 82.63 % Complete
fogpy.filters: INFO: 645 Tasks Remaining --- 82.99 % Complete
fogpy.filters: INFO: 629 Tasks Remaining --- 83.42 % Complete
fogpy.filters: INFO: 618 Tasks Remaining --- 83.71 % Complete
fogpy.filters: INFO: 607 Tasks Remaining --- 84.00 % Complete
fogpy.filters: INFO: 597 Tasks Remaining --- 84.26 % Complete
fogpy.filters: INFO: 586 Tasks Remaining --- 84.55 % Complete
fogpy.filters: INFO: 570 Tasks Remaining --- 84.97 % Complete
fogpy.filters: INFO: 550 Tasks Remaining --- 85.50 % Complete
fogpy.filters: INFO: 537 Tasks Remaining --- 85.84 % Complete
fogpy.filters: INFO: 525 Tasks Remaining --- 86.16 % Complete
fogpy.filters: INFO: 512 Tasks Remaining --- 86.50 % Complete
fogpy.filters: INFO: 498 Tasks Remaining --- 86.87 % Complete
fogpy.filters: INFO: 478 Tasks Remaining --- 87.40 % Complete
fogpy.filters: INFO: 466 Tasks Remaining --- 87.71 % Complete
fogpy.filters: INFO: 456 Tasks Remaining --- 87.98 % Complete
fogpy.filters: INFO: 442 Tasks Remaining --- 88.35 % Complete
fogpy.filters: INFO: 410 Tasks Remaining --- 89.19 % Complete
fogpy.filters: INFO: 401 Tasks Remaining --- 89.43 % Complete
fogpy.filters: INFO: 391 Tasks Remaining --- 89.69 % Complete
fogpy.filters: INFO: 377 Tasks Remaining --- 90.06 % Complete
fogpy.filters: INFO: 350 Tasks Remaining --- 90.77 % Complete
fogpy.filters: INFO: 327 Tasks Remaining --- 91.38 % Complete
fogpy.filters: INFO: 319 Tasks Remaining --- 91.59 % Complete
fogpy.filters: INFO: 308 Tasks Remaining --- 91.88 % Complete
fogpy.filters: INFO: 291 Tasks Remaining --- 92.33 % Complete
fogpy.filters: INFO: 270 Tasks Remaining --- 92.88 % Complete
fogpy.filters: INFO: 255 Tasks Remaining --- 93.28 % Complete
fogpy.filters: INFO: 246 Tasks Remaining --- 93.51 % Complete
fogpy.filters: INFO: 214 Tasks Remaining --- 94.36 % Complete
fogpy.filters: INFO: 202 Tasks Remaining --- 94.67 % Complete
fogpy.filters: INFO: 193 Tasks Remaining --- 94.91 % Complete
fogpy.filters: INFO: 180 Tasks Remaining --- 95.25 % Complete
fogpy.filters: INFO: 159 Tasks Remaining --- 95.81 % Complete
fogpy.filters: INFO: 131 Tasks Remaining --- 96.55 % Complete
fogpy.filters: INFO: 119 Tasks Remaining --- 96.86 % Complete
fogpy.filters: INFO: 106 Tasks Remaining --- 97.21 % Complete
fogpy.filters: INFO: 96 Tasks Remaining --- 97.47 % Complete
fogpy.filters: INFO: 80 Tasks Remaining --- 97.89 % Complete
fogpy.filters: INFO: 50 Tasks Remaining --- 98.68 % Complete
fogpy.filters: INFO: 33 Tasks Remaining --- 99.13 % Complete
fogpy.filters: INFO: 21 Tasks Remaining --- 99.45 % Complete
fogpy.filters: INFO: 13 Tasks Remaining --- 99.66 % Complete
fogpy.filters: INFO: 1 Tasks Remaining --- 99.97 % Complete
fogpy.filters: INFO: All Done. Completed 3793 tasks
fogpy.filters: INFO: Finished low cloud models for 3793 cells
fogpy.filters: INFO: Filter results for LowCloudFilter
Filtering low clouds for satellite images.
Array size: 42018
Masking: 41830
Previous masked: 38225
New filtered: 3605
Remaining: 188
trollimage.image: DEBUG: Applying stretch crude with parameters {}
trollimage.image: DEBUG: Applying invert with parameters True
trollimage.image: DEBUG: Applying stretch crude with parameters {}
trollimage.image: DEBUG: Applying invert with parameters True
fogpy.filters: INFO: LowCloudFilter results are plotted to: /tmp/FLS/LowCloudFilter_201311120830.png
trollimage.image: DEBUG: Applying stretch crude with parameters {}
trollimage.image: WARNING: Nothing to stretch !
trollimage.image: DEBUG: Applying invert with parameters True
fogpy.filters: INFO: Plotting filter attribute cbh to /tmp/FLS/LowCloudFilter_cbh_201311120830.png
trollimage.image: DEBUG: Applying stretch crude with parameters {}
trollimage.image: DEBUG: Applying invert with parameters True
fogpy.filters: INFO: Plotting filter attribute fbh to /tmp/FLS/LowCloudFilter_fbh_201311120830.png
trollimage.image: DEBUG: Applying stretch crude with parameters {}
trollimage.image: DEBUG: Applying invert with parameters True
fogpy.algorithms: INFO: Finish fog and low cloud detection algorithm
trollimage.image: DEBUG: Applying stretch crude with parameters {}
fogpy.algorithms: INFO: Set color range to (267.44605080253444, 273.76849008650674)
fogpy.algorithms: INFO: DayFogLowStratusAlgorithm results are plotted to: /tmp/FLS
trollimage.image: DEBUG: Applying stretch crude with parameters {}
--------------------- >> end captured logging << ---------------------
======================================================================
ERROR: test_fls_algorithm_other (fogpy.test.test_algorithms.Test_DayFogLowStratusAlgorithm)
----------------------------------------------------------------------
Traceback (most recent call last):
File "/home/gholl/checkouts/fogpy/fogpy/test/test_algorithms.py", line 232, in test_fls_algorithm_other
stationfile2, bgimg=self.input2['ir108'])
File "/home/gholl/checkouts/fogpy/fogpy/utils/add_synop.py", line 124, in add_to_image
currentstations = stations[time.strftime("%Y%m%d%H0000")]
KeyError: '20140827070000'
-------------------- >> begin captured logging << --------------------
fogpy.algorithms: INFO: Starting fog and low cloud detection algorithm in daytime mode
fogpy.filters: INFO: Applying Cloud Filter
fogpy.filters: DEBUG: Histogram range for cloudy/clear sky pixels: -6.48294205488 - 2.5771321229
fogpy.filters: DEBUG: Cloud mask difference threshold set to -1.95290496599
fogpy.filters: INFO: Filter results for CloudFilter
Cloud filtering for satellite images.
Array size: 42018
Masking: 16336
Previous masked: 0
New filtered: 16336
Remaining: 25682
trollimage.image: DEBUG: Applying stretch crude with parameters {}
trollimage.image: DEBUG: Applying invert with parameters True
trollimage.image: DEBUG: Applying stretch crude with parameters {}
trollimage.image: DEBUG: Applying invert with parameters True
fogpy.filters: INFO: CloudFilter results are plotted to: /tmp/FLS/CloudFilter_201408270715.png
trollimage.image: DEBUG: Applying stretch crude with parameters {}
trollimage.image: WARNING: Nothing to stretch !
trollimage.image: DEBUG: Applying invert with parameters True
fogpy.filters: INFO: Applying Snow Filter
fogpy.filters: INFO: Filter results for SnowFilter
Snow filtering for satellite images.
Array size: 42018
Masking: 183
Previous masked: 16336
New filtered: 144
Remaining: 25538
trollimage.image: DEBUG: Applying stretch crude with parameters {}
trollimage.image: DEBUG: Applying invert with parameters True
trollimage.image: DEBUG: Applying stretch crude with parameters {}
trollimage.image: DEBUG: Applying invert with parameters True
fogpy.filters: INFO: SnowFilter results are plotted to: /tmp/FLS/SnowFilter_201408270715.png
trollimage.image: DEBUG: Applying stretch crude with parameters {}
trollimage.image: WARNING: Nothing to stretch !
trollimage.image: DEBUG: Applying invert with parameters True
fogpy.filters: INFO: Applying Snow Filter
fogpy.filters: INFO: Filter results for IceCloudFilter
Ice cloud filtering for satellite images.
Array size: 42018
Masking: 35413
Previous masked: 16480
New filtered: 19524
Remaining: 6014
trollimage.image: DEBUG: Applying stretch crude with parameters {}
trollimage.image: DEBUG: Applying invert with parameters True
trollimage.image: DEBUG: Applying stretch crude with parameters {}
trollimage.image: DEBUG: Applying invert with parameters True
fogpy.filters: INFO: IceCloudFilter results are plotted to: /tmp/FLS/IceCloudFilter_201408270715.png
trollimage.image: DEBUG: Applying stretch crude with parameters {}
trollimage.image: WARNING: Nothing to stretch !
trollimage.image: DEBUG: Applying invert with parameters True
fogpy.filters: INFO: Applying Cirrus Filter
fogpy.filters: DEBUG: Found solar zenith angles from 59.83404307196856 to 69.19908223088952°
fogpy.filters: DEBUG: Set BT difference thresholds for cirrus: 1.1 to 4.73 K
fogpy.filters: INFO: Filter results for CirrusCloudFilter
Thin cirrus cloud filtering for satellite images.
Array size: 42018
Masking: 6617
Previous masked: 36004
New filtered: 15
Remaining: 5999
trollimage.image: DEBUG: Applying stretch crude with parameters {}
trollimage.image: DEBUG: Applying invert with parameters True
trollimage.image: DEBUG: Applying stretch crude with parameters {}
trollimage.image: DEBUG: Applying invert with parameters True
fogpy.filters: INFO: CirrusCloudFilter results are plotted to: /tmp/FLS/CirrusCloudFilter_201408270715.png
trollimage.image: DEBUG: Applying stretch crude with parameters {}
trollimage.image: WARNING: Nothing to stretch !
trollimage.image: DEBUG: Applying invert with parameters True
fogpy.filters: INFO: Applying Water Cloud Filter
fogpy.filters: DEBUG: Mean latitudinal threshold for cloudfree areas: 280.81 K
fogpy.filters: INFO: Filter results for WaterCloudFilter
Water cloud filtering for satellite images.
Array size: 42018
Masking: 21489
Previous masked: 36019
New filtered: 765
Remaining: 5234
trollimage.image: DEBUG: Applying stretch crude with parameters {}
trollimage.image: DEBUG: Applying invert with parameters True
trollimage.image: DEBUG: Applying stretch crude with parameters {}
trollimage.image: DEBUG: Applying invert with parameters True
fogpy.filters: INFO: WaterCloudFilter results are plotted to: /tmp/FLS/WaterCloudFilter_201408270715.png
trollimage.image: DEBUG: Applying stretch crude with parameters {}
trollimage.image: WARNING: Nothing to stretch !
trollimage.image: DEBUG: Applying invert with parameters True
fogpy.algorithms: INFO: Clustering low clouds
fogpy.algorithms: DEBUG: Number of spatial coherent fog cloud clusters: 318
trollimage.image: DEBUG: Applying stretch crude with parameters {}
fogpy.algorithms: INFO: DayFogLowStratusAlgorithm results are plotted to: /tmp/FLS
fogpy.filters: INFO: Applying Spatial Cloud Top Height Filter
fogpy.filters: INFO: Filter results for SpatialCloudTopHeightFilter
Filtering cloud clusters by height for satellite images.
Array size: 42018
Masking: 20746
Previous masked: 36784
New filtered: 2526
Remaining: 2708
trollimage.image: DEBUG: Applying stretch crude with parameters {}
trollimage.image: DEBUG: Applying invert with parameters True
trollimage.image: DEBUG: Applying stretch crude with parameters {}
trollimage.image: DEBUG: Applying invert with parameters True
fogpy.filters: INFO: SpatialCloudTopHeightFilter results are plotted to: /tmp/FLS/SpatialCloudTopHeightFilter_201408270715.png
trollimage.image: DEBUG: Applying stretch crude with parameters {}
trollimage.image: WARNING: Nothing to stretch !
trollimage.image: DEBUG: Applying invert with parameters True
fogpy.algorithms: INFO: Clustering low clouds
fogpy.algorithms: DEBUG: Number of spatial coherent fog cloud clusters: 142
fogpy.filters: INFO: Applying Spatial Clustering Inhomogeneity Filter
fogpy.filters: INFO: Filter results for SpatialHomogeneityFilter
Filtering cloud clusters by StDev for satellite images.
Array size: 42018
Masking: 39310
Previous masked: 39310
New filtered: 0
Remaining: 2708
trollimage.image: DEBUG: Applying stretch crude with parameters {}
trollimage.image: DEBUG: Applying invert with parameters True
trollimage.image: DEBUG: Applying stretch crude with parameters {}
trollimage.image: DEBUG: Applying invert with parameters True
fogpy.filters: INFO: SpatialHomogeneityFilter results are plotted to: /tmp/FLS/SpatialHomogeneityFilter_201408270715.png
trollimage.image: DEBUG: Applying stretch crude with parameters {}
trollimage.image: WARNING: Nothing to stretch !
trollimage.image: DEBUG: Applying invert with parameters True
fogpy.filters: INFO: Applying Spatial Clustering Inhomogenity Filter
fogpy.filters: INFO: Filter results for CloudPhysicsFilter
Filtering cloud microphysics for satellite images.
Array size: 42018
Masking: 11139
Previous masked: 39310
New filtered: 43
Remaining: 2665
trollimage.image: DEBUG: Applying stretch crude with parameters {}
trollimage.image: DEBUG: Applying invert with parameters True
trollimage.image: DEBUG: Applying stretch crude with parameters {}
trollimage.image: DEBUG: Applying invert with parameters True
fogpy.filters: INFO: CloudPhysicsFilter results are plotted to: /tmp/FLS/CloudPhysicsFilter_201408270715.png
trollimage.image: DEBUG: Applying stretch crude with parameters {}
trollimage.image: WARNING: Nothing to stretch !
trollimage.image: DEBUG: Applying invert with parameters True
fogpy.algorithms: INFO: Clustering low clouds
fogpy.algorithms: DEBUG: Number of spatial coherent fog cloud clusters: 148
fogpy.filters: INFO: Applying Low Cloud Filter
fogpy.filters: INFO: Run low cloud models for cloud clusters
fogpy.filters: INFO: 148 Tasks Remaining --- 0.00 % Complete
fogpy.filters: INFO: 146 Tasks Remaining --- 1.35 % Complete
fogpy.filters: INFO: 141 Tasks Remaining --- 4.73 % Complete
fogpy.filters: INFO: 139 Tasks Remaining --- 6.08 % Complete
fogpy.filters: INFO: 133 Tasks Remaining --- 10.14 % Complete
fogpy.filters: INFO: 121 Tasks Remaining --- 18.24 % Complete
fogpy.filters: INFO: 116 Tasks Remaining --- 21.62 % Complete
fogpy.filters: INFO: 112 Tasks Remaining --- 24.32 % Complete
fogpy.filters: INFO: 104 Tasks Remaining --- 29.73 % Complete
fogpy.filters: INFO: 101 Tasks Remaining --- 31.76 % Complete
fogpy.filters: INFO: 96 Tasks Remaining --- 35.14 % Complete
fogpy.filters: INFO: 89 Tasks Remaining --- 39.86 % Complete
fogpy.filters: INFO: 83 Tasks Remaining --- 43.92 % Complete
fogpy.filters: INFO: 79 Tasks Remaining --- 46.62 % Complete
fogpy.filters: INFO: 75 Tasks Remaining --- 49.32 % Complete
fogpy.filters: INFO: 71 Tasks Remaining --- 52.03 % Complete
fogpy.filters: INFO: 68 Tasks Remaining --- 54.05 % Complete
fogpy.filters: INFO: 66 Tasks Remaining --- 55.41 % Complete
fogpy.filters: INFO: 60 Tasks Remaining --- 59.46 % Complete
fogpy.filters: INFO: 59 Tasks Remaining --- 60.14 % Complete
fogpy.filters: INFO: 58 Tasks Remaining --- 60.81 % Complete
fogpy.filters: INFO: 55 Tasks Remaining --- 62.84 % Complete
fogpy.filters: INFO: 51 Tasks Remaining --- 65.54 % Complete
fogpy.filters: INFO: 50 Tasks Remaining --- 66.22 % Complete
fogpy.filters: INFO: 49 Tasks Remaining --- 66.89 % Complete
fogpy.filters: INFO: 46 Tasks Remaining --- 68.92 % Complete
fogpy.filters: INFO: 42 Tasks Remaining --- 71.62 % Complete
fogpy.filters: INFO: 41 Tasks Remaining --- 72.30 % Complete
fogpy.filters: INFO: 37 Tasks Remaining --- 75.00 % Complete
fogpy.filters: INFO: 35 Tasks Remaining --- 76.35 % Complete
fogpy.filters: INFO: 32 Tasks Remaining --- 78.38 % Complete
fogpy.filters: INFO: 30 Tasks Remaining --- 79.73 % Complete
fogpy.filters: INFO: 27 Tasks Remaining --- 81.76 % Complete
fogpy.filters: INFO: 24 Tasks Remaining --- 83.78 % Complete
fogpy.filters: INFO: 20 Tasks Remaining --- 86.49 % Complete
fogpy.filters: INFO: 17 Tasks Remaining --- 88.51 % Complete
fogpy.filters: INFO: 12 Tasks Remaining --- 91.89 % Complete
fogpy.filters: INFO: 10 Tasks Remaining --- 93.24 % Complete
fogpy.filters: INFO: 9 Tasks Remaining --- 93.92 % Complete
fogpy.filters: INFO: 6 Tasks Remaining --- 95.95 % Complete
fogpy.filters: INFO: 3 Tasks Remaining --- 97.97 % Complete
fogpy.filters: INFO: All Done. Completed 148 tasks
fogpy.filters: INFO: Filter results for LowCloudFilter
Filtering low clouds for satellite images.
Array size: 42018
Masking: 41778
Previous masked: 39353
New filtered: 2425
Remaining: 240
trollimage.image: DEBUG: Applying stretch crude with parameters {}
trollimage.image: DEBUG: Applying invert with parameters True
trollimage.image: DEBUG: Applying stretch crude with parameters {}
trollimage.image: DEBUG: Applying invert with parameters True
fogpy.filters: INFO: LowCloudFilter results are plotted to: /tmp/FLS/LowCloudFilter_201408270715.png
trollimage.image: DEBUG: Applying stretch crude with parameters {}
trollimage.image: WARNING: Nothing to stretch !
trollimage.image: DEBUG: Applying invert with parameters True
fogpy.filters: INFO: Plotting filter attribute cbh to /tmp/FLS/LowCloudFilter_cbh_201408270715.png
trollimage.image: DEBUG: Applying stretch crude with parameters {}
trollimage.image: DEBUG: Applying invert with parameters True
fogpy.filters: INFO: Plotting filter attribute fbh to /tmp/FLS/LowCloudFilter_fbh_201408270715.png
trollimage.image: DEBUG: Applying stretch crude with parameters {}
trollimage.image: DEBUG: Applying invert with parameters True
fogpy.algorithms: INFO: Finish fog and low cloud detection algorithm
trollimage.image: DEBUG: Applying stretch crude with parameters {}
fogpy.algorithms: INFO: Set color range to (273.9249643716746, 284.14751440203855)
fogpy.algorithms: INFO: DayFogLowStratusAlgorithm results are plotted to: /tmp/FLS
trollimage.image: DEBUG: Applying stretch crude with parameters {}
--------------------- >> end captured logging << ---------------------
======================================================================
ERROR: test_nightfls_algorithm (fogpy.test.test_algorithms.Test_NightFogLowStratusAlgorithm)
----------------------------------------------------------------------
Traceback (most recent call last):
File "/home/gholl/checkouts/fogpy/fogpy/test/test_algorithms.py", line 622, in setUp
line2=self.tle.line2)
File "/media/nas/x21324/miniconda3/envs/py27b/lib/python2.7/site-packages/pyorbital/orbital.py", line 167, in __init__
self._sgdp4 = _SGDP4(self.orbit_elements)
File "/media/nas/x21324/miniconda3/envs/py27b/lib/python2.7/site-packages/pyorbital/orbital.py", line 706, in __init__
raise NotImplementedError('Deep space calculations not supported')
NotImplementedError: Deep space calculations not supported
======================================================================
ERROR: test_nightfls_algorithm2 (fogpy.test.test_algorithms.Test_NightFogLowStratusAlgorithm)
----------------------------------------------------------------------
Traceback (most recent call last):
File "/home/gholl/checkouts/fogpy/fogpy/test/test_algorithms.py", line 622, in setUp
line2=self.tle.line2)
File "/media/nas/x21324/miniconda3/envs/py27b/lib/python2.7/site-packages/pyorbital/orbital.py", line 167, in __init__
self._sgdp4 = _SGDP4(self.orbit_elements)
File "/media/nas/x21324/miniconda3/envs/py27b/lib/python2.7/site-packages/pyorbital/orbital.py", line 706, in __init__
raise NotImplementedError('Deep space calculations not supported')
NotImplementedError: Deep space calculations not supported
======================================================================
ERROR: test_nightfls_slope (fogpy.test.test_algorithms.Test_NightFogLowStratusAlgorithm)
----------------------------------------------------------------------
Traceback (most recent call last):
File "/home/gholl/checkouts/fogpy/fogpy/test/test_algorithms.py", line 622, in setUp
line2=self.tle.line2)
File "/media/nas/x21324/miniconda3/envs/py27b/lib/python2.7/site-packages/pyorbital/orbital.py", line 167, in __init__
self._sgdp4 = _SGDP4(self.orbit_elements)
File "/media/nas/x21324/miniconda3/envs/py27b/lib/python2.7/site-packages/pyorbital/orbital.py", line 706, in __init__
raise NotImplementedError('Deep space calculations not supported')
NotImplementedError: Deep space calculations not supported
======================================================================
ERROR: test_nightfls_turningpoints_no_valley (fogpy.test.test_algorithms.Test_NightFogLowStratusAlgorithm)
----------------------------------------------------------------------
Traceback (most recent call last):
File "/home/gholl/checkouts/fogpy/fogpy/test/test_algorithms.py", line 622, in setUp
line2=self.tle.line2)
File "/media/nas/x21324/miniconda3/envs/py27b/lib/python2.7/site-packages/pyorbital/orbital.py", line 167, in __init__
self._sgdp4 = _SGDP4(self.orbit_elements)
File "/media/nas/x21324/miniconda3/envs/py27b/lib/python2.7/site-packages/pyorbital/orbital.py", line 706, in __init__
raise NotImplementedError('Deep space calculations not supported')
NotImplementedError: Deep space calculations not supported
======================================================================
ERROR: test_nightfls_turningpoints_with_thres (fogpy.test.test_algorithms.Test_NightFogLowStratusAlgorithm)
----------------------------------------------------------------------
Traceback (most recent call last):
File "/home/gholl/checkouts/fogpy/fogpy/test/test_algorithms.py", line 622, in setUp
line2=self.tle.line2)
File "/media/nas/x21324/miniconda3/envs/py27b/lib/python2.7/site-packages/pyorbital/orbital.py", line 167, in __init__
self._sgdp4 = _SGDP4(self.orbit_elements)
File "/media/nas/x21324/miniconda3/envs/py27b/lib/python2.7/site-packages/pyorbital/orbital.py", line 706, in __init__
raise NotImplementedError('Deep space calculations not supported')
NotImplementedError: Deep space calculations not supported
======================================================================
ERROR: test_nightfls_turningpoints_with_valley (fogpy.test.test_algorithms.Test_NightFogLowStratusAlgorithm)
----------------------------------------------------------------------
Traceback (most recent call last):
File "/home/gholl/checkouts/fogpy/fogpy/test/test_algorithms.py", line 622, in setUp
line2=self.tle.line2)
File "/media/nas/x21324/miniconda3/envs/py27b/lib/python2.7/site-packages/pyorbital/orbital.py", line 167, in __init__
self._sgdp4 = _SGDP4(self.orbit_elements)
File "/media/nas/x21324/miniconda3/envs/py27b/lib/python2.7/site-packages/pyorbital/orbital.py", line 706, in __init__
raise NotImplementedError('Deep space calculations not supported')
NotImplementedError: Deep space calculations not supported
======================================================================
ERROR: test_cloud_motion_filter (fogpy.test.test_filters.Test_CloudMotionFilter)
----------------------------------------------------------------------
Traceback (most recent call last):
File "/home/gholl/checkouts/fogpy/fogpy/test/test_filters.py", line 689, in test_cloud_motion_filter
ret, mask = testfilter.apply()
File "/home/gholl/checkouts/fogpy/fogpy/filters.py", line 128, in apply
self.filter_function()
File "/home/gholl/checkouts/fogpy/fogpy/filters.py", line 1091, in filter_function
optflow = self.cv2.createOptFlow_DualTVL1()
AttributeError: 'CloudMotionFilter' object has no attribute 'cv2'
-------------------- >> begin captured logging << --------------------
fogpy.filters: DEBUG: Setting filter reference time to current time: 2019-02-21 14:07:11.028607
fogpy.filters: INFO: Applying Cloud Motion Filter
fogpy.filters: INFO: Calculate optical flow...
--------------------- >> end captured logging << ---------------------
======================================================================
ERROR: test_fusion_filter_bufr_import (fogpy.test.test_filters.Test_StationFusionFilter)
----------------------------------------------------------------------
Traceback (most recent call last):
File "/home/gholl/checkouts/fogpy/fogpy/test/test_filters.py", line 727, in test_fusion_filter_bufr_import
ret, mask = testfilter.apply()
File "/home/gholl/checkouts/fogpy/fogpy/filters.py", line 128, in apply
self.filter_function()
File "/home/gholl/checkouts/fogpy/fogpy/filters.py", line 1223, in filter_function
currentstations = stations[self.time.strftime("%Y%m%d%H0000")]
KeyError: '20131112080000'
-------------------- >> begin captured logging << --------------------
fogpy.filters: DEBUG: Setting filter reference time to current time: 2019-02-21 14:08:01.172060
fogpy.filters: INFO: Applying Cloud Filter
fogpy.filters: DEBUG: Histogram range for cloudy/clear sky pixels: -19.7446861967 - 1.11645277953
fogpy.filters: DEBUG: Cloud mask difference threshold set to -3.51935588185
fogpy.filters: INFO: Filter results for CloudFilter
Cloud filtering for satellite images.
Array size: 42018
Masking: 20551
Previous masked: 0
New filtered: 20551
Remaining: 21467
fogpy.filters: INFO: Applying Station Data Fusion Filter
--------------------- >> end captured logging << ---------------------
======================================================================
ERROR: test_fusion_filter_dem_interpolation (fogpy.test.test_filters.Test_StationFusionFilter)
----------------------------------------------------------------------
Traceback (most recent call last):
File "/home/gholl/checkouts/fogpy/fogpy/test/test_filters.py", line 747, in test_fusion_filter_dem_interpolation
ret, mask = testfilter.apply()
File "/home/gholl/checkouts/fogpy/fogpy/filters.py", line 128, in apply
self.filter_function()
File "/home/gholl/checkouts/fogpy/fogpy/filters.py", line 1223, in filter_function
currentstations = stations[self.time.strftime("%Y%m%d%H0000")]
KeyError: '20131112080000'
-------------------- >> begin captured logging << --------------------
fogpy.filters: DEBUG: Setting filter reference time to current time: 2019-02-21 14:08:11.832507
fogpy.filters: INFO: Applying Cloud Filter
fogpy.filters: DEBUG: Histogram range for cloudy/clear sky pixels: -19.7446861967 - 1.11645277953
fogpy.filters: DEBUG: Cloud mask difference threshold set to -3.51935588185
fogpy.filters: INFO: Filter results for CloudFilter
Cloud filtering for satellite images.
Array size: 42018
Masking: 20551
Previous masked: 0
New filtered: 20551
Remaining: 21467
fogpy.filters: INFO: Applying Station Data Fusion Filter
--------------------- >> end captured logging << ---------------------
======================================================================
ERROR: Failure: AreaNotFound ('Area "germ" not found in file "/home/gholl/checkouts/geotools/etc/areas.yaml"')
----------------------------------------------------------------------
Traceback (most recent call last):
File "/media/nas/x21324/miniconda3/envs/py27b/lib/python2.7/site-packages/nose/loader.py", line 418, in loadTestsFromName
addr.filename, addr.module)
File "/media/nas/x21324/miniconda3/envs/py27b/lib/python2.7/site-packages/nose/importer.py", line 47, in importFromPath
return self.importFromDir(dir_path, fqname)
File "/media/nas/x21324/miniconda3/envs/py27b/lib/python2.7/site-packages/nose/importer.py", line 94, in importFromDir
mod = load_module(part_fqname, fh, filename, desc)
File "/home/gholl/checkouts/fogpy/fogpy/test/test_fogpy.py", line 105, in <module>
'germ')
File "/media/nas/x21324/miniconda3/envs/py27b/lib/python2.7/site-packages/pyresample/utils.py", line 63, in load_area
area_list = parse_area_file(area_file_name, *regions)
File "/media/nas/x21324/miniconda3/envs/py27b/lib/python2.7/site-packages/pyresample/utils.py", line 93, in parse_area_file
return _parse_yaml_area_file(area_file_name, *regions)
File "/media/nas/x21324/miniconda3/envs/py27b/lib/python2.7/site-packages/pyresample/utils.py", line 138, in _parse_yaml_area_file
area_name, area_file_name))
AreaNotFound: 'Area "germ" not found in file "/home/gholl/checkouts/geotools/etc/areas.yaml"'
======================================================================
FAIL: test_spatial_homogenity_filter_highsd (fogpy.test.test_filters.Test_SpatialHomogeneityFilter)
----------------------------------------------------------------------
Traceback (most recent call last):
File "/home/gholl/checkouts/fogpy/fogpy/test/test_filters.py", line 489, in test_spatial_homogenity_filter_highsd
self.assertEqual(np.nansum(testfilter.mask), msum)
AssertionError: 98 != 56
-------------------- >> begin captured logging << --------------------
fogpy.algorithms: INFO: Clustering low clouds
fogpy.algorithms: DEBUG: Number of spatial coherent fog cloud clusters: 14
fogpy.algorithms: INFO: Clustering low clouds
fogpy.algorithms: DEBUG: Number of spatial coherent fog cloud clusters: 6
fogpy.algorithms: INFO: Clustering low clouds
fogpy.algorithms: DEBUG: Number of spatial coherent fog cloud clusters: 1
fogpy.filters: DEBUG: Setting filter reference time to current time: 2019-02-21 14:08:01.124284
fogpy.filters: INFO: Applying Spatial Clustering Inhomogeneity Filter
fogpy.filters: INFO: Filter results for SpatialHomogeneityFilter
Filtering cloud clusters by StDev for satellite images.
Array size: 100
Masking: 98
Previous masked: 42
New filtered: 56
Remaining: 2
--------------------- >> end captured logging << ---------------------
----------------------------------------------------------------------
Ran 74 tests in 607.350s
FAILED (errors=12, failures=1)I don't know why it's different, but now I have
Ran 83 tests in 637.427s
FAILED (errors=25, failures=4)I thought all tests now pass, and indeed they do with nosetests:
/opt/pytroll/pytroll_inst/miniconda3/envs/pytroll_py37/lib/python3.7/unittest/case.py:560: RuntimeWarning: TestResult has no addExpectedFailure method, reporting as passes
RuntimeWarning)
..
----------------------------------------------------------------------
Ran 83 tests in 285.185s
OK (SKIP=2)They also pass when run with pytest:
==================================== 80 passed, 2 skipped, 1 xfailed, 34 warnings in 280.63 seconds ====================================However, with python setup.py test there are less tests run, and there is still a test error:
======================================================================
ERROR: test_cloud_motion_filter (fogpy.test.test_filters.Test_CloudMotionFilter)
----------------------------------------------------------------------
Traceback (most recent call last):
File "/home/gholl/checkouts/fogpy/fogpy/test/test_filters.py", line 711, in test_cloud_motion_filter
ret, mask = testfilter.apply()
File "/home/gholl/checkouts/fogpy/fogpy/filters.py", line 133, in apply
self.filter_function()
File "/home/gholl/checkouts/fogpy/fogpy/filters.py", line 1144, in filter_function
optflow = self.cv2.optflow.createOptFlow_DualTVL1()
AttributeError: module 'cv2.cv2' has no attribute 'optflow'
----------------------------------------------------------------------
Ran 75 tests in 228.599s
FAILED (errors=1, skipped=2, expected failures=1)
Test failed: <unittest.runner.TextTestResult run=75 errors=1 failures=0>
error: Test failed: <unittest.runner.TextTestResult run=75 errors=1 failures=0>The same result with coverage run --source=fogpy setup.py test (or more precisely: PYTHONWARNINGS="ignore:Method:RuntimeWarning" BUFR_TABLES="/media/x21308/DWD-bufrtables/tabellen_v3/" coverage run --source=fogpy setup.py test).
After installation of fogpy, I get 12 errors and 1 failure: