pytroll / fogpy Goto Github PK
View Code? Open in Web Editor NEWSatellite based fog and low stratus detection and nowcasting
Home Page: http://fogpy.readthedocs.io/en/latest
License: GNU General Public License v3.0
Satellite based fog and low stratus detection and nowcasting
Home Page: http://fogpy.readthedocs.io/en/latest
License: GNU General Public License v3.0
This is the sandbox area for the pytroll project, an international cooperation on a future distributed real-time processing system for Meteorological Satellite Data. ------------------------------------ December 2010 Lars Ørum Rasmussen, Esben Sigård Nielsen, Kristian Rune Larsen, Martin Raspaud, Anna Geidne, Adam Dybbroe. Danish Meteorological Institute (DMI) Swedish Meteorological and Hydrological Institute (SMHI)
In fogpy.algorithms.LowCloudHeightAlgorithm.procedure
:
When zcenter==0
and (zneigh==0).all()
, this causes zmargin==[0.0, 0.0, 0.0]
, delta_z==0
, which means that apply_lapse_rate
returns nan
. Not sure what to do about it.
This causes the RuntimeWarning: Mean of empty slice
warning referred to in #9.
The former Travis CI is no longer running. Need to set up GitHub CI as a replacement.
It seems that the brute force method is much faster than the basin hopping method:
>>> t1=time.time(); print([self.lwc.optimize_cbh(1000., method='brute') for _ in range(10)]); t2=time.time(); print(t2-t1)
[417.0, 417.0, 417.0, 417.0, 417.0, 417.0, 417.0, 417.0, 417.0, 417.0]
30.48786234855652
>>> t1=time.time(); print([self.lwc.optimize_cbh(1000., method='basin') for _ in range(10)]); t2=time.time(); print(t2-t1)
[417.1936300818184, 417.19363008207864, 417.19363008230766, 417.1936300820221, 417.19363008157075, 417.1936300821362, 417.1936300825845, 417.1936300816707, 417.1936300828528, 417.19363008183757]
111.41780018806458
Here I have omitted the numerous warnings (see #9).
This issue is probably related to #11, and perhaps to #9 too.
Fogpy uses Reff, COT, and LWP from NWCSAF, to what degree are those valid? For ABI I was considering to use NOAA estimates of the three, but for LWP NOAA uses a parametrisation from Bennartz et al. (2007) that is valid for marine boundary clouds and that, according to Cermak et al. (2011), performs very poorly in fog clouds. For my own understanding, I need to understand how exactly fogpy is using LWP and how this compares to what is described by Cermak et al. (2011).
>>> c = LowWaterCloud(2000., 275., 400., 100., 10e-6)
>>> c.init_cloud_layers(100, 50)
>>> c.get_fog_base_height()
125.0
Which is correct according to https://github.com/gerritholl/fogpy/blob/a66ddd5b625066e287399404a231e0272cfdfa28/fogpy/test/test_lowwatercloud.py#L320-L324
But then:
>>> c.optimize_cbh(c.cbh, method="brute")
1056.0
>>> c.get_fog_base_height()
Traceback (most recent call last):
File "<console>", line 1, in <module>
File "/home/gholl/checkouts/fogpy/fogpy/lowwatercloud.py", line 287, in get_fog_base_height
self.fbh = min(fog_z) # Get lowest heights with visibility treshold
ValueError: min() arg is an empty sequence
>>> c.optimize_cbh(c.cbh, method="basin")
1056.016515282201
>>> c.get_fog_base_height()
1061.0165152782138
What's going on here?
Related to #20.
Satpy nowadays uses xarray and dask arrays. Those arrays should be supported by fogpy as well.
Fogpy uses check_areas
but this is deprecated, resulting in this warning:
/opt/pytroll/pytroll_inst/miniconda3-exp/envs/py38/lib/python3.8/site-packages/satpy/composites/__init__.py:355: UserWarning: satpy.composites.CompositeBase.check_areas is deprecated, use satpy.composites.CompositeBase.match_data_arrays instead
The quickstart guide instructs users to pass the solar zenith angle to the night_fls
composite, but in reality this one needs the satellite zenith angle.
On 2020-01-06, there was widespread valley fog in Germany, as confirmed by direct personal ground observation by myself.
Unfortunately, fogpy fails to deliver any results and the resulting images are all black. The problem is exposed at least at the clustering step:
[DEBUG: 2020-01-08 11:00:04 : fogpy.algorithms] Number of spatial coherent fog cloud clusters: --
In the test routines, Test_NightFogLowStratusAlgorithm.setUp
tries to set up a pyorbital.Orbital
class with a geostationary TLE:
However, pyorbital.Orbital
does not support geostationary satellites, so this fails with a NotImplementedError
:
Traceback (most recent call last):
File "/home/gholl/checkouts/fogpy/fogpy/test/test_algorithms.py", line 622, in setUp
line2=self.tle.line2)
File "/media/nas/x21324/miniconda3/envs/py37d/lib/python3.7/site-packages/pyorbital/orbital.py", line 167, in __init__
self._sgdp4 = _SGDP4(self.orbit_elements)
File "/media/nas/x21324/miniconda3/envs/py37d/lib/python3.7/site-packages/pyorbital/orbital.py", line 706, in __init__
raise NotImplementedError('Deep space calculations not supported')
NotImplementedError: Deep space calculations not supported
This appears to have been the case for many years so I don't see how this test can have ever worked.
The RTD filters list is empty, apparently there is a problem with the RTD documentation building.
The location from which the Digital Elevation Model (DEM) is taken needs to be more flexible. Currently it is hardcoded in the yaml file, for one region (Europe) for a 1 km grid, and the data are not easily available. Instead this data should be dynamically downloaded as needed. For pyspectral, aux data are downloaded from zenodo.
Fogpy is rather slow. Needs some profiling, and probably some of the lower-end functions could be rewritten in numba to speed things up considerably.
Using fogpy 1.2.0+dev52.g86a9cf7.fogpy.for.abi
and fogtools 0.1.0.post0.dev43+g12198b9
:
show-fog $PLOTDIR/abi-ne.tif -m abi_l1b --sat import/Sat_data/OR_ABI-L1b-RadF-M3C*_G16_s20170731606102_e*.nc --nwcsaf export/CMIC/S_NWC_CMIC_GOES16_NEW-ENGLAND-NR_20170314T160610Z.nc
The result is somewhat artsy but not useful:
import glob
import sattools.ptc
from satpy import Scene
fn_sev = glob.glob("/media/nas/x21308/scratch/SEVIRI/2013/12/12/*")
fn_cmsaf = ["/media/nas/x20629/SEVIRI/repr2/level2/cpp/2013/12/12/CPPin20131212100000305SVMSG01MD.nc"]
reader_sev = "seviri_l1b_hrit"
reader_cmsaf = "cmsaf-claas2_l2_nc"
sc = Scene(filenames={
reader_sev: fn_sev,
reader_cmsaf: fn_cmsaf})
sattools.ptc.add_pkg_comps_mods(sc, "fogpy", sensors=["seviri"])
ls = sc.resample("germ2")
ls.load(["fls_day"])
ls.show("germ2")
fails with
File "mwe53.py", line 13, in <module>
ls.load(["fls_day"])
File "/data/gholl/miniconda3/envs/py38/lib/python3.8/site-packages/satpy/scene.py", line 971, in load
raise KeyError("Unknown datasets: {}".format(unknown_str))
KeyError: 'Unknown datasets: VIS006, IR_120, IR_087, VIS008, IR_108, IR_039, IR_016'
It works when adding
sc.load(["VIS006", "IR_120", "IR_087", "VIS008", "IR_108", "IR_039", "IR_016", "cot", "cwp", "reff"])
The need for explicit loading is partly an inevitable consequence of the workaround in 1e85cd3, but that doesn't explain why it also finds the datasets it can find with SEVIRI unknown. This may be an issue with satpy dependencies not found when having multiple readers?
After using LowWaterCloud.optimize_cbh
with the basin hopping algorithm, fogpy can find the fog base height. But if it we use the brute force algorithm instead, then fogpy cannot find the fog base height:
In [120]: lwc = LowWaterCloud(1000., 275., 100., 100., 10e-6)
In [121]: lwc.init_cloud_layers(100, 10)
In [122]: lwc.optimize_cbh(lwc.cbh, method="basin")
/media/nas/x21324/miniconda3/envs/py37d/lib/python3.7/site-packages/scipy/optimize/_minimize.py:517: RuntimeWarning: Method BFGS cannot handle constraints nor bounds.
RuntimeWarning)
/media/nas/x21324/miniconda3/envs/py37d/lib/python3.7/site-packages/scipy/optimize/_minimize.py:517: RuntimeWarning: Method BFGS cannot handle constraints nor bounds.
RuntimeWarning)
INFO lowwatercloud 2019-06-14 13:27:44,736 lowwatercloud.cbh:231: Reducing upper threshold <33.129771728629294> to correct conflict
/media/nas/x21324/miniconda3/envs/py37d/lib/python3.7/site-packages/scipy/optimize/_minimize.py:517: RuntimeWarning: Method BFGS cannot handle constraints nor bounds.
RuntimeWarning)
/media/nas/x21324/miniconda3/envs/py37d/lib/python3.7/site-packages/scipy/optimize/_minimize.py:517: RuntimeWarning: Method BFGS cannot handle constraints nor bounds.
RuntimeWarning)
/media/nas/x21324/miniconda3/envs/py37d/lib/python3.7/site-packages/scipy/optimize/_minimize.py:517: RuntimeWarning: Method BFGS cannot handle constraints nor bounds.
RuntimeWarning)
/media/nas/x21324/miniconda3/envs/py37d/lib/python3.7/site-packages/scipy/optimize/_minimize.py:517: RuntimeWarning: Method BFGS cannot handle constraints nor bounds.
RuntimeWarning)
/media/nas/x21324/miniconda3/envs/py37d/lib/python3.7/site-packages/scipy/optimize/_minimize.py:517: RuntimeWarning: Method BFGS cannot handle constraints nor bounds.
RuntimeWarning)
/media/nas/x21324/miniconda3/envs/py37d/lib/python3.7/site-packages/scipy/optimize/_minimize.py:517: RuntimeWarning: Method BFGS cannot handle constraints nor bounds.
RuntimeWarning)
/media/nas/x21324/miniconda3/envs/py37d/lib/python3.7/site-packages/scipy/optimize/_minimize.py:517: RuntimeWarning: Method BFGS cannot handle constraints nor bounds.
RuntimeWarning)
/media/nas/x21324/miniconda3/envs/py37d/lib/python3.7/site-packages/scipy/optimize/_minimize.py:517: RuntimeWarning: Method BFGS cannot handle constraints nor bounds.
RuntimeWarning)
/media/nas/x21324/miniconda3/envs/py37d/lib/python3.7/site-packages/scipy/optimize/_minimize.py:517: RuntimeWarning: Method BFGS cannot handle constraints nor bounds.
RuntimeWarning)
/media/nas/x21324/miniconda3/envs/py37d/lib/python3.7/site-packages/scipy/optimize/_minimize.py:517: RuntimeWarning: Method BFGS cannot handle constraints nor bounds.
RuntimeWarning)
/media/nas/x21324/miniconda3/envs/py37d/lib/python3.7/site-packages/scipy/optimize/_minimize.py:517: RuntimeWarning: Method BFGS cannot handle constraints nor bounds.
RuntimeWarning)
/media/nas/x21324/miniconda3/envs/py37d/lib/python3.7/site-packages/scipy/optimize/_minimize.py:517: RuntimeWarning: Method BFGS cannot handle constraints nor bounds.
RuntimeWarning)
INFO lowwatercloud 2019-06-14 13:27:46,686 lowwatercloud.optimize_cbh:542: Optimized lwp: start cbh: 100.00, cth: 1000.00, ctt: 275.00, observed lwp 100.00 --> result lwp: 100.00, calibrated cbh: 615.19, elapsed time: 2104.00 ms for 41 layers with 10.0 m thickness
Out[122]: 615.1869443796053
In [123]: lwc.get_fog_base_height()
Out[123]: 620.1860781550229
In [124]: lwc.optimize_cbh(lwc.cbh, method="brute")
Out[124]: 615.0
In [125]: lwc.get_fog_base_height()
WARNING lowwatercloud 2019-06-14 13:28:11,414 lowwatercloud.get_fog_base_height:291: No fog base height found: Set to NaN
Out[125]: nan
Related: #28
After installation of fogpy, I get 12 errors and 1 failure:
test_base_algorithm (fogpy.test.test_algorithms.Test_BaseSatelliteAlgorithm) ... ok
test_fls_algorithm (fogpy.test.test_algorithms.Test_DayFogLowStratusAlgorithm) ... /media/nas/x21324/miniconda3/envs/py27b/lib/python2.7/site-packages/trollimage/colorspaces.py:128: RuntimeWarning: invalid value encountered in power
1.055 * (arr ** (1.0 / 2.4)) - 0.055,
/media/nas/x21324/miniconda3/envs/py27b/lib/python2.7/site-packages/scipy/optimize/_minimize.py:517: RuntimeWarning: Method BFGS cannot handle constraints nor bounds.
RuntimeWarning)
/media/nas/x21324/miniconda3/envs/py27b/lib/python2.7/site-packages/scipy/optimize/_minimize.py:517: RuntimeWarning: Method BFGS cannot handle constraints nor bounds.
RuntimeWarning)
/media/nas/x21324/miniconda3/envs/py27b/lib/python2.7/site-packages/scipy/optimize/_minimize.py:517: RuntimeWarning: Method BFGS cannot handle constraints nor bounds.
RuntimeWarning)
/media/nas/x21324/miniconda3/envs/py27b/lib/python2.7/site-packages/scipy/optimize/_minimize.py:517: RuntimeWarning: Method BFGS cannot handle constraints nor bounds.
RuntimeWarning)
/media/nas/x21324/miniconda3/envs/py27b/lib/python2.7/site-packages/scipy/optimize/_minimize.py:517: RuntimeWarning: Method BFGS cannot handle constraints nor bounds.
RuntimeWarning)
/media/nas/x21324/miniconda3/envs/py27b/lib/python2.7/site-packages/scipy/optimize/_minimize.py:517: RuntimeWarning: Method BFGS cannot handle constraints nor bounds.
RuntimeWarning)
/media/nas/x21324/miniconda3/envs/py27b/lib/python2.7/site-packages/scipy/optimize/_minimize.py:517: RuntimeWarning: Method BFGS cannot handle constraints nor bounds.
RuntimeWarning)
/media/nas/x21324/miniconda3/envs/py27b/lib/python2.7/site-packages/scipy/optimize/_minimize.py:517: RuntimeWarning: Method BFGS cannot handle constraints nor bounds.
RuntimeWarning)
[DEBUG/MainProcess] closing pool
[DEBUG/MainProcess] joining pool
[DEBUG/MainProcess] worker handler exiting
[DEBUG/MainProcess] task handler got sentinel
[DEBUG/MainProcess] task handler sending sentinel to result handler
[DEBUG/MainProcess] task handler sending sentinel to workers
[DEBUG/MainProcess] result handler got sentinel
[DEBUG/MainProcess] ensuring that outqueue is not full
[DEBUG/MainProcess] result handler exiting: len(cache)=0, thread._state=0
[DEBUG/MainProcess] task handler exiting
[DEBUG/MainProcess] finalizing pool
[DEBUG/MainProcess] helping task handler/workers to finish
[DEBUG/MainProcess] removing tasks from inqueue until task handler finished
[DEBUG/MainProcess] joining worker handler
[DEBUG/MainProcess] terminating workers
[DEBUG/MainProcess] joining task handler
[DEBUG/MainProcess] joining result handler
[DEBUG/MainProcess] joining pool workers
/media/nas/x21324/miniconda3/envs/py27b/lib/python2.7/site-packages/trollimage/colorspaces.py:36: RuntimeWarning: invalid value encountered in greater
return np.where(arr > 6.0/29.0,
/media/nas/x21324/miniconda3/envs/py27b/lib/python2.7/site-packages/trollimage/colorspaces.py:127: RuntimeWarning: invalid value encountered in greater
return np.where(arr > 0.0031308,
ERROR
test_fls_algorithm_no_cth_use_clusters (fogpy.test.test_algorithms.Test_DayFogLowStratusAlgorithm) ... /home/gholl/checkouts/fogpy/fogpy/algorithms.py:689: RuntimeWarning: Mean of empty slice
cth = np.nanmean(cthmargin)
/media/nas/x21324/miniconda3/envs/py27b/lib/python2.7/site-packages/numpy/core/_methods.py:32: RuntimeWarning: invalid value encountered in reduce
return umr_minimum(a, axis, None, out, keepdims, initial)
/media/nas/x21324/miniconda3/envs/py27b/lib/python2.7/site-packages/numpy/core/_methods.py:28: RuntimeWarning: invalid value encountered in reduce
return umr_maximum(a, axis, None, out, keepdims, initial)
/home/gholl/checkouts/fogpy/fogpy/filters.py:754: RuntimeWarning: invalid value encountered in greater
cth_mask = (self.cth - self.elev) > 1000
[DEBUG/MainProcess] created semlock with handle 140502249340928
[DEBUG/MainProcess] created semlock with handle 140502234558464
[DEBUG/MainProcess] created semlock with handle 140502234554368
[DEBUG/MainProcess] created semlock with handle 140502234550272
[DEBUG/MainProcess] added worker
[INFO/PoolWorker-9] child process calling self.run()
[DEBUG/MainProcess] added worker
[INFO/PoolWorker-10] child process calling self.run()
[DEBUG/MainProcess] added worker
[INFO/PoolWorker-11] child process calling self.run()
[DEBUG/MainProcess] added worker
[INFO/PoolWorker-12] child process calling self.run()
[DEBUG/MainProcess] added worker
[INFO/PoolWorker-13] child process calling self.run()
[DEBUG/MainProcess] added worker
[INFO/PoolWorker-14] child process calling self.run()
[DEBUG/MainProcess] added worker
[INFO/PoolWorker-15] child process calling self.run()
[DEBUG/MainProcess] added worker
[INFO/PoolWorker-16] child process calling self.run()
/home/gholl/checkouts/fogpy/fogpy/filters.py:1052: RuntimeWarning: Mean of empty slice
result = {k: np.nanmean(v) for k, v in result.iteritems()}
/media/nas/x21324/miniconda3/envs/py27b/lib/python2.7/site-packages/scipy/optimize/_minimize.py:517: RuntimeWarning: Method BFGS cannot handle constraints nor bounds.
RuntimeWarning)
/media/nas/x21324/miniconda3/envs/py27b/lib/python2.7/site-packages/scipy/optimize/_minimize.py:517: RuntimeWarning: Method BFGS cannot handle constraints nor bounds.
RuntimeWarning)
/media/nas/x21324/miniconda3/envs/py27b/lib/python2.7/site-packages/scipy/optimize/_minimize.py:517: RuntimeWarning: Method BFGS cannot handle constraints nor bounds.
RuntimeWarning)
/media/nas/x21324/miniconda3/envs/py27b/lib/python2.7/site-packages/scipy/optimize/_minimize.py:517: RuntimeWarning: Method BFGS cannot handle constraints nor bounds.
RuntimeWarning)
/media/nas/x21324/miniconda3/envs/py27b/lib/python2.7/site-packages/scipy/optimize/_minimize.py:517: RuntimeWarning: Method BFGS cannot handle constraints nor bounds.
RuntimeWarning)
/media/nas/x21324/miniconda3/envs/py27b/lib/python2.7/site-packages/scipy/optimize/_minimize.py:517: RuntimeWarning: Method BFGS cannot handle constraints nor bounds.
RuntimeWarning)
/media/nas/x21324/miniconda3/envs/py27b/lib/python2.7/site-packages/scipy/optimize/_minimize.py:517: RuntimeWarning: Method BFGS cannot handle constraints nor bounds.
RuntimeWarning)
/media/nas/x21324/miniconda3/envs/py27b/lib/python2.7/site-packages/scipy/optimize/_minimize.py:517: RuntimeWarning: Method BFGS cannot handle constraints nor bounds.
RuntimeWarning)
[DEBUG/MainProcess] closing pool
[DEBUG/MainProcess] closing pool
[DEBUG/MainProcess] joining pool
[DEBUG/MainProcess] joining pool
[DEBUG/MainProcess] worker handler exiting
[DEBUG/MainProcess] worker handler exiting
[DEBUG/MainProcess] task handler got sentinel
[DEBUG/MainProcess] task handler got sentinel
[DEBUG/MainProcess] task handler sending sentinel to result handler
[DEBUG/MainProcess] task handler sending sentinel to result handler
[DEBUG/MainProcess] task handler sending sentinel to workers
[DEBUG/MainProcess] result handler got sentinel
[DEBUG/MainProcess] task handler sending sentinel to workers
[DEBUG/MainProcess] result handler got sentinel
[DEBUG/MainProcess] ensuring that outqueue is not full
[DEBUG/PoolWorker-9] worker got sentinel -- exiting
[DEBUG/PoolWorker-13] worker got sentinel -- exiting
[DEBUG/MainProcess] ensuring that outqueue is not full
[DEBUG/PoolWorker-9] worker exiting after 22 tasks
[DEBUG/PoolWorker-13] worker exiting after 20 tasks
[DEBUG/PoolWorker-10] worker got sentinel -- exiting
[DEBUG/PoolWorker-15] worker got sentinel -- exiting
[DEBUG/MainProcess] result handler exiting: len(cache)=0, thread._state=0
[INFO/PoolWorker-9] process shutting down
[DEBUG/PoolWorker-10] worker exiting after 21 tasks
[DEBUG/MainProcess] result handler exiting: len(cache)=0, thread._state=0
[INFO/PoolWorker-13] process shutting down
[DEBUG/PoolWorker-15] worker exiting after 27 tasks
[DEBUG/PoolWorker-9] running all "atexit" finalizers with priority >= 0
[INFO/PoolWorker-10] process shutting down
[DEBUG/PoolWorker-13] running all "atexit" finalizers with priority >= 0
[INFO/PoolWorker-15] process shutting down
[DEBUG/PoolWorker-10] running all "atexit" finalizers with priority >= 0
[DEBUG/PoolWorker-15] running all "atexit" finalizers with priority >= 0
[DEBUG/PoolWorker-9] running the remaining "atexit" finalizers
[DEBUG/PoolWorker-13] running the remaining "atexit" finalizers
[DEBUG/PoolWorker-10] running the remaining "atexit" finalizers
[DEBUG/PoolWorker-15] running the remaining "atexit" finalizers
[INFO/PoolWorker-9] process exiting with exitcode 0
[INFO/PoolWorker-13] process exiting with exitcode 0
[INFO/PoolWorker-15] process exiting with exitcode 0
[INFO/PoolWorker-10] process exiting with exitcode 0
[DEBUG/MainProcess] task handler exiting
[DEBUG/PoolWorker-16] worker got sentinel -- exiting
[DEBUG/PoolWorker-14] worker got sentinel -- exiting
[DEBUG/MainProcess] task handler exiting
[DEBUG/PoolWorker-16] worker exiting after 22 tasks
[DEBUG/PoolWorker-14] worker exiting after 24 tasks
[INFO/PoolWorker-16] process shutting down
[DEBUG/PoolWorker-16] running all "atexit" finalizers with priority >= 0
[DEBUG/PoolWorker-12] worker got sentinel -- exiting
[INFO/PoolWorker-14] process shutting down
[DEBUG/PoolWorker-12] worker exiting after 17 tasks
[DEBUG/PoolWorker-16] running the remaining "atexit" finalizers
[DEBUG/PoolWorker-14] running all "atexit" finalizers with priority >= 0
[INFO/PoolWorker-16] process exiting with exitcode 0
[INFO/PoolWorker-12] process shutting down
[DEBUG/PoolWorker-14] running the remaining "atexit" finalizers
[DEBUG/PoolWorker-12] running all "atexit" finalizers with priority >= 0
[INFO/PoolWorker-14] process exiting with exitcode 0
[DEBUG/PoolWorker-12] running the remaining "atexit" finalizers
[INFO/PoolWorker-12] process exiting with exitcode 0
[DEBUG/PoolWorker-11] worker got sentinel -- exiting
[DEBUG/PoolWorker-11] worker exiting after 21 tasks
[INFO/PoolWorker-11] process shutting down
[DEBUG/PoolWorker-11] running all "atexit" finalizers with priority >= 0
[DEBUG/PoolWorker-11] running the remaining "atexit" finalizers
[INFO/PoolWorker-11] process exiting with exitcode 0
/home/gholl/checkouts/fogpy/fogpy/filters.py:995: RuntimeWarning: invalid value encountered in greater
0)] = True
[DEBUG/MainProcess] finalizing pool
[DEBUG/MainProcess] finalizing pool
[DEBUG/MainProcess] helping task handler/workers to finish
[DEBUG/MainProcess] helping task handler/workers to finish
[DEBUG/MainProcess] removing tasks from inqueue until task handler finished
[DEBUG/MainProcess] removing tasks from inqueue until task handler finished
[DEBUG/MainProcess] joining worker handler
[DEBUG/MainProcess] joining worker handler
[DEBUG/MainProcess] terminating workers
[DEBUG/MainProcess] terminating workers
[DEBUG/MainProcess] joining task handler
[DEBUG/MainProcess] joining task handler
[DEBUG/MainProcess] joining result handler
[DEBUG/MainProcess] joining result handler
[DEBUG/MainProcess] joining pool workers
[DEBUG/MainProcess] joining pool workers
ok
test_fls_algorithm_other (fogpy.test.test_algorithms.Test_DayFogLowStratusAlgorithm) ... [DEBUG/MainProcess] created semlock with handle 140502249340928
[DEBUG/MainProcess] created semlock with handle 140502249340928
[DEBUG/MainProcess] created semlock with handle 140502234558464
[DEBUG/MainProcess] created semlock with handle 140502234558464
[DEBUG/MainProcess] created semlock with handle 140502234554368
[DEBUG/MainProcess] created semlock with handle 140502234554368
[DEBUG/MainProcess] created semlock with handle 140502234550272
[DEBUG/MainProcess] created semlock with handle 140502234550272
[DEBUG/MainProcess] added worker
[DEBUG/MainProcess] added worker
[INFO/PoolWorker-17] child process calling self.run()
[INFO/PoolWorker-17] child process calling self.run()
[DEBUG/MainProcess] added worker
[DEBUG/MainProcess] added worker
[INFO/PoolWorker-18] child process calling self.run()
[INFO/PoolWorker-18] child process calling self.run()
[DEBUG/MainProcess] added worker
[DEBUG/MainProcess] added worker
[INFO/PoolWorker-19] child process calling self.run()
[INFO/PoolWorker-19] child process calling self.run()
[DEBUG/MainProcess] added worker
[DEBUG/MainProcess] added worker
[INFO/PoolWorker-20] child process calling self.run()
[INFO/PoolWorker-20] child process calling self.run()
[DEBUG/MainProcess] added worker
[DEBUG/MainProcess] added worker
[INFO/PoolWorker-21] child process calling self.run()
[INFO/PoolWorker-21] child process calling self.run()
[DEBUG/MainProcess] added worker
[DEBUG/MainProcess] added worker
[INFO/PoolWorker-22] child process calling self.run()
[INFO/PoolWorker-22] child process calling self.run()
[DEBUG/MainProcess] added worker
[DEBUG/MainProcess] added worker
[INFO/PoolWorker-23] child process calling self.run()
[INFO/PoolWorker-23] child process calling self.run()
[DEBUG/MainProcess] added worker
[DEBUG/MainProcess] added worker
[INFO/PoolWorker-24] child process calling self.run()
[INFO/PoolWorker-24] child process calling self.run()
/media/nas/x21324/miniconda3/envs/py27b/lib/python2.7/site-packages/scipy/optimize/_minimize.py:517: RuntimeWarning: Method BFGS cannot handle constraints nor bounds.
RuntimeWarning)
/media/nas/x21324/miniconda3/envs/py27b/lib/python2.7/site-packages/scipy/optimize/_minimize.py:517: RuntimeWarning: Method BFGS cannot handle constraints nor bounds.
RuntimeWarning)
/media/nas/x21324/miniconda3/envs/py27b/lib/python2.7/site-packages/scipy/optimize/_minimize.py:517: RuntimeWarning: Method BFGS cannot handle constraints nor bounds.
RuntimeWarning)
/media/nas/x21324/miniconda3/envs/py27b/lib/python2.7/site-packages/scipy/optimize/_minimize.py:517: RuntimeWarning: Method BFGS cannot handle constraints nor bounds.
RuntimeWarning)
/media/nas/x21324/miniconda3/envs/py27b/lib/python2.7/site-packages/scipy/optimize/_minimize.py:517: RuntimeWarning: Method BFGS cannot handle constraints nor bounds.
RuntimeWarning)
/media/nas/x21324/miniconda3/envs/py27b/lib/python2.7/site-packages/scipy/optimize/_minimize.py:517: RuntimeWarning: Method BFGS cannot handle constraints nor bounds.
RuntimeWarning)
/media/nas/x21324/miniconda3/envs/py27b/lib/python2.7/site-packages/scipy/optimize/_minimize.py:517: RuntimeWarning: Method BFGS cannot handle constraints nor bounds.
RuntimeWarning)
/media/nas/x21324/miniconda3/envs/py27b/lib/python2.7/site-packages/scipy/optimize/_minimize.py:517: RuntimeWarning: Method BFGS cannot handle constraints nor bounds.
RuntimeWarning)
[DEBUG/MainProcess] closing pool
[DEBUG/MainProcess] closing pool
[DEBUG/MainProcess] closing pool
[DEBUG/MainProcess] joining pool
[DEBUG/MainProcess] joining pool
[DEBUG/MainProcess] joining pool
[DEBUG/MainProcess] worker handler exiting
[DEBUG/MainProcess] worker handler exiting
[DEBUG/MainProcess] task handler got sentinel
[DEBUG/MainProcess] worker handler exiting
[DEBUG/MainProcess] task handler got sentinel
[DEBUG/MainProcess] task handler got sentinel
[DEBUG/MainProcess] task handler sending sentinel to result handler
[DEBUG/MainProcess] task handler sending sentinel to result handler
[DEBUG/MainProcess] task handler sending sentinel to result handler
[DEBUG/MainProcess] task handler sending sentinel to workers
[DEBUG/MainProcess] result handler got sentinel
[DEBUG/MainProcess] task handler sending sentinel to workers
[DEBUG/MainProcess] task handler sending sentinel to workers
[DEBUG/MainProcess] result handler got sentinel
[DEBUG/MainProcess] result handler got sentinel
[DEBUG/PoolWorker-21] worker got sentinel -- exiting
[DEBUG/MainProcess] ensuring that outqueue is not full
[DEBUG/PoolWorker-21] worker got sentinel -- exiting
[DEBUG/PoolWorker-18] worker got sentinel -- exiting
[DEBUG/MainProcess] ensuring that outqueue is not full
[DEBUG/PoolWorker-19] worker got sentinel -- exiting
[DEBUG/MainProcess] ensuring that outqueue is not full
[DEBUG/PoolWorker-18] worker got sentinel -- exiting
[DEBUG/PoolWorker-19] worker got sentinel -- exiting
[DEBUG/PoolWorker-22] worker got sentinel -- exiting
[DEBUG/PoolWorker-21] worker exiting after 18 tasks
[DEBUG/PoolWorker-17] worker got sentinel -- exiting
[DEBUG/PoolWorker-22] worker got sentinel -- exiting
[DEBUG/PoolWorker-24] worker got sentinel -- exiting
[DEBUG/PoolWorker-21] worker exiting after 18 tasks
[DEBUG/PoolWorker-18] worker exiting after 16 tasks
[DEBUG/PoolWorker-19] worker exiting after 18 tasks
[DEBUG/PoolWorker-17] worker got sentinel -- exiting
[DEBUG/PoolWorker-24] worker got sentinel -- exiting
[DEBUG/MainProcess] result handler exiting: len(cache)=0, thread._state=0
[DEBUG/PoolWorker-18] worker exiting after 16 tasks
[DEBUG/PoolWorker-19] worker exiting after 18 tasks
[DEBUG/PoolWorker-22] worker exiting after 18 tasks
[DEBUG/MainProcess] result handler exiting: len(cache)=0, thread._state=0
[DEBUG/PoolWorker-22] worker exiting after 18 tasks
[INFO/PoolWorker-21] process shutting down
[DEBUG/PoolWorker-24] worker exiting after 20 tasks
[DEBUG/MainProcess] result handler exiting: len(cache)=0, thread._state=0
[DEBUG/PoolWorker-17] worker exiting after 19 tasks
[INFO/PoolWorker-21] process shutting down
[DEBUG/PoolWorker-24] worker exiting after 20 tasks
[INFO/PoolWorker-19] process shutting down
[INFO/PoolWorker-18] process shutting down
[DEBUG/PoolWorker-17] worker exiting after 19 tasks
[INFO/PoolWorker-18] process shutting down
[INFO/PoolWorker-19] process shutting down
[INFO/PoolWorker-22] process shutting down
[INFO/PoolWorker-22] process shutting down
[DEBUG/PoolWorker-21] running all "atexit" finalizers with priority >= 0
[INFO/PoolWorker-24] process shutting down
[DEBUG/PoolWorker-18] running all "atexit" finalizers with priority >= 0
[DEBUG/PoolWorker-19] running all "atexit" finalizers with priority >= 0
[INFO/PoolWorker-24] process shutting down
[DEBUG/PoolWorker-21] running all "atexit" finalizers with priority >= 0
[DEBUG/PoolWorker-19] running all "atexit" finalizers with priority >= 0
[DEBUG/PoolWorker-18] running all "atexit" finalizers with priority >= 0
[INFO/PoolWorker-17] process shutting down
[DEBUG/PoolWorker-22] running all "atexit" finalizers with priority >= 0
[DEBUG/MainProcess] task handler exiting
[DEBUG/PoolWorker-22] running all "atexit" finalizers with priority >= 0
[INFO/PoolWorker-17] process shutting down
[DEBUG/PoolWorker-24] running all "atexit" finalizers with priority >= 0
[DEBUG/MainProcess] task handler exiting
[DEBUG/PoolWorker-24] running all "atexit" finalizers with priority >= 0
[DEBUG/MainProcess] task handler exiting
[DEBUG/PoolWorker-19] running the remaining "atexit" finalizers
[DEBUG/PoolWorker-18] running the remaining "atexit" finalizers
[DEBUG/PoolWorker-21] running the remaining "atexit" finalizers
[DEBUG/PoolWorker-17] running all "atexit" finalizers with priority >= 0
[DEBUG/PoolWorker-19] running the remaining "atexit" finalizers
[DEBUG/PoolWorker-18] running the remaining "atexit" finalizers
[DEBUG/PoolWorker-22] running the remaining "atexit" finalizers
[DEBUG/PoolWorker-21] running the remaining "atexit" finalizers
[DEBUG/PoolWorker-17] running all "atexit" finalizers with priority >= 0
[DEBUG/PoolWorker-22] running the remaining "atexit" finalizers
[DEBUG/PoolWorker-24] running the remaining "atexit" finalizers
[DEBUG/PoolWorker-24] running the remaining "atexit" finalizers
[INFO/PoolWorker-18] process exiting with exitcode 0
[INFO/PoolWorker-19] process exiting with exitcode 0
[INFO/PoolWorker-18] process exiting with exitcode 0
[INFO/PoolWorker-19] process exiting with exitcode 0
[INFO/PoolWorker-21] process exiting with exitcode 0
[INFO/PoolWorker-22] process exiting with exitcode 0
[DEBUG/PoolWorker-17] running the remaining "atexit" finalizers
[INFO/PoolWorker-24] process exiting with exitcode 0
[INFO/PoolWorker-22] process exiting with exitcode 0
[INFO/PoolWorker-21] process exiting with exitcode 0
[DEBUG/PoolWorker-17] running the remaining "atexit" finalizers
[INFO/PoolWorker-24] process exiting with exitcode 0
[DEBUG/PoolWorker-20] worker got sentinel -- exiting
[DEBUG/PoolWorker-20] worker got sentinel -- exiting
[INFO/PoolWorker-17] process exiting with exitcode 0
[INFO/PoolWorker-17] process exiting with exitcode 0
[DEBUG/PoolWorker-20] worker exiting after 17 tasks
[DEBUG/PoolWorker-20] worker exiting after 17 tasks
[INFO/PoolWorker-20] process shutting down
[INFO/PoolWorker-20] process shutting down
[DEBUG/PoolWorker-20] running all "atexit" finalizers with priority >= 0
[DEBUG/PoolWorker-20] running all "atexit" finalizers with priority >= 0
[DEBUG/PoolWorker-20] running the remaining "atexit" finalizers
[DEBUG/PoolWorker-20] running the remaining "atexit" finalizers
[INFO/PoolWorker-20] process exiting with exitcode 0
[INFO/PoolWorker-20] process exiting with exitcode 0
[DEBUG/PoolWorker-23] worker got sentinel -- exiting
[DEBUG/PoolWorker-23] worker got sentinel -- exiting
[DEBUG/PoolWorker-23] worker exiting after 22 tasks
[DEBUG/PoolWorker-23] worker exiting after 22 tasks
[INFO/PoolWorker-23] process shutting down
[INFO/PoolWorker-23] process shutting down
[DEBUG/PoolWorker-23] running all "atexit" finalizers with priority >= 0
[DEBUG/PoolWorker-23] running all "atexit" finalizers with priority >= 0
[DEBUG/PoolWorker-23] running the remaining "atexit" finalizers
[DEBUG/PoolWorker-23] running the remaining "atexit" finalizers
[INFO/PoolWorker-23] process exiting with exitcode 0
[INFO/PoolWorker-23] process exiting with exitcode 0
[DEBUG/MainProcess] finalizing pool
[DEBUG/MainProcess] finalizing pool
[DEBUG/MainProcess] finalizing pool
[DEBUG/MainProcess] helping task handler/workers to finish
[DEBUG/MainProcess] helping task handler/workers to finish
[DEBUG/MainProcess] helping task handler/workers to finish
[DEBUG/MainProcess] removing tasks from inqueue until task handler finished
[DEBUG/MainProcess] removing tasks from inqueue until task handler finished
[DEBUG/MainProcess] removing tasks from inqueue until task handler finished
[DEBUG/MainProcess] joining worker handler
[DEBUG/MainProcess] joining worker handler
[DEBUG/MainProcess] joining worker handler
[DEBUG/MainProcess] terminating workers
[DEBUG/MainProcess] terminating workers
[DEBUG/MainProcess] terminating workers
[DEBUG/MainProcess] joining task handler
[DEBUG/MainProcess] joining task handler
[DEBUG/MainProcess] joining task handler
[DEBUG/MainProcess] joining result handler
[DEBUG/MainProcess] joining result handler
[DEBUG/MainProcess] joining result handler
[DEBUG/MainProcess] joining pool workers
[DEBUG/MainProcess] joining pool workers
[DEBUG/MainProcess] joining pool workers
ERROR
test_lcth_algorithm_artificial (fogpy.test.test_algorithms.Test_LowCloudHeightAlgorithm) ... /home/gholl/checkouts/fogpy/fogpy/algorithms.py:850: FutureWarning: `rcond` parameter will change to the default of machine precision times ``max(M, N)`` where M and N are the input matrix dimensions.
To use the future default and silence this warning we advise to pass `rcond=None`, to keep using the old, explicitly pass `rcond=-1`.
m, c = np.linalg.lstsq(A, y)[0]
ok
test_lcth_algorithm_artificial_complement (fogpy.test.test_algorithms.Test_LowCloudHeightAlgorithm) ... ok
test_lcth_algorithm_artificial_next (fogpy.test.test_algorithms.Test_LowCloudHeightAlgorithm) ... ok
test_lcth_algorithm_interpolate (fogpy.test.test_algorithms.Test_LowCloudHeightAlgorithm) ... ok
test_lcth_algorithm_linreg (fogpy.test.test_algorithms.Test_LowCloudHeightAlgorithm) ... ok
Test single cloud cluster linear regression interpolation ... ok
test_lcth_algorithm_nan_neighbor (fogpy.test.test_algorithms.Test_LowCloudHeightAlgorithm) ... /home/gholl/checkouts/fogpy/fogpy/algorithms.py:729: RuntimeWarning: All-NaN slice encountered
self.minheight = np.nanmin(self.result)
/home/gholl/checkouts/fogpy/fogpy/algorithms.py:730: RuntimeWarning: Mean of empty slice
self.meanheight = np.nanmean(self.result)
/home/gholl/checkouts/fogpy/fogpy/algorithms.py:731: RuntimeWarning: All-NaN slice encountered
self.maxheight = np.nanmax(self.result)
/home/gholl/checkouts/fogpy/fogpy/test/test_algorithms.py:378: RuntimeWarning: All-NaN slice encountered
self.assertEqual(np.isnan(np.nanmax(lcthalgo.dz)), True)
/home/gholl/checkouts/fogpy/fogpy/test/test_algorithms.py:379: RuntimeWarning: All-NaN slice encountered
self.assertEqual(np.isnan(np.nanmax(lcthalgo.cth)), True)
ok
test_lcth_algorithm_real (fogpy.test.test_algorithms.Test_LowCloudHeightAlgorithm) ... ok
test_lcth_cell_neighbors (fogpy.test.test_algorithms.Test_LowCloudHeightAlgorithm) ... ok
test_lcth_direct_neighbors (fogpy.test.test_algorithms.Test_LowCloudHeightAlgorithm) ... ok
test_lcth_lapse_rate (fogpy.test.test_algorithms.Test_LowCloudHeightAlgorithm) ... ok
test_nightfls_algorithm (fogpy.test.test_algorithms.Test_NightFogLowStratusAlgorithm) ... ERROR
test_nightfls_algorithm2 (fogpy.test.test_algorithms.Test_NightFogLowStratusAlgorithm) ... ERROR
test_nightfls_slope (fogpy.test.test_algorithms.Test_NightFogLowStratusAlgorithm) ... ERROR
test_nightfls_turningpoints_no_valley (fogpy.test.test_algorithms.Test_NightFogLowStratusAlgorithm) ... ERROR
test_nightfls_turningpoints_with_thres (fogpy.test.test_algorithms.Test_NightFogLowStratusAlgorithm) ... ERROR
test_nightfls_turningpoints_with_valley (fogpy.test.test_algorithms.Test_NightFogLowStratusAlgorithm) ... ERROR
Test resampling to degraded multispectral channel resolution ... /home/gholl/checkouts/fogpy/fogpy/algorithms.py:1130: FutureWarning: `rcond` parameter will change to the default of machine precision times ``max(M, N)`` where M and N are the input matrix dimensions.
To use the future default and silence this warning we advise to pass `rcond=None`, to keep using the old, explicitly pass `rcond=-1`.
results, resids, rank, s = np.linalg.lstsq(A, y)
ok
test_array_filter (fogpy.test.test_filters.Test_ArrayFilter) ... ok
test_array_filter_param (fogpy.test.test_filters.Test_ArrayFilter) ... ok
test_marray_filter (fogpy.test.test_filters.Test_ArrayFilter) ... ok
test_cirrus_cloud_filter (fogpy.test.test_filters.Test_CirrusCloudFilter) ... ok
test_ccl_cloud_filter (fogpy.test.test_filters.Test_CloudFilter) ... ok
test_cloud_filter (fogpy.test.test_filters.Test_CloudFilter) ... ok
test_cloud_filter_plot (fogpy.test.test_filters.Test_CloudFilter) ... ok
test_masked_cloud_filter (fogpy.test.test_filters.Test_CloudFilter) ... ok
test_cloud_motion_filter (fogpy.test.test_filters.Test_CloudMotionFilter) ... ERROR
test_ice_cloud_filter (fogpy.test.test_filters.Test_IceCloudFilter) ... ok
test_lowcloud_filter_clusters (fogpy.test.test_filters.Test_LowCloudFilter) ... [DEBUG/MainProcess] created semlock with handle 140502249340928
[DEBUG/MainProcess] created semlock with handle 140502249340928
[DEBUG/MainProcess] created semlock with handle 140502249340928
[DEBUG/MainProcess] created semlock with handle 140502234558464
[DEBUG/MainProcess] created semlock with handle 140502234558464
[DEBUG/MainProcess] created semlock with handle 140502234558464
[DEBUG/MainProcess] created semlock with handle 140502234554368
[DEBUG/MainProcess] created semlock with handle 140502234554368
[DEBUG/MainProcess] created semlock with handle 140502234554368
[DEBUG/MainProcess] created semlock with handle 140502234550272
[DEBUG/MainProcess] created semlock with handle 140502234550272
[DEBUG/MainProcess] created semlock with handle 140502234550272
[DEBUG/MainProcess] added worker
[DEBUG/MainProcess] added worker
[DEBUG/MainProcess] added worker
[INFO/PoolWorker-25] child process calling self.run()
[INFO/PoolWorker-25] child process calling self.run()
[INFO/PoolWorker-25] child process calling self.run()
[DEBUG/MainProcess] added worker
[DEBUG/MainProcess] added worker
[DEBUG/MainProcess] added worker
[INFO/PoolWorker-26] child process calling self.run()
[INFO/PoolWorker-26] child process calling self.run()
[INFO/PoolWorker-26] child process calling self.run()
[DEBUG/MainProcess] added worker
[DEBUG/MainProcess] added worker
[DEBUG/MainProcess] added worker
[INFO/PoolWorker-27] child process calling self.run()
[INFO/PoolWorker-27] child process calling self.run()
[INFO/PoolWorker-27] child process calling self.run()
[DEBUG/MainProcess] added worker
[DEBUG/MainProcess] added worker
[DEBUG/MainProcess] added worker
[INFO/PoolWorker-28] child process calling self.run()
[INFO/PoolWorker-28] child process calling self.run()
[INFO/PoolWorker-28] child process calling self.run()
[DEBUG/MainProcess] added worker
[DEBUG/MainProcess] added worker
[DEBUG/MainProcess] added worker
[INFO/PoolWorker-29] child process calling self.run()
[INFO/PoolWorker-29] child process calling self.run()
[INFO/PoolWorker-29] child process calling self.run()
[DEBUG/MainProcess] added worker
[DEBUG/MainProcess] added worker
[DEBUG/MainProcess] added worker
[INFO/PoolWorker-30] child process calling self.run()
[INFO/PoolWorker-30] child process calling self.run()
[INFO/PoolWorker-30] child process calling self.run()
[DEBUG/MainProcess] added worker
[DEBUG/MainProcess] added worker
[DEBUG/MainProcess] added worker
[INFO/PoolWorker-31] child process calling self.run()
[INFO/PoolWorker-31] child process calling self.run()
[INFO/PoolWorker-31] child process calling self.run()
[DEBUG/MainProcess] added worker
[DEBUG/MainProcess] added worker
[DEBUG/MainProcess] added worker
[INFO/PoolWorker-32] child process calling self.run()
[INFO/PoolWorker-32] child process calling self.run()
[INFO/PoolWorker-32] child process calling self.run()
/media/nas/x21324/miniconda3/envs/py27b/lib/python2.7/site-packages/scipy/optimize/_minimize.py:517: RuntimeWarning: Method BFGS cannot handle constraints nor bounds.
RuntimeWarning)
[DEBUG/MainProcess] closing pool
[DEBUG/MainProcess] closing pool
[DEBUG/MainProcess] closing pool
[DEBUG/MainProcess] closing pool
[DEBUG/MainProcess] joining pool
[DEBUG/MainProcess] joining pool
[DEBUG/MainProcess] joining pool
[DEBUG/MainProcess] joining pool
[DEBUG/MainProcess] worker handler exiting
[DEBUG/MainProcess] worker handler exiting
[DEBUG/MainProcess] worker handler exiting
[DEBUG/MainProcess] task handler got sentinel
[DEBUG/MainProcess] task handler got sentinel
[DEBUG/MainProcess] worker handler exiting
[DEBUG/MainProcess] task handler got sentinel
[DEBUG/MainProcess] task handler got sentinel
[DEBUG/MainProcess] task handler sending sentinel to result handler
[DEBUG/MainProcess] task handler sending sentinel to result handler
[DEBUG/MainProcess] task handler sending sentinel to result handler
[DEBUG/MainProcess] task handler sending sentinel to result handler
[DEBUG/MainProcess] task handler sending sentinel to workers
[DEBUG/MainProcess] task handler sending sentinel to workers
[DEBUG/MainProcess] result handler got sentinel
[DEBUG/MainProcess] result handler got sentinel
[DEBUG/MainProcess] task handler sending sentinel to workers
[DEBUG/MainProcess] result handler got sentinel
[DEBUG/MainProcess] task handler sending sentinel to workers
[DEBUG/MainProcess] result handler got sentinel
[DEBUG/PoolWorker-26] worker got sentinel -- exiting
[DEBUG/MainProcess] ensuring that outqueue is not full
[DEBUG/PoolWorker-26] worker got sentinel -- exiting
[DEBUG/PoolWorker-27] worker got sentinel -- exiting
[DEBUG/MainProcess] ensuring that outqueue is not full
[DEBUG/PoolWorker-28] worker got sentinel -- exiting
[DEBUG/PoolWorker-26] worker got sentinel -- exiting
[DEBUG/PoolWorker-27] worker got sentinel -- exiting
[DEBUG/PoolWorker-28] worker got sentinel -- exiting
[DEBUG/PoolWorker-27] worker got sentinel -- exiting
[DEBUG/MainProcess] ensuring that outqueue is not full
[DEBUG/PoolWorker-28] worker got sentinel -- exiting
[DEBUG/PoolWorker-29] worker got sentinel -- exiting
[DEBUG/PoolWorker-26] worker exiting after 0 tasks
[DEBUG/PoolWorker-29] worker got sentinel -- exiting
[DEBUG/PoolWorker-26] worker exiting after 0 tasks
[DEBUG/PoolWorker-27] worker exiting after 0 tasks
[DEBUG/PoolWorker-29] worker got sentinel -- exiting
[DEBUG/PoolWorker-28] worker exiting after 0 tasks
[DEBUG/PoolWorker-26] worker exiting after 0 tasks
[DEBUG/PoolWorker-30] worker got sentinel -- exiting
[DEBUG/PoolWorker-27] worker exiting after 0 tasks
[DEBUG/MainProcess] task handler exiting
[DEBUG/PoolWorker-28] worker exiting after 0 tasks
[DEBUG/PoolWorker-27] worker exiting after 0 tasks
[DEBUG/MainProcess] ensuring that outqueue is not full
[DEBUG/PoolWorker-30] worker got sentinel -- exiting
[DEBUG/PoolWorker-28] worker exiting after 0 tasks
[DEBUG/PoolWorker-29] worker exiting after 0 tasks
[DEBUG/PoolWorker-31] worker got sentinel -- exiting
[DEBUG/PoolWorker-30] worker got sentinel -- exiting
[INFO/PoolWorker-26] process shutting down
[DEBUG/PoolWorker-29] worker exiting after 0 tasks
[DEBUG/PoolWorker-31] worker got sentinel -- exiting
[INFO/PoolWorker-26] process shutting down
[DEBUG/MainProcess] task handler exiting
[DEBUG/PoolWorker-29] worker exiting after 0 tasks
[INFO/PoolWorker-27] process shutting down
[DEBUG/PoolWorker-31] worker got sentinel -- exiting
[INFO/PoolWorker-28] process shutting down
[INFO/PoolWorker-26] process shutting down
[INFO/PoolWorker-27] process shutting down
[INFO/PoolWorker-28] process shutting down
[DEBUG/PoolWorker-30] worker exiting after 0 tasks
[INFO/PoolWorker-27] process shutting down
[INFO/PoolWorker-28] process shutting down
[DEBUG/PoolWorker-30] worker exiting after 0 tasks
[DEBUG/PoolWorker-26] running all "atexit" finalizers with priority >= 0
[INFO/PoolWorker-29] process shutting down
[DEBUG/MainProcess] task handler exiting
[DEBUG/PoolWorker-31] worker exiting after 0 tasks
[DEBUG/PoolWorker-30] worker exiting after 0 tasks
[INFO/PoolWorker-29] process shutting down
[DEBUG/PoolWorker-26] running all "atexit" finalizers with priority >= 0
[DEBUG/PoolWorker-27] running all "atexit" finalizers with priority >= 0
[DEBUG/PoolWorker-28] running all "atexit" finalizers with priority >= 0
[DEBUG/MainProcess] result handler exiting: len(cache)=0, thread._state=0
[DEBUG/PoolWorker-31] worker exiting after 0 tasks
[INFO/PoolWorker-29] process shutting down
[DEBUG/PoolWorker-26] running all "atexit" finalizers with priority >= 0
[DEBUG/PoolWorker-28] running all "atexit" finalizers with priority >= 0
[DEBUG/PoolWorker-27] running all "atexit" finalizers with priority >= 0
[DEBUG/PoolWorker-31] worker exiting after 0 tasks
[DEBUG/MainProcess] result handler exiting: len(cache)=0, thread._state=0
[DEBUG/PoolWorker-28] running all "atexit" finalizers with priority >= 0
[DEBUG/PoolWorker-27] running all "atexit" finalizers with priority >= 0
[DEBUG/PoolWorker-29] running all "atexit" finalizers with priority >= 0
[INFO/PoolWorker-30] process shutting down
[DEBUG/PoolWorker-26] running the remaining "atexit" finalizers
[DEBUG/PoolWorker-29] running all "atexit" finalizers with priority >= 0
[INFO/PoolWorker-30] process shutting down
[DEBUG/PoolWorker-29] running all "atexit" finalizers with priority >= 0
[DEBUG/PoolWorker-27] running the remaining "atexit" finalizers
[DEBUG/PoolWorker-26] running the remaining "atexit" finalizers
[INFO/PoolWorker-30] process shutting down
[INFO/PoolWorker-31] process shutting down
[DEBUG/PoolWorker-28] running the remaining "atexit" finalizers
[DEBUG/PoolWorker-32] worker got sentinel -- exiting
[DEBUG/PoolWorker-26] running the remaining "atexit" finalizers
[DEBUG/PoolWorker-27] running the remaining "atexit" finalizers
[DEBUG/PoolWorker-28] running the remaining "atexit" finalizers
[DEBUG/PoolWorker-32] worker got sentinel -- exiting
[INFO/PoolWorker-31] process shutting down
[DEBUG/PoolWorker-27] running the remaining "atexit" finalizers
[DEBUG/PoolWorker-28] running the remaining "atexit" finalizers
[DEBUG/PoolWorker-32] worker got sentinel -- exiting
[DEBUG/PoolWorker-30] running all "atexit" finalizers with priority >= 0
[INFO/PoolWorker-31] process shutting down
[DEBUG/PoolWorker-29] running the remaining "atexit" finalizers
[INFO/PoolWorker-26] process exiting with exitcode 0
[DEBUG/PoolWorker-30] running all "atexit" finalizers with priority >= 0
[DEBUG/PoolWorker-29] running the remaining "atexit" finalizers
[INFO/PoolWorker-26] process exiting with exitcode 0
[DEBUG/PoolWorker-30] running all "atexit" finalizers with priority >= 0
[INFO/PoolWorker-28] process exiting with exitcode 0
[INFO/PoolWorker-27] process exiting with exitcode 0
[DEBUG/PoolWorker-29] running the remaining "atexit" finalizers
[DEBUG/PoolWorker-32] worker exiting after 0 tasks
[INFO/PoolWorker-26] process exiting with exitcode 0
[INFO/PoolWorker-27] process exiting with exitcode 0
[INFO/PoolWorker-28] process exiting with exitcode 0
[DEBUG/PoolWorker-31] running all "atexit" finalizers with priority >= 0
[DEBUG/PoolWorker-32] worker exiting after 0 tasks
[INFO/PoolWorker-28] process exiting with exitcode 0
[INFO/PoolWorker-27] process exiting with exitcode 0
[DEBUG/PoolWorker-31] running all "atexit" finalizers with priority >= 0
[DEBUG/PoolWorker-32] worker exiting after 0 tasks
[DEBUG/PoolWorker-30] running the remaining "atexit" finalizers
[DEBUG/PoolWorker-31] running all "atexit" finalizers with priority >= 0
[INFO/PoolWorker-29] process exiting with exitcode 0
[DEBUG/PoolWorker-30] running the remaining "atexit" finalizers
[DEBUG/PoolWorker-30] running the remaining "atexit" finalizers
[INFO/PoolWorker-29] process exiting with exitcode 0
[INFO/PoolWorker-32] process shutting down
[INFO/PoolWorker-32] process shutting down
[INFO/PoolWorker-29] process exiting with exitcode 0
[DEBUG/PoolWorker-31] running the remaining "atexit" finalizers
[INFO/PoolWorker-32] process shutting down
[INFO/PoolWorker-30] process exiting with exitcode 0
[DEBUG/PoolWorker-31] running the remaining "atexit" finalizers
[INFO/PoolWorker-30] process exiting with exitcode 0
[INFO/PoolWorker-30] process exiting with exitcode 0
[DEBUG/PoolWorker-31] running the remaining "atexit" finalizers
[DEBUG/PoolWorker-32] running all "atexit" finalizers with priority >= 0
[DEBUG/PoolWorker-32] running all "atexit" finalizers with priority >= 0
[DEBUG/PoolWorker-32] running all "atexit" finalizers with priority >= 0
[INFO/PoolWorker-31] process exiting with exitcode 0
[INFO/PoolWorker-31] process exiting with exitcode 0
[INFO/PoolWorker-31] process exiting with exitcode 0
[DEBUG/PoolWorker-32] running the remaining "atexit" finalizers
[DEBUG/PoolWorker-32] running the remaining "atexit" finalizers
[DEBUG/PoolWorker-32] running the remaining "atexit" finalizers
[INFO/PoolWorker-32] process exiting with exitcode 0
[INFO/PoolWorker-32] process exiting with exitcode 0
[INFO/PoolWorker-32] process exiting with exitcode 0
[DEBUG/MainProcess] task handler exiting
[DEBUG/MainProcess] result handler exiting: len(cache)=0, thread._state=0
[DEBUG/MainProcess] result handler exiting: len(cache)=0, thread._state=0
[DEBUG/PoolWorker-25] worker got sentinel -- exiting
[DEBUG/PoolWorker-25] worker got sentinel -- exiting
[DEBUG/PoolWorker-25] worker got sentinel -- exiting
[DEBUG/PoolWorker-25] worker exiting after 1 tasks
[DEBUG/PoolWorker-25] worker exiting after 1 tasks
[DEBUG/PoolWorker-25] worker exiting after 1 tasks
[INFO/PoolWorker-25] process shutting down
[INFO/PoolWorker-25] process shutting down
[INFO/PoolWorker-25] process shutting down
[DEBUG/PoolWorker-25] running all "atexit" finalizers with priority >= 0
[DEBUG/PoolWorker-25] running all "atexit" finalizers with priority >= 0
[DEBUG/PoolWorker-25] running all "atexit" finalizers with priority >= 0
[DEBUG/PoolWorker-25] running the remaining "atexit" finalizers
[DEBUG/PoolWorker-25] running the remaining "atexit" finalizers
[DEBUG/PoolWorker-25] running the remaining "atexit" finalizers
[INFO/PoolWorker-25] process exiting with exitcode 0
[INFO/PoolWorker-25] process exiting with exitcode 0
[INFO/PoolWorker-25] process exiting with exitcode 0
[DEBUG/MainProcess] finalizing pool
[DEBUG/MainProcess] finalizing pool
[DEBUG/MainProcess] finalizing pool
[DEBUG/MainProcess] finalizing pool
[DEBUG/MainProcess] helping task handler/workers to finish
[DEBUG/MainProcess] helping task handler/workers to finish
[DEBUG/MainProcess] helping task handler/workers to finish
[DEBUG/MainProcess] helping task handler/workers to finish
[DEBUG/MainProcess] removing tasks from inqueue until task handler finished
[DEBUG/MainProcess] removing tasks from inqueue until task handler finished
[DEBUG/MainProcess] removing tasks from inqueue until task handler finished
[DEBUG/MainProcess] removing tasks from inqueue until task handler finished
[DEBUG/MainProcess] joining worker handler
[DEBUG/MainProcess] joining worker handler
[DEBUG/MainProcess] joining worker handler
[DEBUG/MainProcess] joining worker handler
[DEBUG/MainProcess] terminating workers
[DEBUG/MainProcess] terminating workers
[DEBUG/MainProcess] terminating workers
[DEBUG/MainProcess] terminating workers
[DEBUG/MainProcess] joining task handler
[DEBUG/MainProcess] joining task handler
[DEBUG/MainProcess] joining task handler
[DEBUG/MainProcess] joining task handler
[DEBUG/MainProcess] joining result handler
[DEBUG/MainProcess] joining result handler
[DEBUG/MainProcess] joining result handler
[DEBUG/MainProcess] joining result handler
[DEBUG/MainProcess] joining pool workers
[DEBUG/MainProcess] joining pool workers
[DEBUG/MainProcess] joining pool workers
[DEBUG/MainProcess] joining pool workers
ok
test_lowcloud_filter_single (fogpy.test.test_filters.Test_LowCloudFilter) ... [DEBUG/MainProcess] created semlock with handle 140502249340928
[DEBUG/MainProcess] created semlock with handle 140502249340928
[DEBUG/MainProcess] created semlock with handle 140502249340928
[DEBUG/MainProcess] created semlock with handle 140502249340928
[DEBUG/MainProcess] created semlock with handle 140502234558464
[DEBUG/MainProcess] created semlock with handle 140502234558464
[DEBUG/MainProcess] created semlock with handle 140502234558464
[DEBUG/MainProcess] created semlock with handle 140502234558464
[DEBUG/MainProcess] created semlock with handle 140502234554368
[DEBUG/MainProcess] created semlock with handle 140502234554368
[DEBUG/MainProcess] created semlock with handle 140502234554368
[DEBUG/MainProcess] created semlock with handle 140502234554368
[DEBUG/MainProcess] created semlock with handle 140502234550272
[DEBUG/MainProcess] created semlock with handle 140502234550272
[DEBUG/MainProcess] created semlock with handle 140502234550272
[DEBUG/MainProcess] created semlock with handle 140502234550272
[DEBUG/MainProcess] added worker
[DEBUG/MainProcess] added worker
[DEBUG/MainProcess] added worker
[DEBUG/MainProcess] added worker
[INFO/PoolWorker-33] child process calling self.run()
[INFO/PoolWorker-33] child process calling self.run()
[INFO/PoolWorker-33] child process calling self.run()
[INFO/PoolWorker-33] child process calling self.run()
[DEBUG/MainProcess] added worker
[DEBUG/MainProcess] added worker
[DEBUG/MainProcess] added worker
[DEBUG/MainProcess] added worker
[INFO/PoolWorker-34] child process calling self.run()
[INFO/PoolWorker-34] child process calling self.run()
[INFO/PoolWorker-34] child process calling self.run()
[INFO/PoolWorker-34] child process calling self.run()
[DEBUG/MainProcess] added worker
[DEBUG/MainProcess] added worker
[DEBUG/MainProcess] added worker
[DEBUG/MainProcess] added worker
[INFO/PoolWorker-35] child process calling self.run()
[INFO/PoolWorker-35] child process calling self.run()
[INFO/PoolWorker-35] child process calling self.run()
[INFO/PoolWorker-35] child process calling self.run()
[DEBUG/MainProcess] added worker
[DEBUG/MainProcess] added worker
[DEBUG/MainProcess] added worker
[DEBUG/MainProcess] added worker
[INFO/PoolWorker-36] child process calling self.run()
[INFO/PoolWorker-36] child process calling self.run()
[INFO/PoolWorker-36] child process calling self.run()
[INFO/PoolWorker-36] child process calling self.run()
[DEBUG/MainProcess] added worker
[DEBUG/MainProcess] added worker
[DEBUG/MainProcess] added worker
[DEBUG/MainProcess] added worker
[INFO/PoolWorker-37] child process calling self.run()
[INFO/PoolWorker-37] child process calling self.run()
[INFO/PoolWorker-37] child process calling self.run()
[INFO/PoolWorker-37] child process calling self.run()
[DEBUG/MainProcess] added worker
[DEBUG/MainProcess] added worker
[DEBUG/MainProcess] added worker
[DEBUG/MainProcess] added worker
[INFO/PoolWorker-38] child process calling self.run()
[INFO/PoolWorker-38] child process calling self.run()
[INFO/PoolWorker-38] child process calling self.run()
[INFO/PoolWorker-38] child process calling self.run()
[DEBUG/MainProcess] added worker
[DEBUG/MainProcess] added worker
[DEBUG/MainProcess] added worker
[DEBUG/MainProcess] added worker
[INFO/PoolWorker-39] child process calling self.run()
[INFO/PoolWorker-39] child process calling self.run()
[INFO/PoolWorker-39] child process calling self.run()
[INFO/PoolWorker-39] child process calling self.run()
[DEBUG/MainProcess] added worker
[DEBUG/MainProcess] added worker
[DEBUG/MainProcess] added worker
[DEBUG/MainProcess] added worker
[INFO/PoolWorker-40] child process calling self.run()
[INFO/PoolWorker-40] child process calling self.run()
[INFO/PoolWorker-40] child process calling self.run()
[INFO/PoolWorker-40] child process calling self.run()
/media/nas/x21324/miniconda3/envs/py27b/lib/python2.7/site-packages/scipy/optimize/_minimize.py:517: RuntimeWarning: Method BFGS cannot handle constraints nor bounds.
RuntimeWarning)
/media/nas/x21324/miniconda3/envs/py27b/lib/python2.7/site-packages/scipy/optimize/_minimize.py:517: RuntimeWarning: Method BFGS cannot handle constraints nor bounds.
RuntimeWarning)
/media/nas/x21324/miniconda3/envs/py27b/lib/python2.7/site-packages/scipy/optimize/_minimize.py:517: RuntimeWarning: Method BFGS cannot handle constraints nor bounds.
RuntimeWarning)
/media/nas/x21324/miniconda3/envs/py27b/lib/python2.7/site-packages/scipy/optimize/_minimize.py:517: RuntimeWarning: Method BFGS cannot handle constraints nor bounds.
RuntimeWarning)
/media/nas/x21324/miniconda3/envs/py27b/lib/python2.7/site-packages/scipy/optimize/_minimize.py:517: RuntimeWarning: Method BFGS cannot handle constraints nor bounds.
RuntimeWarning)
/media/nas/x21324/miniconda3/envs/py27b/lib/python2.7/site-packages/scipy/optimize/_minimize.py:517: RuntimeWarning: Method BFGS cannot handle constraints nor bounds.
RuntimeWarning)
/media/nas/x21324/miniconda3/envs/py27b/lib/python2.7/site-packages/scipy/optimize/_minimize.py:517: RuntimeWarning: Method BFGS cannot handle constraints nor bounds.
RuntimeWarning)
/media/nas/x21324/miniconda3/envs/py27b/lib/python2.7/site-packages/scipy/optimize/_minimize.py:517: RuntimeWarning: Method BFGS cannot handle constraints nor bounds.
RuntimeWarning)
[DEBUG/MainProcess] closing pool
[DEBUG/MainProcess] closing pool
[DEBUG/MainProcess] closing pool
[DEBUG/MainProcess] closing pool
[DEBUG/MainProcess] closing pool
[DEBUG/MainProcess] joining pool
[DEBUG/MainProcess] joining pool
[DEBUG/MainProcess] joining pool
[DEBUG/MainProcess] joining pool
[DEBUG/MainProcess] joining pool
[DEBUG/MainProcess] worker handler exiting
[DEBUG/MainProcess] worker handler exiting
[DEBUG/MainProcess] task handler got sentinel
[DEBUG/MainProcess] worker handler exiting
[DEBUG/MainProcess] worker handler exiting
[DEBUG/MainProcess] task handler got sentinel
[DEBUG/MainProcess] worker handler exiting
[DEBUG/MainProcess] task handler got sentinel
[DEBUG/MainProcess] task handler got sentinel
[DEBUG/MainProcess] task handler got sentinel
[DEBUG/MainProcess] task handler sending sentinel to result handler
[DEBUG/MainProcess] task handler sending sentinel to result handler
[DEBUG/MainProcess] task handler sending sentinel to result handler
[DEBUG/MainProcess] task handler sending sentinel to result handler
[DEBUG/MainProcess] task handler sending sentinel to result handler
[DEBUG/MainProcess] task handler sending sentinel to workers
[DEBUG/MainProcess] result handler got sentinel
[DEBUG/MainProcess] task handler sending sentinel to workers
[DEBUG/MainProcess] task handler sending sentinel to workers
[DEBUG/MainProcess] result handler got sentinel
[DEBUG/MainProcess] result handler got sentinel
[DEBUG/MainProcess] task handler sending sentinel to workers
[DEBUG/MainProcess] task handler sending sentinel to workers
[DEBUG/MainProcess] result handler got sentinel
[DEBUG/MainProcess] result handler got sentinel
[DEBUG/PoolWorker-38] worker got sentinel -- exiting
[DEBUG/PoolWorker-37] worker got sentinel -- exiting
[DEBUG/PoolWorker-38] worker got sentinel -- exiting
[DEBUG/PoolWorker-35] worker got sentinel -- exiting
[DEBUG/MainProcess] ensuring that outqueue is not full
[DEBUG/PoolWorker-37] worker got sentinel -- exiting
[DEBUG/PoolWorker-38] worker got sentinel -- exiting
[DEBUG/PoolWorker-35] worker got sentinel -- exiting
[DEBUG/PoolWorker-38] worker got sentinel -- exiting
[DEBUG/PoolWorker-37] worker got sentinel -- exiting
[DEBUG/MainProcess] ensuring that outqueue is not full
[DEBUG/PoolWorker-35] worker got sentinel -- exiting
[DEBUG/PoolWorker-37] worker got sentinel -- exiting
[DEBUG/PoolWorker-33] worker got sentinel -- exiting
[DEBUG/PoolWorker-35] worker got sentinel -- exiting
[DEBUG/MainProcess] ensuring that outqueue is not full
[DEBUG/PoolWorker-38] worker exiting after 1 tasks
[DEBUG/PoolWorker-34] worker got sentinel -- exiting
[DEBUG/PoolWorker-33] worker got sentinel -- exiting
[DEBUG/PoolWorker-40] worker got sentinel -- exiting
[DEBUG/PoolWorker-38] worker exiting after 1 tasks
[DEBUG/MainProcess] ensuring that outqueue is not full
[DEBUG/PoolWorker-33] worker got sentinel -- exiting
[DEBUG/PoolWorker-34] worker got sentinel -- exiting
[DEBUG/PoolWorker-37] worker exiting after 2 tasks
[DEBUG/PoolWorker-35] worker exiting after 2 tasks
[DEBUG/PoolWorker-38] worker exiting after 1 tasks
[DEBUG/PoolWorker-40] worker got sentinel -- exiting
[DEBUG/PoolWorker-33] worker got sentinel -- exiting
[DEBUG/PoolWorker-34] worker got sentinel -- exiting
[DEBUG/PoolWorker-37] worker exiting after 2 tasks
[DEBUG/MainProcess] ensuring that outqueue is not full
[DEBUG/PoolWorker-35] worker exiting after 2 tasks
[DEBUG/PoolWorker-38] worker exiting after 1 tasks
[DEBUG/PoolWorker-40] worker got sentinel -- exiting
[DEBUG/PoolWorker-37] worker exiting after 2 tasks
[DEBUG/PoolWorker-34] worker got sentinel -- exiting
[DEBUG/PoolWorker-35] worker exiting after 2 tasks
[DEBUG/PoolWorker-40] worker got sentinel -- exiting
[DEBUG/PoolWorker-37] worker exiting after 2 tasks
[DEBUG/PoolWorker-35] worker exiting after 2 tasks
[DEBUG/PoolWorker-33] worker exiting after 2 tasks
[INFO/PoolWorker-38] process shutting down
[DEBUG/PoolWorker-33] worker exiting after 2 tasks
[DEBUG/PoolWorker-34] worker exiting after 2 tasks
[DEBUG/PoolWorker-40] worker exiting after 3 tasks
[DEBUG/MainProcess] result handler exiting: len(cache)=0, thread._state=0
[DEBUG/PoolWorker-33] worker exiting after 2 tasks
[INFO/PoolWorker-38] process shutting down
[DEBUG/PoolWorker-34] worker exiting after 2 tasks
[INFO/PoolWorker-37] process shutting down
[DEBUG/PoolWorker-40] worker exiting after 3 tasks
[INFO/PoolWorker-35] process shutting down
[DEBUG/PoolWorker-33] worker exiting after 2 tasks
[INFO/PoolWorker-38] process shutting down
[DEBUG/PoolWorker-34] worker exiting after 2 tasks
[INFO/PoolWorker-37] process shutting down
[DEBUG/MainProcess] result handler exiting: len(cache)=0, thread._state=0
[INFO/PoolWorker-35] process shutting down
[DEBUG/PoolWorker-40] worker exiting after 3 tasks
[INFO/PoolWorker-38] process shutting down
[INFO/PoolWorker-37] process shutting down
[DEBUG/PoolWorker-34] worker exiting after 2 tasks
[DEBUG/PoolWorker-40] worker exiting after 3 tasks
[INFO/PoolWorker-35] process shutting down
[DEBUG/MainProcess] result handler exiting: len(cache)=0, thread._state=0
[INFO/PoolWorker-37] process shutting down
[INFO/PoolWorker-35] process shutting down
[INFO/PoolWorker-33] process shutting down
[DEBUG/PoolWorker-38] running all "atexit" finalizers with priority >= 0
[DEBUG/MainProcess] result handler exiting: len(cache)=0, thread._state=0
[INFO/PoolWorker-33] process shutting down
[DEBUG/PoolWorker-38] running all "atexit" finalizers with priority >= 0
[INFO/PoolWorker-34] process shutting down
[DEBUG/PoolWorker-37] running all "atexit" finalizers with priority >= 0
[INFO/PoolWorker-40] process shutting down
[DEBUG/PoolWorker-35] running all "atexit" finalizers with priority >= 0
[DEBUG/PoolWorker-38] running all "atexit" finalizers with priority >= 0
[INFO/PoolWorker-33] process shutting down
[DEBUG/MainProcess] result handler exiting: len(cache)=0, thread._state=0
[INFO/PoolWorker-34] process shutting down
[DEBUG/PoolWorker-37] running all "atexit" finalizers with priority >= 0
[INFO/PoolWorker-40] process shutting down
[DEBUG/PoolWorker-35] running all "atexit" finalizers with priority >= 0
[INFO/PoolWorker-33] process shutting down
[DEBUG/PoolWorker-38] running all "atexit" finalizers with priority >= 0
[DEBUG/PoolWorker-37] running all "atexit" finalizers with priority >= 0
[INFO/PoolWorker-34] process shutting down
[DEBUG/PoolWorker-35] running all "atexit" finalizers with priority >= 0
[INFO/PoolWorker-40] process shutting down
[INFO/PoolWorker-34] process shutting down
[DEBUG/PoolWorker-37] running all "atexit" finalizers with priority >= 0
[DEBUG/PoolWorker-35] running all "atexit" finalizers with priority >= 0
[INFO/PoolWorker-40] process shutting down
[DEBUG/PoolWorker-33] running all "atexit" finalizers with priority >= 0
[DEBUG/PoolWorker-33] running all "atexit" finalizers with priority >= 0
[DEBUG/PoolWorker-34] running all "atexit" finalizers with priority >= 0
[DEBUG/PoolWorker-38] running the remaining "atexit" finalizers
[DEBUG/PoolWorker-40] running all "atexit" finalizers with priority >= 0
[DEBUG/PoolWorker-33] running all "atexit" finalizers with priority >= 0
[DEBUG/PoolWorker-34] running all "atexit" finalizers with priority >= 0
[DEBUG/PoolWorker-38] running the remaining "atexit" finalizers
[DEBUG/PoolWorker-35] running the remaining "atexit" finalizers
[DEBUG/PoolWorker-40] running all "atexit" finalizers with priority >= 0
[DEBUG/PoolWorker-33] running all "atexit" finalizers with priority >= 0
[DEBUG/PoolWorker-37] running the remaining "atexit" finalizers
[DEBUG/PoolWorker-34] running all "atexit" finalizers with priority >= 0
[DEBUG/PoolWorker-38] running the remaining "atexit" finalizers
[DEBUG/PoolWorker-35] running the remaining "atexit" finalizers
[DEBUG/PoolWorker-40] running all "atexit" finalizers with priority >= 0
[DEBUG/PoolWorker-37] running the remaining "atexit" finalizers
[DEBUG/PoolWorker-34] running all "atexit" finalizers with priority >= 0
[DEBUG/PoolWorker-38] running the remaining "atexit" finalizers
[DEBUG/PoolWorker-40] running all "atexit" finalizers with priority >= 0
[DEBUG/PoolWorker-35] running the remaining "atexit" finalizers
[DEBUG/PoolWorker-37] running the remaining "atexit" finalizers
[DEBUG/PoolWorker-35] running the remaining "atexit" finalizers
[DEBUG/PoolWorker-37] running the remaining "atexit" finalizers
[DEBUG/PoolWorker-33] running the remaining "atexit" finalizers
[DEBUG/PoolWorker-33] running the remaining "atexit" finalizers
[INFO/PoolWorker-38] process exiting with exitcode 0
[DEBUG/PoolWorker-34] running the remaining "atexit" finalizers
[DEBUG/PoolWorker-40] running the remaining "atexit" finalizers
[INFO/PoolWorker-38] process exiting with exitcode 0
[DEBUG/PoolWorker-33] running the remaining "atexit" finalizers
[INFO/PoolWorker-35] process exiting with exitcode 0
[DEBUG/PoolWorker-34] running the remaining "atexit" finalizers
[INFO/PoolWorker-37] process exiting with exitcode 0
[INFO/PoolWorker-38] process exiting with exitcode 0
[DEBUG/PoolWorker-33] running the remaining "atexit" finalizers
[DEBUG/PoolWorker-40] running the remaining "atexit" finalizers
[INFO/PoolWorker-35] process exiting with exitcode 0
[DEBUG/PoolWorker-34] running the remaining "atexit" finalizers
[INFO/PoolWorker-37] process exiting with exitcode 0
[INFO/PoolWorker-38] process exiting with exitcode 0
[DEBUG/PoolWorker-40] running the remaining "atexit" finalizers
[INFO/PoolWorker-35] process exiting with exitcode 0
[INFO/PoolWorker-37] process exiting with exitcode 0
[DEBUG/PoolWorker-34] running the remaining "atexit" finalizers
[INFO/PoolWorker-35] process exiting with exitcode 0
[DEBUG/PoolWorker-40] running the remaining "atexit" finalizers
[INFO/PoolWorker-37] process exiting with exitcode 0
[INFO/PoolWorker-33] process exiting with exitcode 0
[INFO/PoolWorker-34] process exiting with exitcode 0
[INFO/PoolWorker-33] process exiting with exitcode 0
[INFO/PoolWorker-40] process exiting with exitcode 0
[INFO/PoolWorker-34] process exiting with exitcode 0
[INFO/PoolWorker-33] process exiting with exitcode 0
[INFO/PoolWorker-40] process exiting with exitcode 0
[INFO/PoolWorker-34] process exiting with exitcode 0
[INFO/PoolWorker-33] process exiting with exitcode 0
[INFO/PoolWorker-40] process exiting with exitcode 0
[INFO/PoolWorker-34] process exiting with exitcode 0
[INFO/PoolWorker-40] process exiting with exitcode 0
[DEBUG/MainProcess] task handler exiting
[DEBUG/MainProcess] task handler exiting
[DEBUG/MainProcess] task handler exiting
[DEBUG/MainProcess] task handler exiting
[DEBUG/MainProcess] task handler exiting
[DEBUG/PoolWorker-39] worker got sentinel -- exiting
[DEBUG/PoolWorker-36] worker got sentinel -- exiting
[DEBUG/PoolWorker-39] worker got sentinel -- exiting
[DEBUG/PoolWorker-36] worker got sentinel -- exiting
[DEBUG/PoolWorker-39] worker got sentinel -- exiting
[DEBUG/PoolWorker-36] worker got sentinel -- exiting
[DEBUG/PoolWorker-39] worker got sentinel -- exiting
[DEBUG/PoolWorker-36] worker got sentinel -- exiting
[DEBUG/PoolWorker-36] worker exiting after 2 tasks
[DEBUG/PoolWorker-39] worker exiting after 2 tasks
[DEBUG/PoolWorker-36] worker exiting after 2 tasks
[DEBUG/PoolWorker-39] worker exiting after 2 tasks
[DEBUG/PoolWorker-39] worker exiting after 2 tasks
[DEBUG/PoolWorker-36] worker exiting after 2 tasks
[DEBUG/PoolWorker-39] worker exiting after 2 tasks
[DEBUG/PoolWorker-36] worker exiting after 2 tasks
[INFO/PoolWorker-36] process shutting down
[INFO/PoolWorker-39] process shutting down
[INFO/PoolWorker-39] process shutting down
[INFO/PoolWorker-36] process shutting down
[INFO/PoolWorker-39] process shutting down
[INFO/PoolWorker-36] process shutting down
[INFO/PoolWorker-39] process shutting down
[INFO/PoolWorker-36] process shutting down
[DEBUG/PoolWorker-39] running all "atexit" finalizers with priority >= 0
[DEBUG/PoolWorker-36] running all "atexit" finalizers with priority >= 0
[DEBUG/PoolWorker-39] running all "atexit" finalizers with priority >= 0
[DEBUG/PoolWorker-36] running all "atexit" finalizers with priority >= 0
[DEBUG/PoolWorker-39] running all "atexit" finalizers with priority >= 0
[DEBUG/PoolWorker-36] running all "atexit" finalizers with priority >= 0
[DEBUG/PoolWorker-39] running all "atexit" finalizers with priority >= 0
[DEBUG/PoolWorker-36] running all "atexit" finalizers with priority >= 0
[DEBUG/PoolWorker-39] running the remaining "atexit" finalizers
[DEBUG/PoolWorker-39] running the remaining "atexit" finalizers
[DEBUG/PoolWorker-36] running the remaining "atexit" finalizers
[DEBUG/PoolWorker-39] running the remaining "atexit" finalizers
[DEBUG/PoolWorker-36] running the remaining "atexit" finalizers
[DEBUG/PoolWorker-39] running the remaining "atexit" finalizers
[DEBUG/PoolWorker-36] running the remaining "atexit" finalizers
[DEBUG/PoolWorker-36] running the remaining "atexit" finalizers
[INFO/PoolWorker-39] process exiting with exitcode 0
[INFO/PoolWorker-36] process exiting with exitcode 0
[INFO/PoolWorker-39] process exiting with exitcode 0
[INFO/PoolWorker-36] process exiting with exitcode 0
[INFO/PoolWorker-39] process exiting with exitcode 0
[INFO/PoolWorker-39] process exiting with exitcode 0
[INFO/PoolWorker-36] process exiting with exitcode 0
[INFO/PoolWorker-36] process exiting with exitcode 0
[DEBUG/MainProcess] finalizing pool
[DEBUG/MainProcess] finalizing pool
[DEBUG/MainProcess] finalizing pool
[DEBUG/MainProcess] finalizing pool
[DEBUG/MainProcess] finalizing pool
[DEBUG/MainProcess] helping task handler/workers to finish
[DEBUG/MainProcess] helping task handler/workers to finish
[DEBUG/MainProcess] helping task handler/workers to finish
[DEBUG/MainProcess] helping task handler/workers to finish
[DEBUG/MainProcess] helping task handler/workers to finish
[DEBUG/MainProcess] removing tasks from inqueue until task handler finished
[DEBUG/MainProcess] removing tasks from inqueue until task handler finished
[DEBUG/MainProcess] removing tasks from inqueue until task handler finished
[DEBUG/MainProcess] removing tasks from inqueue until task handler finished
[DEBUG/MainProcess] removing tasks from inqueue until task handler finished
[DEBUG/MainProcess] joining worker handler
[DEBUG/MainProcess] joining worker handler
[DEBUG/MainProcess] joining worker handler
[DEBUG/MainProcess] joining worker handler
[DEBUG/MainProcess] joining worker handler
[DEBUG/MainProcess] terminating workers
[DEBUG/MainProcess] terminating workers
[DEBUG/MainProcess] terminating workers
[DEBUG/MainProcess] terminating workers
[DEBUG/MainProcess] terminating workers
[DEBUG/MainProcess] joining task handler
[DEBUG/MainProcess] joining task handler
[DEBUG/MainProcess] joining task handler
[DEBUG/MainProcess] joining task handler
[DEBUG/MainProcess] joining task handler
[DEBUG/MainProcess] joining result handler
[DEBUG/MainProcess] joining result handler
[DEBUG/MainProcess] joining result handler
[DEBUG/MainProcess] joining result handler
[DEBUG/MainProcess] joining result handler
[DEBUG/MainProcess] joining pool workers
[DEBUG/MainProcess] joining pool workers
[DEBUG/MainProcess] joining pool workers
[DEBUG/MainProcess] joining pool workers
[DEBUG/MainProcess] joining pool workers
ok
test_lowcloud_filter_single_lwp_allfog (fogpy.test.test_filters.Test_LowCloudFilter) ... [DEBUG/MainProcess] created semlock with handle 140502249340928
[DEBUG/MainProcess] created semlock with handle 140502249340928
[DEBUG/MainProcess] created semlock with handle 140502249340928
[DEBUG/MainProcess] created semlock with handle 140502249340928
[DEBUG/MainProcess] created semlock with handle 140502249340928
[DEBUG/MainProcess] created semlock with handle 140502234558464
[DEBUG/MainProcess] created semlock with handle 140502234558464
[DEBUG/MainProcess] created semlock with handle 140502234558464
[DEBUG/MainProcess] created semlock with handle 140502234558464
[DEBUG/MainProcess] created semlock with handle 140502234558464
[DEBUG/MainProcess] created semlock with handle 140502234554368
[DEBUG/MainProcess] created semlock with handle 140502234554368
[DEBUG/MainProcess] created semlock with handle 140502234554368
[DEBUG/MainProcess] created semlock with handle 140502234554368
[DEBUG/MainProcess] created semlock with handle 140502234554368
[DEBUG/MainProcess] created semlock with handle 140502234550272
[DEBUG/MainProcess] created semlock with handle 140502234550272
[DEBUG/MainProcess] created semlock with handle 140502234550272
[DEBUG/MainProcess] created semlock with handle 140502234550272
[DEBUG/MainProcess] created semlock with handle 140502234550272
[DEBUG/MainProcess] added worker
[DEBUG/MainProcess] added worker
[DEBUG/MainProcess] added worker
[DEBUG/MainProcess] added worker
[DEBUG/MainProcess] added worker
[INFO/PoolWorker-41] child process calling self.run()
[INFO/PoolWorker-41] child process calling self.run()
[INFO/PoolWorker-41] child process calling self.run()
[INFO/PoolWorker-41] child process calling self.run()
[INFO/PoolWorker-41] child process calling self.run()
[DEBUG/MainProcess] added worker
[DEBUG/MainProcess] added worker
[DEBUG/MainProcess] added worker
[DEBUG/MainProcess] added worker
[DEBUG/MainProcess] added worker
[INFO/PoolWorker-42] child process calling self.run()
[INFO/PoolWorker-42] child process calling self.run()
[INFO/PoolWorker-42] child process calling self.run()
[INFO/PoolWorker-42] child process calling self.run()
[INFO/PoolWorker-42] child process calling self.run()
[DEBUG/MainProcess] added worker
[DEBUG/MainProcess] added worker
[DEBUG/MainProcess] added worker
[DEBUG/MainProcess] added worker
[DEBUG/MainProcess] added worker
[INFO/PoolWorker-43] child process calling self.run()
[INFO/PoolWorker-43] child process calling self.run()
[INFO/PoolWorker-43] child process calling self.run()
[INFO/PoolWorker-43] child process calling self.run()
[INFO/PoolWorker-43] child process calling self.run()
[DEBUG/MainProcess] added worker
[DEBUG/MainProcess] added worker
[DEBUG/MainProcess] added worker
[DEBUG/MainProcess] added worker
[DEBUG/MainProcess] added worker
[INFO/PoolWorker-44] child process calling self.run()
[INFO/PoolWorker-44] child process calling self.run()
[INFO/PoolWorker-44] child process calling self.run()
[INFO/PoolWorker-44] child process calling self.run()
[INFO/PoolWorker-44] child process calling self.run()
[DEBUG/MainProcess] added worker
[DEBUG/MainProcess] added worker
[DEBUG/MainProcess] added worker
[DEBUG/MainProcess] added worker
[DEBUG/MainProcess] added worker
[INFO/PoolWorker-45] child process calling self.run()
[INFO/PoolWorker-45] child process calling self.run()
[INFO/PoolWorker-45] child process calling self.run()
[INFO/PoolWorker-45] child process calling self.run()
[INFO/PoolWorker-45] child process calling self.run()
[DEBUG/MainProcess] added worker
[DEBUG/MainProcess] added worker
[DEBUG/MainProcess] added worker
[DEBUG/MainProcess] added worker
[DEBUG/MainProcess] added worker
[INFO/PoolWorker-46] child process calling self.run()
[INFO/PoolWorker-46] child process calling self.run()
[INFO/PoolWorker-46] child process calling self.run()
[INFO/PoolWorker-46] child process calling self.run()
[INFO/PoolWorker-46] child process calling self.run()
[DEBUG/MainProcess] added worker
[DEBUG/MainProcess] added worker
[DEBUG/MainProcess] added worker
[DEBUG/MainProcess] added worker
[DEBUG/MainProcess] added worker
[INFO/PoolWorker-47] child process calling self.run()
[INFO/PoolWorker-47] child process calling self.run()
[INFO/PoolWorker-47] child process calling self.run()
[INFO/PoolWorker-47] child process calling self.run()
[INFO/PoolWorker-47] child process calling self.run()
[DEBUG/MainProcess] added worker
[DEBUG/MainProcess] added worker
[DEBUG/MainProcess] added worker
[DEBUG/MainProcess] added worker
[DEBUG/MainProcess] added worker
[INFO/PoolWorker-48] child process calling self.run()
[INFO/PoolWorker-48] child process calling self.run()
[INFO/PoolWorker-48] child process calling self.run()
[INFO/PoolWorker-48] child process calling self.run()
[INFO/PoolWorker-48] child process calling self.run()
/media/nas/x21324/miniconda3/envs/py27b/lib/python2.7/site-packages/scipy/optimize/_minimize.py:517: RuntimeWarning: Method BFGS cannot handle constraints nor bounds.
RuntimeWarning)
/media/nas/x21324/miniconda3/envs/py27b/lib/python2.7/site-packages/scipy/optimize/_minimize.py:517: RuntimeWarning: Method BFGS cannot handle constraints nor bounds.
RuntimeWarning)
/media/nas/x21324/miniconda3/envs/py27b/lib/python2.7/site-packages/scipy/optimize/_minimize.py:517: RuntimeWarning: Method BFGS cannot handle constraints nor bounds.
RuntimeWarning)
/media/nas/x21324/miniconda3/envs/py27b/lib/python2.7/site-packages/scipy/optimize/_minimize.py:517: RuntimeWarning: Method BFGS cannot handle constraints nor bounds.
RuntimeWarning)
[DEBUG/MainProcess] closing pool
[DEBUG/MainProcess] closing pool
[DEBUG/MainProcess] closing pool
[DEBUG/MainProcess] closing pool
[DEBUG/MainProcess] closing pool
[DEBUG/MainProcess] closing pool
[DEBUG/MainProcess] joining pool
[DEBUG/MainProcess] joining pool
[DEBUG/MainProcess] joining pool
[DEBUG/MainProcess] joining pool
[DEBUG/MainProcess] joining pool
[DEBUG/MainProcess] joining pool
[DEBUG/MainProcess] worker handler exiting
[DEBUG/MainProcess] worker handler exiting
[DEBUG/MainProcess] task handler got sentinel
[DEBUG/MainProcess] worker handler exiting
[DEBUG/MainProcess] task handler got sentinel
[DEBUG/MainProcess] task handler got sentinel
[DEBUG/MainProcess] worker handler exiting
[DEBUG/MainProcess] worker handler exiting
[DEBUG/MainProcess] task handler got sentinel
[DEBUG/MainProcess] task handler got sentinel
[DEBUG/MainProcess] worker handler exiting
[DEBUG/MainProcess] task handler got sentinel
[DEBUG/MainProcess] task handler sending sentinel to result handler
[DEBUG/MainProcess] task handler sending sentinel to result handler
[DEBUG/MainProcess] task handler sending sentinel to result handler
[DEBUG/MainProcess] task handler sending sentinel to result handler
[DEBUG/MainProcess] task handler sending sentinel to result handler
[DEBUG/MainProcess] task handler sending sentinel to result handler
[DEBUG/MainProcess] task handler sending sentinel to workers
[DEBUG/MainProcess] task handler sending sentinel to workers
[DEBUG/MainProcess] result handler got sentinel
[DEBUG/MainProcess] task handler sending sentinel to workers
[DEBUG/MainProcess] task handler sending sentinel to workers
[DEBUG/MainProcess] result handler got sentinel
[DEBUG/MainProcess] result handler got sentinel
[DEBUG/MainProcess] result handler got sentinel
[DEBUG/MainProcess] task handler sending sentinel to workers
[DEBUG/MainProcess] task handler sending sentinel to workers
[DEBUG/MainProcess] result handler got sentinel
[DEBUG/MainProcess] result handler got sentinel
[DEBUG/PoolWorker-45] worker got sentinel -- exiting
[DEBUG/MainProcess] ensuring that outqueue is not full
[DEBUG/PoolWorker-45] worker got sentinel -- exiting
[DEBUG/PoolWorker-46] worker got sentinel -- exiting
[DEBUG/PoolWorker-45] worker got sentinel -- exiting
[DEBUG/PoolWorker-46] worker got sentinel -- exiting
[DEBUG/PoolWorker-47] worker got sentinel -- exiting
[DEBUG/MainProcess] ensuring that outqueue is not full
[DEBUG/PoolWorker-45] worker got sentinel -- exiting
[DEBUG/PoolWorker-46] worker got sentinel -- exiting
[DEBUG/PoolWorker-46] worker got sentinel -- exiting
[DEBUG/PoolWorker-45] worker got sentinel -- exiting
[DEBUG/PoolWorker-47] worker got sentinel -- exiting
[DEBUG/MainProcess] ensuring that outqueue is not full
[DEBUG/PoolWorker-46] worker got sentinel -- exiting
[DEBUG/PoolWorker-47] worker got sentinel -- exiting
[DEBUG/MainProcess] ensuring that outqueue is not full
[DEBUG/PoolWorker-48] worker got sentinel -- exiting
[DEBUG/PoolWorker-47] worker got sentinel -- exiting
[DEBUG/PoolWorker-44] worker got sentinel -- exiting
[DEBUG/MainProcess] ensuring that outqueue is not full
[DEBUG/PoolWorker-48] worker got sentinel -- exiting
[DEBUG/PoolWorker-43] worker got sentinel -- exiting
[DEBUG/PoolWorker-45] worker exiting after 0 tasks
[DEBUG/PoolWorker-47] worker got sentinel -- exiting
[DEBUG/PoolWorker-44] worker got sentinel -- exiting
[DEBUG/PoolWorker-46] worker exiting after 0 tasks
[DEBUG/MainProcess] ensuring that outqueue is not full
[DEBUG/PoolWorker-42] worker got sentinel -- exiting
[DEBUG/PoolWorker-45] worker exiting after 0 tasks
[DEBUG/PoolWorker-48] worker got sentinel -- exiting
[DEBUG/PoolWorker-43] worker got sentinel -- exiting
[DEBUG/PoolWorker-44] worker got sentinel -- exiting
[DEBUG/PoolWorker-46] worker exiting after 0 tasks
[DEBUG/PoolWorker-45] worker exiting after 0 tasks
[DEBUG/PoolWorker-42] worker got sentinel -- exiting
[DEBUG/PoolWorker-43] worker got sentinel -- exiting
[DEBUG/PoolWorker-48] worker got sentinel -- exiting
[DEBUG/PoolWorker-46] worker exiting after 0 tasks
[DEBUG/PoolWorker-44] worker got sentinel -- exiting
[DEBUG/PoolWorker-45] worker exiting after 0 tasks
[DEBUG/PoolWorker-47] worker exiting after 0 tasks
[DEBUG/PoolWorker-42] worker got sentinel -- exiting
[DEBUG/PoolWorker-48] worker got sentinel -- exiting
[DEBUG/PoolWorker-43] worker got sentinel -- exiting
[DEBUG/PoolWorker-46] worker exiting after 0 tasks
[DEBUG/PoolWorker-44] worker got sentinel -- exiting
[DEBUG/PoolWorker-45] worker exiting after 0 tasks
[DEBUG/PoolWorker-42] worker got sentinel -- exiting
[DEBUG/PoolWorker-47] worker exiting after 0 tasks
[DEBUG/PoolWorker-43] worker got sentinel -- exiting
[DEBUG/PoolWorker-46] worker exiting after 0 tasks
[DEBUG/MainProcess] result handler exiting: len(cache)=0, thread._state=0
[DEBUG/PoolWorker-42] worker got sentinel -- exiting
[DEBUG/PoolWorker-47] worker exiting after 0 tasks
[DEBUG/PoolWorker-47] worker exiting after 0 tasks
[DEBUG/MainProcess] result handler exiting: len(cache)=0, thread._state=0
[DEBUG/PoolWorker-48] worker exiting after 0 tasks
[DEBUG/PoolWorker-44] worker exiting after 1 tasks
[DEBUG/PoolWorker-43] worker exiting after 1 tasks
[DEBUG/PoolWorker-47] worker exiting after 0 tasks
[DEBUG/MainProcess] result handler exiting: len(cache)=0, thread._state=0
[DEBUG/PoolWorker-48] worker exiting after 0 tasks
[INFO/PoolWorker-45] process shutting down
[DEBUG/PoolWorker-44] worker exiting after 1 tasks
[DEBUG/PoolWorker-42] worker exiting after 1 tasks
[INFO/PoolWorker-46] process shutting down
[DEBUG/PoolWorker-43] worker exiting after 1 tasks
[DEBUG/PoolWorker-48] worker exiting after 0 tasks
[DEBUG/PoolWorker-44] worker exiting after 1 tasks
[DEBUG/MainProcess] result handler exiting: len(cache)=0, thread._state=0
[INFO/PoolWorker-45] process shutting down
[DEBUG/PoolWorker-42] worker exiting after 1 tasks
[INFO/PoolWorker-46] process shutting down
[DEBUG/PoolWorker-43] worker exiting after 1 tasks
[DEBUG/PoolWorker-48] worker exiting after 0 tasks
[DEBUG/PoolWorker-44] worker exiting after 1 tasks
[INFO/PoolWorker-45] process shutting down
[INFO/PoolWorker-46] process shutting down
[DEBUG/PoolWorker-42] worker exiting after 1 tasks
[DEBUG/MainProcess] result handler exiting: len(cache)=0, thread._state=0
[DEBUG/PoolWorker-43] worker exiting after 1 tasks
[INFO/PoolWorker-47] process shutting down
[DEBUG/PoolWorker-48] worker exiting after 0 tasks
[DEBUG/PoolWorker-44] worker exiting after 1 tasks
[INFO/PoolWorker-45] process shutting down
[INFO/PoolWorker-46] process shutting down
[DEBUG/PoolWorker-42] worker exiting after 1 tasks
[DEBUG/PoolWorker-43] worker exiting after 1 tasks
[DEBUG/MainProcess] result handler exiting: len(cache)=0, thread._state=0
[INFO/PoolWorker-47] process shutting down
[INFO/PoolWorker-46] process shutting down
[INFO/PoolWorker-45] process shutting down
[DEBUG/PoolWorker-42] worker exiting after 1 tasks
[INFO/PoolWorker-47] process shutting down
[INFO/PoolWorker-47] process shutting down
[DEBUG/PoolWorker-45] running all "atexit" finalizers with priority >= 0
[DEBUG/PoolWorker-46] running all "atexit" finalizers with priority >= 0
[INFO/PoolWorker-48] process shutting down
[INFO/PoolWorker-43] process shutting down
[INFO/PoolWorker-44] process shutting down
[INFO/PoolWorker-47] process shutting down
[DEBUG/PoolWorker-46] running all "atexit" finalizers with priority >= 0
[DEBUG/PoolWorker-45] running all "atexit" finalizers with priority >= 0
[INFO/PoolWorker-42] process shutting down
[INFO/PoolWorker-43] process shutting down
[INFO/PoolWorker-48] process shutting down
[INFO/PoolWorker-44] process shutting down
[DEBUG/PoolWorker-45] running all "atexit" finalizers with priority >= 0
[DEBUG/PoolWorker-46] running all "atexit" finalizers with priority >= 0
[INFO/PoolWorker-42] process shutting down
[INFO/PoolWorker-48] process shutting down
[INFO/PoolWorker-43] process shutting down
[DEBUG/PoolWorker-46] running all "atexit" finalizers with priority >= 0
[DEBUG/PoolWorker-45] running all "atexit" finalizers with priority >= 0
[DEBUG/PoolWorker-47] running all "atexit" finalizers with priority >= 0
[INFO/PoolWorker-44] process shutting down
[INFO/PoolWorker-42] process shutting down
[INFO/PoolWorker-48] process shutting down
[INFO/PoolWorker-43] process shutting down
[DEBUG/PoolWorker-45] running all "atexit" finalizers with priority >= 0
[DEBUG/PoolWorker-46] running all "atexit" finalizers with priority >= 0
[INFO/PoolWorker-42] process shutting down
[DEBUG/PoolWorker-47] running all "atexit" finalizers with priority >= 0
[INFO/PoolWorker-48] process shutting down
[INFO/PoolWorker-43] process shutting down
[INFO/PoolWorker-44] process shutting down
[DEBUG/PoolWorker-47] running all "atexit" finalizers with priority >= 0
[INFO/PoolWorker-42] process shutting down
[INFO/PoolWorker-44] process shutting down
[DEBUG/PoolWorker-47] running all "atexit" finalizers with priority >= 0
[DEBUG/PoolWorker-43] running all "atexit" finalizers with priority >= 0
[DEBUG/PoolWorker-48] running all "atexit" finalizers with priority >= 0
[DEBUG/PoolWorker-47] running all "atexit" finalizers with priority >= 0
[DEBUG/PoolWorker-42] running all "atexit" finalizers with priority >= 0
[DEBUG/PoolWorker-43] running all "atexit" finalizers with priority >= 0
[DEBUG/PoolWorker-48] running all "atexit" finalizers with priority >= 0
[DEBUG/PoolWorker-46] running the remaining "atexit" finalizers
[DEBUG/PoolWorker-45] running the remaining "atexit" finalizers
[DEBUG/PoolWorker-42] running all "atexit" finalizers with priority >= 0
[DEBUG/PoolWorker-48] running all "atexit" finalizers with priority >= 0
[DEBUG/PoolWorker-43] running all "atexit" finalizers with priority >= 0
[DEBUG/PoolWorker-44] running all "atexit" finalizers with priority >= 0
[DEBUG/PoolWorker-45] running the remaining "atexit" finalizers
[DEBUG/PoolWorker-46] running the remaining "atexit" finalizers
[DEBUG/PoolWorker-42] running all "atexit" finalizers with priority >= 0
[DEBUG/PoolWorker-43] running all "atexit" finalizers with priority >= 0
[DEBUG/PoolWorker-48] running all "atexit" finalizers with priority >= 0
[DEBUG/PoolWorker-45] running the remaining "atexit" finalizers
[DEBUG/PoolWorker-46] running the remaining "atexit" finalizers
[DEBUG/PoolWorker-44] running all "atexit" finalizers with priority >= 0
[DEBUG/PoolWorker-42] running all "atexit" finalizers with priority >= 0
[DEBUG/PoolWorker-43] running all "atexit" finalizers with priority >= 0
[DEBUG/PoolWorker-48] running all "atexit" finalizers with priority >= 0
[DEBUG/PoolWorker-47] running the remaining "atexit" finalizers
[DEBUG/PoolWorker-46] running the remaining "atexit" finalizers
[DEBUG/PoolWorker-45] running the remaining "atexit" finalizers
[DEBUG/PoolWorker-44] running all "atexit" finalizers with priority >= 0
[DEBUG/PoolWorker-42] running all "atexit" finalizers with priority >= 0
[DEBUG/PoolWorker-47] running the remaining "atexit" finalizers
[DEBUG/PoolWorker-46] running the remaining "atexit" finalizers
[DEBUG/PoolWorker-45] running the remaining "atexit" finalizers
[DEBUG/PoolWorker-44] running all "atexit" finalizers with priority >= 0
[DEBUG/PoolWorker-47] running the remaining "atexit" finalizers
[DEBUG/PoolWorker-47] running the remaining "atexit" finalizers
[DEBUG/PoolWorker-44] running all "atexit" finalizers with priority >= 0
[DEBUG/PoolWorker-43] running the remaining "atexit" finalizers
[DEBUG/PoolWorker-48] running the remaining "atexit" finalizers
[INFO/PoolWorker-45] process exiting with exitcode 0
[INFO/PoolWorker-46] process exiting with exitcode 0
[DEBUG/PoolWorker-47] running the remaining "atexit" finalizers
[DEBUG/PoolWorker-42] running the remaining "atexit" finalizers
[DEBUG/PoolWorker-43] running the remaining "atexit" finalizers
[DEBUG/PoolWorker-48] running the remaining "atexit" finalizers
[INFO/PoolWorker-45] process exiting with exitcode 0
[INFO/PoolWorker-46] process exiting with exitcode 0
[DEBUG/PoolWorker-42] running the remaining "atexit" finalizers
[DEBUG/PoolWorker-43] running the remaining "atexit" finalizers
[DEBUG/PoolWorker-48] running the remaining "atexit" finalizers
[INFO/PoolWorker-45] process exiting with exitcode 0
[INFO/PoolWorker-46] process exiting with exitcode 0
[DEBUG/PoolWorker-42] running the remaining "atexit" finalizers
[DEBUG/PoolWorker-48] running the remaining "atexit" finalizers
[DEBUG/PoolWorker-43] running the remaining "atexit" finalizers
[INFO/PoolWorker-45] process exiting with exitcode 0
[INFO/PoolWorker-46] process exiting with exitcode 0
[INFO/PoolWorker-47] process exiting with exitcode 0
[DEBUG/PoolWorker-44] running the remaining "atexit" finalizers
[DEBUG/PoolWorker-42] running the remaining "atexit" finalizers
[DEBUG/PoolWorker-48] running the remaining "atexit" finalizers
[DEBUG/PoolWorker-43] running the remaining "atexit" finalizers
[INFO/PoolWorker-46] process exiting with exitcode 0
[INFO/PoolWorker-45] process exiting with exitcode 0
[INFO/PoolWorker-47] process exiting with exitcode 0
[DEBUG/PoolWorker-44] running the remaining "atexit" finalizers
[DEBUG/PoolWorker-42] running the remaining "atexit" finalizers
[DEBUG/MainProcess] task handler exiting
[INFO/PoolWorker-47] process exiting with exitcode 0
[DEBUG/PoolWorker-44] running the remaining "atexit" finalizers
[INFO/PoolWorker-47] process exiting with exitcode 0
[DEBUG/MainProcess] task handler exiting
[DEBUG/PoolWorker-44] running the remaining "atexit" finalizers
[INFO/PoolWorker-48] process exiting with exitcode 0
[INFO/PoolWorker-43] process exiting with exitcode 0
[INFO/PoolWorker-47] process exiting with exitcode 0
[DEBUG/MainProcess] task handler exiting
[DEBUG/PoolWorker-44] running the remaining "atexit" finalizers
[INFO/PoolWorker-42] process exiting with exitcode 0
[INFO/PoolWorker-48] process exiting with exitcode 0
[INFO/PoolWorker-43] process exiting with exitcode 0
[DEBUG/MainProcess] task handler exiting
[INFO/PoolWorker-43] process exiting with exitcode 0
[INFO/PoolWorker-48] process exiting with exitcode 0
[DEBUG/MainProcess] task handler exiting
[INFO/PoolWorker-42] process exiting with exitcode 0
[INFO/PoolWorker-48] process exiting with exitcode 0
[INFO/PoolWorker-43] process exiting with exitcode 0
[DEBUG/MainProcess] task handler exiting
[INFO/PoolWorker-44] process exiting with exitcode 0
[INFO/PoolWorker-48] process exiting with exitcode 0
[INFO/PoolWorker-43] process exiting with exitcode 0
[INFO/PoolWorker-42] process exiting with exitcode 0
[INFO/PoolWorker-44] process exiting with exitcode 0
[INFO/PoolWorker-42] process exiting with exitcode 0
[INFO/PoolWorker-44] process exiting with exitcode 0
[INFO/PoolWorker-44] process exiting with exitcode 0
[INFO/PoolWorker-42] process exiting with exitcode 0
[INFO/PoolWorker-44] process exiting with exitcode 0
[DEBUG/PoolWorker-41] worker got sentinel -- exiting
[DEBUG/PoolWorker-41] worker got sentinel -- exiting
[DEBUG/PoolWorker-41] worker got sentinel -- exiting
[DEBUG/PoolWorker-41] worker got sentinel -- exiting
[DEBUG/PoolWorker-41] worker got sentinel -- exiting
[DEBUG/PoolWorker-41] worker exiting after 1 tasks
[DEBUG/PoolWorker-41] worker exiting after 1 tasks
[DEBUG/PoolWorker-41] worker exiting after 1 tasks
[DEBUG/PoolWorker-41] worker exiting after 1 tasks
[DEBUG/PoolWorker-41] worker exiting after 1 tasks
[INFO/PoolWorker-41] process shutting down
[INFO/PoolWorker-41] process shutting down
[INFO/PoolWorker-41] process shutting down
[INFO/PoolWorker-41] process shutting down
[INFO/PoolWorker-41] process shutting down
[DEBUG/PoolWorker-41] running all "atexit" finalizers with priority >= 0
[DEBUG/PoolWorker-41] running all "atexit" finalizers with priority >= 0
[DEBUG/PoolWorker-41] running all "atexit" finalizers with priority >= 0
[DEBUG/PoolWorker-41] running all "atexit" finalizers with priority >= 0
[DEBUG/PoolWorker-41] running all "atexit" finalizers with priority >= 0
[DEBUG/PoolWorker-41] running the remaining "atexit" finalizers
[DEBUG/PoolWorker-41] running the remaining "atexit" finalizers
[DEBUG/PoolWorker-41] running the remaining "atexit" finalizers
[DEBUG/PoolWorker-41] running the remaining "atexit" finalizers
[DEBUG/PoolWorker-41] running the remaining "atexit" finalizers
[INFO/PoolWorker-41] process exiting with exitcode 0
[INFO/PoolWorker-41] process exiting with exitcode 0
[INFO/PoolWorker-41] process exiting with exitcode 0
[INFO/PoolWorker-41] process exiting with exitcode 0
[INFO/PoolWorker-41] process exiting with exitcode 0
[DEBUG/MainProcess] finalizing pool
[DEBUG/MainProcess] finalizing pool
[DEBUG/MainProcess] finalizing pool
[DEBUG/MainProcess] finalizing pool
[DEBUG/MainProcess] finalizing pool
[DEBUG/MainProcess] finalizing pool
[DEBUG/MainProcess] helping task handler/workers to finish
[DEBUG/MainProcess] helping task handler/workers to finish
[DEBUG/MainProcess] helping task handler/workers to finish
[DEBUG/MainProcess] helping task handler/workers to finish
[DEBUG/MainProcess] helping task handler/workers to finish
[DEBUG/MainProcess] helping task handler/workers to finish
[DEBUG/MainProcess] removing tasks from inqueue until task handler finished
[DEBUG/MainProcess] removing tasks from inqueue until task handler finished
[DEBUG/MainProcess] removing tasks from inqueue until task handler finished
[DEBUG/MainProcess] removing tasks from inqueue until task handler finished
[DEBUG/MainProcess] removing tasks from inqueue until task handler finished
[DEBUG/MainProcess] removing tasks from inqueue until task handler finished
[DEBUG/MainProcess] joining worker handler
[DEBUG/MainProcess] joining worker handler
[DEBUG/MainProcess] joining worker handler
[DEBUG/MainProcess] joining worker handler
[DEBUG/MainProcess] joining worker handler
[DEBUG/MainProcess] joining worker handler
[DEBUG/MainProcess] terminating workers
[DEBUG/MainProcess] terminating workers
[DEBUG/MainProcess] terminating workers
[DEBUG/MainProcess] terminating workers
[DEBUG/MainProcess] terminating workers
[DEBUG/MainProcess] terminating workers
[DEBUG/MainProcess] joining task handler
[DEBUG/MainProcess] joining task handler
[DEBUG/MainProcess] joining task handler
[DEBUG/MainProcess] joining task handler
[DEBUG/MainProcess] joining task handler
[DEBUG/MainProcess] joining task handler
[DEBUG/MainProcess] joining result handler
[DEBUG/MainProcess] joining result handler
[DEBUG/MainProcess] joining result handler
[DEBUG/MainProcess] joining result handler
[DEBUG/MainProcess] joining result handler
[DEBUG/MainProcess] joining result handler
[DEBUG/MainProcess] joining pool workers
[DEBUG/MainProcess] joining pool workers
[DEBUG/MainProcess] joining pool workers
[DEBUG/MainProcess] joining pool workers
[DEBUG/MainProcess] joining pool workers
[DEBUG/MainProcess] joining pool workers
ok
test_lowcloud_filter_single_lwp_nofog (fogpy.test.test_filters.Test_LowCloudFilter) ... [DEBUG/MainProcess] created semlock with handle 140502249340928
[DEBUG/MainProcess] created semlock with handle 140502249340928
[DEBUG/MainProcess] created semlock with handle 140502249340928
[DEBUG/MainProcess] created semlock with handle 140502249340928
[DEBUG/MainProcess] created semlock with handle 140502249340928
[DEBUG/MainProcess] created semlock with handle 140502249340928
[DEBUG/MainProcess] created semlock with handle 140502234558464
[DEBUG/MainProcess] created semlock with handle 140502234558464
[DEBUG/MainProcess] created semlock with handle 140502234558464
[DEBUG/MainProcess] created semlock with handle 140502234558464
[DEBUG/MainProcess] created semlock with handle 140502234558464
[DEBUG/MainProcess] created semlock with handle 140502234558464
[DEBUG/MainProcess] created semlock with handle 140502234554368
[DEBUG/MainProcess] created semlock with handle 140502234554368
[DEBUG/MainProcess] created semlock with handle 140502234554368
[DEBUG/MainProcess] created semlock with handle 140502234554368
[DEBUG/MainProcess] created semlock with handle 140502234554368
[DEBUG/MainProcess] created semlock with handle 140502234554368
[DEBUG/MainProcess] created semlock with handle 140502234550272
[DEBUG/MainProcess] created semlock with handle 140502234550272
[DEBUG/MainProcess] created semlock with handle 140502234550272
[DEBUG/MainProcess] created semlock with handle 140502234550272
[DEBUG/MainProcess] created semlock with handle 140502234550272
[DEBUG/MainProcess] created semlock with handle 140502234550272
[DEBUG/MainProcess] added worker
[DEBUG/MainProcess] added worker
[DEBUG/MainProcess] added worker
[DEBUG/MainProcess] added worker
[DEBUG/MainProcess] added worker
[DEBUG/MainProcess] added worker
[INFO/PoolWorker-49] child process calling self.run()
[INFO/PoolWorker-49] child process calling self.run()
[INFO/PoolWorker-49] child process calling self.run()
[INFO/PoolWorker-49] child process calling self.run()
[INFO/PoolWorker-49] child process calling self.run()
[INFO/PoolWorker-49] child process calling self.run()
[DEBUG/MainProcess] added worker
[DEBUG/MainProcess] added worker
[DEBUG/MainProcess] added worker
[DEBUG/MainProcess] added worker
[DEBUG/MainProcess] added worker
[DEBUG/MainProcess] added worker
[INFO/PoolWorker-50] child process calling self.run()
[INFO/PoolWorker-50] child process calling self.run()
[INFO/PoolWorker-50] child process calling self.run()
[INFO/PoolWorker-50] child process calling self.run()
[INFO/PoolWorker-50] child process calling self.run()
[INFO/PoolWorker-50] child process calling self.run()
[DEBUG/MainProcess] added worker
[DEBUG/MainProcess] added worker
[DEBUG/MainProcess] added worker
[DEBUG/MainProcess] added worker
[DEBUG/MainProcess] added worker
[DEBUG/MainProcess] added worker
[INFO/PoolWorker-51] child process calling self.run()
[INFO/PoolWorker-51] child process calling self.run()
[INFO/PoolWorker-51] child process calling self.run()
[INFO/PoolWorker-51] child process calling self.run()
[INFO/PoolWorker-51] child process calling self.run()
[INFO/PoolWorker-51] child process calling self.run()
[DEBUG/MainProcess] added worker
[DEBUG/MainProcess] added worker
[DEBUG/MainProcess] added worker
[DEBUG/MainProcess] added worker
[DEBUG/MainProcess] added worker
[DEBUG/MainProcess] added worker
[INFO/PoolWorker-52] child process calling self.run()
[INFO/PoolWorker-52] child process calling self.run()
[INFO/PoolWorker-52] child process calling self.run()
[INFO/PoolWorker-52] child process calling self.run()
[INFO/PoolWorker-52] child process calling self.run()
[INFO/PoolWorker-52] child process calling self.run()
[DEBUG/MainProcess] added worker
[DEBUG/MainProcess] added worker
[DEBUG/MainProcess] added worker
[DEBUG/MainProcess] added worker
[DEBUG/MainProcess] added worker
[DEBUG/MainProcess] added worker
[INFO/PoolWorker-53] child process calling self.run()
[INFO/PoolWorker-53] child process calling self.run()
[INFO/PoolWorker-53] child process calling self.run()
[INFO/PoolWorker-53] child process calling self.run()
[INFO/PoolWorker-53] child process calling self.run()
[INFO/PoolWorker-53] child process calling self.run()
[DEBUG/MainProcess] added worker
[DEBUG/MainProcess] added worker
[DEBUG/MainProcess] added worker
[DEBUG/MainProcess] added worker
[DEBUG/MainProcess] added worker
[DEBUG/MainProcess] added worker
[INFO/PoolWorker-54] child process calling self.run()
[INFO/PoolWorker-54] child process calling self.run()
[INFO/PoolWorker-54] child process calling self.run()
[INFO/PoolWorker-54] child process calling self.run()
[INFO/PoolWorker-54] child process calling self.run()
[INFO/PoolWorker-54] child process calling self.run()
[DEBUG/MainProcess] added worker
[DEBUG/MainProcess] added worker
[DEBUG/MainProcess] added worker
[DEBUG/MainProcess] added worker
[DEBUG/MainProcess] added worker
[DEBUG/MainProcess] added worker
[INFO/PoolWorker-55] child process calling self.run()
[INFO/PoolWorker-55] child process calling self.run()
[INFO/PoolWorker-55] child process calling self.run()
[INFO/PoolWorker-55] child process calling self.run()
[INFO/PoolWorker-55] child process calling self.run()
[INFO/PoolWorker-55] child process calling self.run()
[DEBUG/MainProcess] added worker
[DEBUG/MainProcess] added worker
[DEBUG/MainProcess] added worker
[DEBUG/MainProcess] added worker
[DEBUG/MainProcess] added worker
[DEBUG/MainProcess] added worker
[INFO/PoolWorker-56] child process calling self.run()
[INFO/PoolWorker-56] child process calling self.run()
[INFO/PoolWorker-56] child process calling self.run()
[INFO/PoolWorker-56] child process calling self.run()
[INFO/PoolWorker-56] child process calling self.run()
[INFO/PoolWorker-56] child process calling self.run()
/media/nas/x21324/miniconda3/envs/py27b/lib/python2.7/site-packages/scipy/optimize/_minimize.py:517: RuntimeWarning: Method BFGS cannot handle constraints nor bounds.
RuntimeWarning)
/media/nas/x21324/miniconda3/envs/py27b/lib/python2.7/site-packages/scipy/optimize/_minimize.py:517: RuntimeWarning: Method BFGS cannot handle constraints nor bounds.
RuntimeWarning)
/media/nas/x21324/miniconda3/envs/py27b/lib/python2.7/site-packages/scipy/optimize/_minimize.py:517: RuntimeWarning: Method BFGS cannot handle constraints nor bounds.
RuntimeWarning)
/media/nas/x21324/miniconda3/envs/py27b/lib/python2.7/site-packages/scipy/optimize/_minimize.py:517: RuntimeWarning: Method BFGS cannot handle constraints nor bounds.
RuntimeWarning)
[DEBUG/MainProcess] closing pool
[DEBUG/MainProcess] closing pool
[DEBUG/MainProcess] closing pool
[DEBUG/MainProcess] closing pool
[DEBUG/MainProcess] closing pool
[DEBUG/MainProcess] closing pool
[DEBUG/MainProcess] closing pool
[DEBUG/MainProcess] joining pool
[DEBUG/MainProcess] joining pool
[DEBUG/MainProcess] joining pool
[DEBUG/MainProcess] joining pool
[DEBUG/MainProcess] joining pool
[DEBUG/MainProcess] joining pool
[DEBUG/MainProcess] joining pool
[DEBUG/MainProcess] worker handler exiting
[DEBUG/MainProcess] worker handler exiting
[DEBUG/MainProcess] task handler got sentinel
[DEBUG/MainProcess] worker handler exiting
[DEBUG/MainProcess] task handler got sentinel
[DEBUG/MainProcess] worker handler exiting
[DEBUG/MainProcess] task handler got sentinel
[DEBUG/MainProcess] worker handler exiting
[DEBUG/MainProcess] task handler got sentinel
[DEBUG/MainProcess] task handler got sentinel
[DEBUG/MainProcess] worker handler exiting
[DEBUG/MainProcess] worker handler exiting
[DEBUG/MainProcess] task handler got sentinel
[DEBUG/MainProcess] task handler got sentinel
[DEBUG/MainProcess] task handler sending sentinel to result handler
[DEBUG/MainProcess] task handler sending sentinel to result handler
[DEBUG/MainProcess] task handler sending sentinel to result handler
[DEBUG/MainProcess] task handler sending sentinel to result handler
[DEBUG/MainProcess] task handler sending sentinel to result handler
[DEBUG/MainProcess] task handler sending sentinel to result handler
[DEBUG/MainProcess] task handler sending sentinel to result handler
[DEBUG/MainProcess] task handler sending sentinel to workers
[DEBUG/MainProcess] result handler got sentinel
[DEBUG/MainProcess] task handler sending sentinel to workers
[DEBUG/MainProcess] task handler sending sentinel to workers
[DEBUG/MainProcess] result handler got sentinel
[DEBUG/MainProcess] result handler got sentinel
[DEBUG/MainProcess] task handler sending sentinel to workers
[DEBUG/MainProcess] task handler sending sentinel to workers
[DEBUG/MainProcess] result handler got sentinel
[DEBUG/MainProcess] result handler got sentinel
[DEBUG/MainProcess] task handler sending sentinel to workers
[DEBUG/MainProcess] task handler sending sentinel to workers
[DEBUG/MainProcess] result handler got sentinel
[DEBUG/MainProcess] result handler got sentinel
[DEBUG/PoolWorker-53] worker got sentinel -- exiting
[DEBUG/MainProcess] ensuring that outqueue is not full
[DEBUG/PoolWorker-53] worker got sentinel -- exiting
[DEBUG/PoolWorker-54] worker got sentinel -- exiting
[DEBUG/MainProcess] ensuring that outqueue is not full
[DEBUG/PoolWorker-53] worker got sentinel -- exiting
[DEBUG/PoolWorker-54] worker got sentinel -- exiting
[DEBUG/PoolWorker-53] worker got sentinel -- exiting
[DEBUG/MainProcess] ensuring that outqueue is not full
[DEBUG/PoolWorker-54] worker got sentinel -- exiting
[DEBUG/PoolWorker-53] worker got sentinel -- exiting
[DEBUG/MainProcess] ensuring that outqueue is not full
[DEBUG/PoolWorker-54] worker got sentinel -- exiting
[DEBUG/PoolWorker-55] worker got sentinel -- exiting
[DEBUG/PoolWorker-53] worker got sentinel -- exiting
[DEBUG/MainProcess] ensuring that outqueue is not full
[DEBUG/PoolWorker-54] worker got sentinel -- exiting
[DEBUG/PoolWorker-55] worker got sentinel -- exiting
[DEBUG/MainProcess] ensuring that outqueue is not full
[DEBUG/PoolWorker-55] worker got sentinel -- exiting
[DEBUG/PoolWorker-56] worker got sentinel -- exiting
[DEBUG/PoolWorker-54] worker got sentinel -- exiting
[DEBUG/PoolWorker-55] worker got sentinel -- exiting
[DEBUG/PoolWorker-50] worker got sentinel -- exiting
[DEBUG/PoolWorker-53] worker exiting after 0 tasks
[DEBUG/MainProcess] ensuring that outqueue is not full
[DEBUG/PoolWorker-55] worker got sentinel -- exiting
[DEBUG/PoolWorker-56] worker got sentinel -- exiting
[DEBUG/PoolWorker-50] worker got sentinel -- exiting
[DEBUG/PoolWorker-53] worker exiting after 0 tasks
[DEBUG/PoolWorker-55] worker got sentinel -- exiting
[DEBUG/PoolWorker-50] worker got sentinel -- exiting
[DEBUG/PoolWorker-56] worker got sentinel -- exiting
[DEBUG/PoolWorker-53] worker exiting after 0 tasks
[DEBUG/PoolWorker-54] worker exiting after 0 tasks
[DEBUG/PoolWorker-50] worker got sentinel -- exiting
[DEBUG/PoolWorker-53] worker exiting after 0 tasks
[DEBUG/PoolWorker-56] worker got sentinel -- exiting
[DEBUG/MainProcess] result handler exiting: len(cache)=0, thread._state=0
[DEBUG/PoolWorker-54] worker exiting after 0 tasks
[DEBUG/PoolWorker-50] worker got sentinel -- exiting
[DEBUG/PoolWorker-53] worker exiting after 0 tasks
[DEBUG/PoolWorker-55] worker exiting after 0 tasks
[DEBUG/PoolWorker-56] worker got sentinel -- exiting
[DEBUG/PoolWorker-50] worker got sentinel -- exiting
[DEBUG/MainProcess] result handler exiting: len(cache)=0, thread._state=0
[DEBUG/PoolWorker-53] worker exiting after 0 tasks
[DEBUG/PoolWorker-54] worker exiting after 0 tasks
[DEBUG/PoolWorker-55] worker exiting after 0 tasks
[DEBUG/PoolWorker-56] worker got sentinel -- exiting
[DEBUG/PoolWorker-55] worker exiting after 0 tasks
[DEBUG/MainProcess] result handler exiting: len(cache)=0, thread._state=0
[DEBUG/PoolWorker-54] worker exiting after 0 tasks
[DEBUG/PoolWorker-55] worker exiting after 0 tasks
[DEBUG/PoolWorker-50] worker exiting after 1 tasks
[DEBUG/MainProcess] result handler exiting: len(cache)=0, thread._state=0
[DEBUG/PoolWorker-54] worker exiting after 0 tasks
[DEBUG/PoolWorker-55] worker exiting after 0 tasks
[DEBUG/PoolWorker-50] worker exiting after 1 tasks
[INFO/PoolWorker-53] process shutting down
[DEBUG/MainProcess] result handler exiting: len(cache)=0, thread._state=0
[DEBUG/PoolWorker-54] worker exiting after 0 tasks
[DEBUG/PoolWorker-55] worker exiting after 0 tasks
[DEBUG/PoolWorker-50] worker exiting after 1 tasks
[DEBUG/PoolWorker-56] worker exiting after 0 tasks
[INFO/PoolWorker-53] process shutting down
[DEBUG/MainProcess] result handler exiting: len(cache)=0, thread._state=0
[DEBUG/PoolWorker-50] worker exiting after 1 tasks
[INFO/PoolWorker-53] process shutting down
[DEBUG/PoolWorker-56] worker exiting after 0 tasks
[DEBUG/PoolWorker-50] worker exiting after 1 tasks
[INFO/PoolWorker-53] process shutting down
[DEBUG/MainProcess] result handler exiting: len(cache)=0, thread._state=0
[DEBUG/PoolWorker-56] worker exiting after 0 tasks
[DEBUG/PoolWorker-50] worker exiting after 1 tasks
[INFO/PoolWorker-53] process shutting down
[INFO/PoolWorker-55] process shutting down
[INFO/PoolWorker-54] process shutting down
[DEBUG/PoolWorker-56] worker exiting after 0 tasks
[INFO/PoolWorker-53] process shutting down
[INFO/PoolWorker-55] process shutting down
[INFO/PoolWorker-54] process shutting down
[DEBUG/PoolWorker-56] worker exiting after 0 tasks
[INFO/PoolWorker-55] process shutting down
[INFO/PoolWorker-50] process shutting down
[INFO/PoolWorker-55] process shutting down
[INFO/PoolWorker-54] process shutting down
[DEBUG/PoolWorker-56] worker exiting after 0 tasks
[INFO/PoolWorker-55] process shutting down
[INFO/PoolWorker-50] process shutting down
[DEBUG/PoolWorker-53] running all "atexit" finalizers with priority >= 0
[INFO/PoolWorker-54] process shutting down
[INFO/PoolWorker-55] process shutting down
[INFO/PoolWorker-50] process shutting down
[DEBUG/PoolWorker-53] running all "atexit" finalizers with priority >= 0
[INFO/PoolWorker-54] process shutting down
[INFO/PoolWorker-50] process shutting down
[INFO/PoolWorker-50] process shutting down
[DEBUG/PoolWorker-53] running all "atexit" finalizers with priority >= 0
[INFO/PoolWorker-54] process shutting down
[INFO/PoolWorker-56] process shutting down
[DEBUG/PoolWorker-55] running all "atexit" finalizers with priority >= 0
[INFO/PoolWorker-50] process shutting down
[DEBUG/PoolWorker-53] running all "atexit" finalizers with priority >= 0
[DEBUG/PoolWorker-55] running all "atexit" finalizers with priority >= 0
[INFO/PoolWorker-56] process shutting down
[DEBUG/PoolWorker-55] running all "atexit" finalizers with priority >= 0
[DEBUG/PoolWorker-53] running all "atexit" finalizers with priority >= 0
[INFO/PoolWorker-56] process shutting down
[DEBUG/PoolWorker-54] running all "atexit" finalizers with priority >= 0
[DEBUG/PoolWorker-50] running all "atexit" finalizers with priority >= 0
[DEBUG/PoolWorker-55] running all "atexit" finalizers with priority >= 0
[DEBUG/PoolWorker-53] running all "atexit" finalizers with priority >= 0
[INFO/PoolWorker-56] process shutting down
[DEBUG/PoolWorker-55] running all "atexit" finalizers with priority >= 0
[DEBUG/PoolWorker-50] running all "atexit" finalizers with priority >= 0
[DEBUG/PoolWorker-54] running all "atexit" finalizers with priority >= 0
[DEBUG/PoolWorker-55] running all "atexit" finalizers with priority >= 0
[DEBUG/PoolWorker-50] running all "atexit" finalizers with priority >= 0
[INFO/PoolWorker-56] process shutting down
[DEBUG/PoolWorker-54] running all "atexit" finalizers with priority >= 0
[DEBUG/PoolWorker-50] running all "atexit" finalizers with priority >= 0
[INFO/PoolWorker-56] process shutting down
[DEBUG/PoolWorker-54] running all "atexit" finalizers with priority >= 0
[DEBUG/PoolWorker-50] running all "atexit" finalizers with priority >= 0
[DEBUG/PoolWorker-50] running all "atexit" finalizers with priority >= 0
[DEBUG/PoolWorker-53] running the remaining "atexit" finalizers
[DEBUG/PoolWorker-54] running all "atexit" finalizers with priority >= 0
[DEBUG/PoolWorker-55] running the remaining "atexit" finalizers
[DEBUG/PoolWorker-53] running the remaining "atexit" finalizers
[DEBUG/PoolWorker-54] running all "atexit" finalizers with priority >= 0
[DEBUG/PoolWorker-56] running all "atexit" finalizers with priority >= 0
[DEBUG/PoolWorker-55] running the remaining "atexit" finalizers
[DEBUG/PoolWorker-53] running the remaining "atexit" finalizers
[DEBUG/PoolWorker-56] running all "atexit" finalizers with priority >= 0
[DEBUG/PoolWorker-55] running the remaining "atexit" finalizers
[DEBUG/PoolWorker-50] running the remaining "atexit" finalizers
[DEBUG/PoolWorker-53] running the remaining "atexit" finalizers
[DEBUG/PoolWorker-55] running the remaining "atexit" finalizers
[DEBUG/PoolWorker-56] running all "atexit" finalizers with priority >= 0
[DEBUG/PoolWorker-50] running the remaining "atexit" finalizers
[DEBUG/PoolWorker-55] running the remaining "atexit" finalizers
[DEBUG/PoolWorker-53] running the remaining "atexit" finalizers
[DEBUG/PoolWorker-50] running the remaining "atexit" finalizers
[DEBUG/PoolWorker-56] running all "atexit" finalizers with priority >= 0
[DEBUG/PoolWorker-54] running the remaining "atexit" finalizers
[DEBUG/PoolWorker-55] running the remaining "atexit" finalizers
[DEBUG/PoolWorker-50] running the remaining "atexit" finalizers
[DEBUG/PoolWorker-53] running the remaining "atexit" finalizers
[DEBUG/PoolWorker-56] running all "atexit" finalizers with priority >= 0
[DEBUG/PoolWorker-54] running the remaining "atexit" finalizers
[DEBUG/PoolWorker-50] running the remaining "atexit" finalizers
[DEBUG/PoolWorker-56] running all "atexit" finalizers with priority >= 0
[DEBUG/PoolWorker-50] running the remaining "atexit" finalizers
[DEBUG/PoolWorker-54] running the remaining "atexit" finalizers
[INFO/PoolWorker-55] process exiting with exitcode 0
[DEBUG/PoolWorker-54] running the remaining "atexit" finalizers
[INFO/PoolWorker-55] process exiting with exitcode 0
[INFO/PoolWorker-53] process exiting with exitcode 0
[INFO/PoolWorker-55] process exiting with exitcode 0
[DEBUG/PoolWorker-54] running the remaining "atexit" finalizers
[INFO/PoolWorker-50] process exiting with exitcode 0
[INFO/PoolWorker-53] process exiting with exitcode 0
[INFO/PoolWorker-55] process exiting with exitcode 0
[INFO/PoolWorker-50] process exiting with exitcode 0
[DEBUG/PoolWorker-54] running the remaining "atexit" finalizers
[DEBUG/PoolWorker-56] running the remaining "atexit" finalizers
[INFO/PoolWorker-53] process exiting with exitcode 0
[INFO/PoolWorker-50] process exiting with exitcode 0
[INFO/PoolWorker-55] process exiting with exitcode 0
[INFO/PoolWorker-55] process exiting with exitcode 0
[INFO/PoolWorker-50] process exiting with exitcode 0
[INFO/PoolWorker-53] process exiting with exitcode 0
[DEBUG/PoolWorker-56] running the remaining "atexit" finalizers
[INFO/PoolWorker-50] process exiting with exitcode 0
[INFO/PoolWorker-53] process exiting with exitcode 0
[INFO/PoolWorker-54] process exiting with exitcode 0
[DEBUG/MainProcess] task handler exiting
[DEBUG/PoolWorker-56] running the remaining "atexit" finalizers
[INFO/PoolWorker-53] process exiting with exitcode 0
[INFO/PoolWorker-54] process exiting with exitcode 0
[DEBUG/MainProcess] task handler exiting
[DEBUG/PoolWorker-56] running the remaining "atexit" finalizers
[INFO/PoolWorker-50] process exiting with exitcode 0
[INFO/PoolWorker-54] process exiting with exitcode 0
[DEBUG/MainProcess] task handler exiting
[DEBUG/PoolWorker-56] running the remaining "atexit" finalizers
[DEBUG/PoolWorker-51] worker got sentinel -- exiting
[INFO/PoolWorker-54] process exiting with exitcode 0
[DEBUG/MainProcess] task handler exiting
[DEBUG/PoolWorker-56] running the remaining "atexit" finalizers
[DEBUG/PoolWorker-51] worker got sentinel -- exiting
[DEBUG/PoolWorker-49] worker got sentinel -- exiting
[INFO/PoolWorker-54] process exiting with exitcode 0
[DEBUG/MainProcess] task handler exiting
[DEBUG/PoolWorker-51] worker got sentinel -- exiting
[INFO/PoolWorker-54] process exiting with exitcode 0
[DEBUG/MainProcess] task handler exiting
[DEBUG/PoolWorker-51] worker got sentinel -- exiting
[DEBUG/PoolWorker-49] worker got sentinel -- exiting
[DEBUG/MainProcess] task handler exiting
[DEBUG/PoolWorker-51] worker got sentinel -- exiting
[INFO/PoolWorker-56] process exiting with exitcode 0
[DEBUG/PoolWorker-49] worker got sentinel -- exiting
[DEBUG/PoolWorker-51] worker got sentinel -- exiting
[INFO/PoolWorker-56] process exiting with exitcode 0
[DEBUG/PoolWorker-49] worker got sentinel -- exiting
[INFO/PoolWorker-56] process exiting with exitcode 0
[INFO/PoolWorker-56] process exiting with exitcode 0
[DEBUG/PoolWorker-49] worker got sentinel -- exiting
[DEBUG/PoolWorker-51] worker exiting after 1 tasks
[INFO/PoolWorker-56] process exiting with exitcode 0
[DEBUG/PoolWorker-51] worker exiting after 1 tasks
[INFO/PoolWorker-56] process exiting with exitcode 0
[DEBUG/PoolWorker-49] worker got sentinel -- exiting
[DEBUG/PoolWorker-51] worker exiting after 1 tasks
[DEBUG/PoolWorker-51] worker exiting after 1 tasks
[DEBUG/PoolWorker-52] worker got sentinel -- exiting
[DEBUG/PoolWorker-51] worker exiting after 1 tasks
[DEBUG/PoolWorker-49] worker exiting after 1 tasks
[DEBUG/PoolWorker-52] worker got sentinel -- exiting
[DEBUG/PoolWorker-51] worker exiting after 1 tasks
[DEBUG/PoolWorker-49] worker exiting after 1 tasks
[DEBUG/PoolWorker-52] worker got sentinel -- exiting
[DEBUG/PoolWorker-49] worker exiting after 1 tasks
[DEBUG/PoolWorker-52] worker got sentinel -- exiting
[DEBUG/PoolWorker-49] worker exiting after 1 tasks
[DEBUG/PoolWorker-52] worker got sentinel -- exiting
[INFO/PoolWorker-51] process shutting down
[DEBUG/PoolWorker-49] worker exiting after 1 tasks
[DEBUG/PoolWorker-52] worker got sentinel -- exiting
[INFO/PoolWorker-51] process shutting down
[DEBUG/PoolWorker-49] worker exiting after 1 tasks
[INFO/PoolWorker-51] process shutting down
[DEBUG/PoolWorker-52] worker exiting after 1 tasks
[INFO/PoolWorker-51] process shutting down
[INFO/PoolWorker-49] process shutting down
[DEBUG/PoolWorker-52] worker exiting after 1 tasks
[INFO/PoolWorker-51] process shutting down
[INFO/PoolWorker-49] process shutting down
[DEBUG/PoolWorker-52] worker exiting after 1 tasks
[INFO/PoolWorker-51] process shutting down
[INFO/PoolWorker-49] process shutting down
[DEBUG/PoolWorker-52] worker exiting after 1 tasks
[INFO/PoolWorker-49] process shutting down
[DEBUG/PoolWorker-52] worker exiting after 1 tasks
[INFO/PoolWorker-49] process shutting down
[DEBUG/PoolWorker-52] worker exiting after 1 tasks
[DEBUG/PoolWorker-51] running all "atexit" finalizers with priority >= 0
[INFO/PoolWorker-49] process shutting down
[DEBUG/PoolWorker-51] running all "atexit" finalizers with priority >= 0
[DEBUG/PoolWorker-51] running all "atexit" finalizers with priority >= 0
[INFO/PoolWorker-52] process shutting down
[DEBUG/PoolWorker-49] running all "atexit" finalizers with priority >= 0
[DEBUG/PoolWorker-51] running all "atexit" finalizers with priority >= 0
[INFO/PoolWorker-52] process shutting down
[DEBUG/PoolWorker-49] running all "atexit" finalizers with priority >= 0
[DEBUG/PoolWorker-51] running all "atexit" finalizers with priority >= 0
[INFO/PoolWorker-52] process shutting down
[DEBUG/PoolWorker-49] running all "atexit" finalizers with priority >= 0
[DEBUG/PoolWorker-51] running all "atexit" finalizers with priority >= 0
[INFO/PoolWorker-52] process shutting down
[DEBUG/PoolWorker-49] running all "atexit" finalizers with priority >= 0
[INFO/PoolWorker-52] process shutting down
[DEBUG/PoolWorker-49] running all "atexit" finalizers with priority >= 0
[INFO/PoolWorker-52] process shutting down
[DEBUG/PoolWorker-49] running all "atexit" finalizers with priority >= 0
[DEBUG/PoolWorker-51] running the remaining "atexit" finalizers
[DEBUG/PoolWorker-51] running the remaining "atexit" finalizers
[DEBUG/PoolWorker-52] running all "atexit" finalizers with priority >= 0
[DEBUG/PoolWorker-51] running the remaining "atexit" finalizers
[DEBUG/PoolWorker-52] running all "atexit" finalizers with priority >= 0
[DEBUG/PoolWorker-49] running the remaining "atexit" finalizers
[DEBUG/PoolWorker-51] running the remaining "atexit" finalizers
[DEBUG/PoolWorker-52] running all "atexit" finalizers with priority >= 0
[DEBUG/PoolWorker-49] running the remaining "atexit" finalizers
[DEBUG/PoolWorker-51] running the remaining "atexit" finalizers
[DEBUG/PoolWorker-52] running all "atexit" finalizers with priority >= 0
[DEBUG/PoolWorker-49] running the remaining "atexit" finalizers
[DEBUG/PoolWorker-51] running the remaining "atexit" finalizers
[DEBUG/PoolWorker-52] running all "atexit" finalizers with priority >= 0
[DEBUG/PoolWorker-49] running the remaining "atexit" finalizers
[DEBUG/PoolWorker-52] running all "atexit" finalizers with priority >= 0
[DEBUG/PoolWorker-49] running the remaining "atexit" finalizers
[INFO/PoolWorker-51] process exiting with exitcode 0
[DEBUG/PoolWorker-49] running the remaining "atexit" finalizers
[INFO/PoolWorker-51] process exiting with exitcode 0
[DEBUG/PoolWorker-52] running the remaining "atexit" finalizers
[INFO/PoolWorker-51] process exiting with exitcode 0
[INFO/PoolWorker-49] process exiting with exitcode 0
[DEBUG/PoolWorker-52] running the remaining "atexit" finalizers
[INFO/PoolWorker-51] process exiting with exitcode 0
[INFO/PoolWorker-49] process exiting with exitcode 0
[DEBUG/PoolWorker-52] running the remaining "atexit" finalizers
[INFO/PoolWorker-51] process exiting with exitcode 0
[INFO/PoolWorker-49] process exiting with exitcode 0
[DEBUG/PoolWorker-52] running the remaining "atexit" finalizers
[INFO/PoolWorker-51] process exiting with exitcode 0
[INFO/PoolWorker-49] process exiting with exitcode 0
[DEBUG/PoolWorker-52] running the remaining "atexit" finalizers
[INFO/PoolWorker-49] process exiting with exitcode 0
[DEBUG/PoolWorker-52] running the remaining "atexit" finalizers
[INFO/PoolWorker-49] process exiting with exitcode 0
[INFO/PoolWorker-52] process exiting with exitcode 0
[INFO/PoolWorker-52] process exiting with exitcode 0
[INFO/PoolWorker-52] process exiting with exitcode 0
[INFO/PoolWorker-52] process exiting with exitcode 0
[INFO/PoolWorker-52] process exiting with exitcode 0
[INFO/PoolWorker-52] process exiting with exitcode 0
/home/gholl/checkouts/fogpy/fogpy/filters.py:949: RuntimeWarning: invalid value encountered in greater
| np.isnan(self.fbh)] = True
[DEBUG/MainProcess] finalizing pool
[DEBUG/MainProcess] finalizing pool
[DEBUG/MainProcess] finalizing pool
[DEBUG/MainProcess] finalizing pool
[DEBUG/MainProcess] finalizing pool
[DEBUG/MainProcess] finalizing pool
[DEBUG/MainProcess] finalizing pool
[DEBUG/MainProcess] helping task handler/workers to finish
[DEBUG/MainProcess] helping task handler/workers to finish
[DEBUG/MainProcess] helping task handler/workers to finish
[DEBUG/MainProcess] helping task handler/workers to finish
[DEBUG/MainProcess] helping task handler/workers to finish
[DEBUG/MainProcess] helping task handler/workers to finish
[DEBUG/MainProcess] helping task handler/workers to finish
[DEBUG/MainProcess] removing tasks from inqueue until task handler finished
[DEBUG/MainProcess] removing tasks from inqueue until task handler finished
[DEBUG/MainProcess] removing tasks from inqueue until task handler finished
[DEBUG/MainProcess] removing tasks from inqueue until task handler finished
[DEBUG/MainProcess] removing tasks from inqueue until task handler finished
[DEBUG/MainProcess] removing tasks from inqueue until task handler finished
[DEBUG/MainProcess] removing tasks from inqueue until task handler finished
[DEBUG/MainProcess] joining worker handler
[DEBUG/MainProcess] joining worker handler
[DEBUG/MainProcess] joining worker handler
[DEBUG/MainProcess] joining worker handler
[DEBUG/MainProcess] joining worker handler
[DEBUG/MainProcess] joining worker handler
[DEBUG/MainProcess] joining worker handler
[DEBUG/MainProcess] terminating workers
[DEBUG/MainProcess] terminating workers
[DEBUG/MainProcess] terminating workers
[DEBUG/MainProcess] terminating workers
[DEBUG/MainProcess] terminating workers
[DEBUG/MainProcess] terminating workers
[DEBUG/MainProcess] terminating workers
[DEBUG/MainProcess] joining task handler
[DEBUG/MainProcess] joining task handler
[DEBUG/MainProcess] joining task handler
[DEBUG/MainProcess] joining task handler
[DEBUG/MainProcess] joining task handler
[DEBUG/MainProcess] joining task handler
[DEBUG/MainProcess] joining task handler
[DEBUG/MainProcess] joining result handler
[DEBUG/MainProcess] joining result handler
[DEBUG/MainProcess] joining result handler
[DEBUG/MainProcess] joining result handler
[DEBUG/MainProcess] joining result handler
[DEBUG/MainProcess] joining result handler
[DEBUG/MainProcess] joining result handler
[DEBUG/MainProcess] joining pool workers
[DEBUG/MainProcess] joining pool workers
[DEBUG/MainProcess] joining pool workers
[DEBUG/MainProcess] joining pool workers
[DEBUG/MainProcess] joining pool workers
[DEBUG/MainProcess] joining pool workers
[DEBUG/MainProcess] joining pool workers
ok
test_lowcloud_filter_single_lwp_randomfog (fogpy.test.test_filters.Test_LowCloudFilter) ... [DEBUG/MainProcess] created semlock with handle 140502249340928
[DEBUG/MainProcess] created semlock with handle 140502249340928
[DEBUG/MainProcess] created semlock with handle 140502249340928
[DEBUG/MainProcess] created semlock with handle 140502249340928
[DEBUG/MainProcess] created semlock with handle 140502249340928
[DEBUG/MainProcess] created semlock with handle 140502249340928
[DEBUG/MainProcess] created semlock with handle 140502249340928
[DEBUG/MainProcess] created semlock with handle 140502234558464
[DEBUG/MainProcess] created semlock with handle 140502234558464
[DEBUG/MainProcess] created semlock with handle 140502234558464
[DEBUG/MainProcess] created semlock with handle 140502234558464
[DEBUG/MainProcess] created semlock with handle 140502234558464
[DEBUG/MainProcess] created semlock with handle 140502234558464
[DEBUG/MainProcess] created semlock with handle 140502234558464
[DEBUG/MainProcess] created semlock with handle 140502234554368
[DEBUG/MainProcess] created semlock with handle 140502234554368
[DEBUG/MainProcess] created semlock with handle 140502234554368
[DEBUG/MainProcess] created semlock with handle 140502234554368
[DEBUG/MainProcess] created semlock with handle 140502234554368
[DEBUG/MainProcess] created semlock with handle 140502234554368
[DEBUG/MainProcess] created semlock with handle 140502234554368
[DEBUG/MainProcess] created semlock with handle 140502234550272
[DEBUG/MainProcess] created semlock with handle 140502234550272
[DEBUG/MainProcess] created semlock with handle 140502234550272
[DEBUG/MainProcess] created semlock with handle 140502234550272
[DEBUG/MainProcess] created semlock with handle 140502234550272
[DEBUG/MainProcess] created semlock with handle 140502234550272
[DEBUG/MainProcess] created semlock with handle 140502234550272
[DEBUG/MainProcess] added worker
[DEBUG/MainProcess] added worker
[DEBUG/MainProcess] added worker
[DEBUG/MainProcess] added worker
[DEBUG/MainProcess] added worker
[DEBUG/MainProcess] added worker
[DEBUG/MainProcess] added worker
[INFO/PoolWorker-57] child process calling self.run()
[INFO/PoolWorker-57] child process calling self.run()
[INFO/PoolWorker-57] child process calling self.run()
[INFO/PoolWorker-57] child process calling self.run()
[INFO/PoolWorker-57] child process calling self.run()
[INFO/PoolWorker-57] child process calling self.run()
[INFO/PoolWorker-57] child process calling self.run()
[DEBUG/MainProcess] added worker
[DEBUG/MainProcess] added worker
[DEBUG/MainProcess] added worker
[DEBUG/MainProcess] added worker
[DEBUG/MainProcess] added worker
[DEBUG/MainProcess] added worker
[DEBUG/MainProcess] added worker
[INFO/PoolWorker-58] child process calling self.run()
[INFO/PoolWorker-58] child process calling self.run()
[INFO/PoolWorker-58] child process calling self.run()
[INFO/PoolWorker-58] child process calling self.run()
[INFO/PoolWorker-58] child process calling self.run()
[INFO/PoolWorker-58] child process calling self.run()
[INFO/PoolWorker-58] child process calling self.run()
[DEBUG/MainProcess] added worker
[DEBUG/MainProcess] added worker
[DEBUG/MainProcess] added worker
[DEBUG/MainProcess] added worker
[DEBUG/MainProcess] added worker
[DEBUG/MainProcess] added worker
[DEBUG/MainProcess] added worker
[INFO/PoolWorker-59] child process calling self.run()
[INFO/PoolWorker-59] child process calling self.run()
[INFO/PoolWorker-59] child process calling self.run()
[INFO/PoolWorker-59] child process calling self.run()
[INFO/PoolWorker-59] child process calling self.run()
[INFO/PoolWorker-59] child process calling self.run()
[INFO/PoolWorker-59] child process calling self.run()
[DEBUG/MainProcess] added worker
[DEBUG/MainProcess] added worker
[DEBUG/MainProcess] added worker
[DEBUG/MainProcess] added worker
[DEBUG/MainProcess] added worker
[DEBUG/MainProcess] added worker
[DEBUG/MainProcess] added worker
[INFO/PoolWorker-60] child process calling self.run()
[INFO/PoolWorker-60] child process calling self.run()
[INFO/PoolWorker-60] child process calling self.run()
[INFO/PoolWorker-60] child process calling self.run()
[INFO/PoolWorker-60] child process calling self.run()
[INFO/PoolWorker-60] child process calling self.run()
[INFO/PoolWorker-60] child process calling self.run()
[DEBUG/MainProcess] added worker
[DEBUG/MainProcess] added worker
[DEBUG/MainProcess] added worker
[DEBUG/MainProcess] added worker
[DEBUG/MainProcess] added worker
[DEBUG/MainProcess] added worker
[DEBUG/MainProcess] added worker
[INFO/PoolWorker-61] child process calling self.run()
[INFO/PoolWorker-61] child process calling self.run()
[INFO/PoolWorker-61] child process calling self.run()
[INFO/PoolWorker-61] child process calling self.run()
[INFO/PoolWorker-61] child process calling self.run()
[INFO/PoolWorker-61] child process calling self.run()
[INFO/PoolWorker-61] child process calling self.run()
[DEBUG/MainProcess] added worker
[DEBUG/MainProcess] added worker
[DEBUG/MainProcess] added worker
[DEBUG/MainProcess] added worker
[DEBUG/MainProcess] added worker
[DEBUG/MainProcess] added worker
[DEBUG/MainProcess] added worker
[INFO/PoolWorker-62] child process calling self.run()
[INFO/PoolWorker-62] child process calling self.run()
[INFO/PoolWorker-62] child process calling self.run()
[INFO/PoolWorker-62] child process calling self.run()
[INFO/PoolWorker-62] child process calling self.run()
[INFO/PoolWorker-62] child process calling self.run()
[INFO/PoolWorker-62] child process calling self.run()
[DEBUG/MainProcess] added worker
[DEBUG/MainProcess] added worker
[DEBUG/MainProcess] added worker
[DEBUG/MainProcess] added worker
[DEBUG/MainProcess] added worker
[DEBUG/MainProcess] added worker
[DEBUG/MainProcess] added worker
[INFO/PoolWorker-63] child process calling self.run()
[INFO/PoolWorker-63] child process calling self.run()
[INFO/PoolWorker-63] child process calling self.run()
[INFO/PoolWorker-63] child process calling self.run()
[INFO/PoolWorker-63] child process calling self.run()
[INFO/PoolWorker-63] child process calling self.run()
[INFO/PoolWorker-63] child process calling self.run()
[DEBUG/MainProcess] added worker
[DEBUG/MainProcess] added worker
[DEBUG/MainProcess] added worker
[DEBUG/MainProcess] added worker
[DEBUG/MainProcess] added worker
[DEBUG/MainProcess] added worker
[DEBUG/MainProcess] added worker
[INFO/PoolWorker-64] child process calling self.run()
[INFO/PoolWorker-64] child process calling self.run()
[INFO/PoolWorker-64] child process calling self.run()
[INFO/PoolWorker-64] child process calling self.run()
[INFO/PoolWorker-64] child process calling self.run()
[INFO/PoolWorker-64] child process calling self.run()
[INFO/PoolWorker-64] child process calling self.run()
/media/nas/x21324/miniconda3/envs/py27b/lib/python2.7/site-packages/scipy/optimize/_minimize.py:517: RuntimeWarning: Method BFGS cannot handle constraints nor bounds.
RuntimeWarning)
/media/nas/x21324/miniconda3/envs/py27b/lib/python2.7/site-packages/scipy/optimize/_minimize.py:517: RuntimeWarning: Method BFGS cannot handle constraints nor bounds.
RuntimeWarning)
/media/nas/x21324/miniconda3/envs/py27b/lib/python2.7/site-packages/scipy/optimize/_minimize.py:517: RuntimeWarning: Method BFGS cannot handle constraints nor bounds.
RuntimeWarning)
/media/nas/x21324/miniconda3/envs/py27b/lib/python2.7/site-packages/scipy/optimize/_minimize.py:517: RuntimeWarning: Method BFGS cannot handle constraints nor bounds.
RuntimeWarning)
[DEBUG/MainProcess] closing pool
[DEBUG/MainProcess] closing pool
[DEBUG/MainProcess] closing pool
[DEBUG/MainProcess] closing pool
[DEBUG/MainProcess] closing pool
[DEBUG/MainProcess] closing pool
[DEBUG/MainProcess] closing pool
[DEBUG/MainProcess] closing pool
[DEBUG/MainProcess] joining pool
[DEBUG/MainProcess] joining pool
[DEBUG/MainProcess] joining pool
[DEBUG/MainProcess] joining pool
[DEBUG/MainProcess] joining pool
[DEBUG/MainProcess] joining pool
[DEBUG/MainProcess] joining pool
[DEBUG/MainProcess] joining pool
[DEBUG/MainProcess] worker handler exiting
[DEBUG/MainProcess] worker handler exiting
[DEBUG/MainProcess] task handler got sentinel
[DEBUG/MainProcess] worker handler exiting
[DEBUG/MainProcess] worker handler exiting
[DEBUG/MainProcess] task handler got sentinel
[DEBUG/MainProcess] task handler got sentinel
[DEBUG/MainProcess] worker handler exiting
[DEBUG/MainProcess] worker handler exiting
[DEBUG/MainProcess] task handler got sentinel
[DEBUG/MainProcess] worker handler exiting
[DEBUG/MainProcess] worker handler exiting
[DEBUG/MainProcess] task handler got sentinel
[DEBUG/MainProcess] task handler got sentinel
[DEBUG/MainProcess] task handler got sentinel
[DEBUG/MainProcess] task handler got sentinel
[DEBUG/MainProcess] task handler sending sentinel to result handler
[DEBUG/MainProcess] task handler sending sentinel to result handler
[DEBUG/MainProcess] task handler sending sentinel to result handler
[DEBUG/MainProcess] task handler sending sentinel to result handler
[DEBUG/MainProcess] task handler sending sentinel to result handler
[DEBUG/MainProcess] task handler sending sentinel to result handler
[DEBUG/MainProcess] task handler sending sentinel to result handler
[DEBUG/MainProcess] task handler sending sentinel to result handler
[DEBUG/MainProcess] task handler sending sentinel to workers
[DEBUG/MainProcess] task handler sending sentinel to workers
[DEBUG/MainProcess] result handler got sentinel
[DEBUG/MainProcess] task handler sending sentinel to workers
[DEBUG/MainProcess] task handler sending sentinel to workers
[DEBUG/MainProcess] result handler got sentinel
[DEBUG/MainProcess] task handler sending sentinel to workers
[DEBUG/MainProcess] task handler sending sentinel to workers
[DEBUG/MainProcess] result handler got sentinel
[DEBUG/MainProcess] task handler sending sentinel to workers
[DEBUG/MainProcess] result handler got sentinel
[DEBUG/MainProcess] result handler got sentinel
[DEBUG/MainProcess] task handler sending sentinel to workers
[DEBUG/MainProcess] result handler got sentinel
[DEBUG/MainProcess] result handler got sentinel
[DEBUG/MainProcess] result handler got sentinel
[DEBUG/MainProcess] ensuring that outqueue is not full
[DEBUG/PoolWorker-61] worker got sentinel -- exiting
[DEBUG/PoolWorker-61] worker got sentinel -- exiting
[DEBUG/PoolWorker-62] worker got sentinel -- exiting
[DEBUG/PoolWorker-61] worker got sentinel -- exiting
[DEBUG/PoolWorker-62] worker got sentinel -- exiting
[DEBUG/PoolWorker-61] worker got sentinel -- exiting
[DEBUG/PoolWorker-62] worker got sentinel -- exiting
[DEBUG/PoolWorker-61] worker got sentinel -- exiting
[DEBUG/PoolWorker-63] worker got sentinel -- exiting
[DEBUG/PoolWorker-62] worker got sentinel -- exiting
[DEBUG/PoolWorker-61] worker got sentinel -- exiting
[DEBUG/PoolWorker-64] worker got sentinel -- exiting
[DEBUG/PoolWorker-63] worker got sentinel -- exiting
[DEBUG/PoolWorker-62] worker got sentinel -- exiting
[DEBUG/PoolWorker-61] worker got sentinel -- exiting
[DEBUG/PoolWorker-58] worker got sentinel -- exiting
[DEBUG/PoolWorker-64] worker got sentinel -- exiting
[DEBUG/PoolWorker-63] worker got sentinel -- exiting
[DEBUG/PoolWorker-62] worker got sentinel -- exiting
[DEBUG/PoolWorker-58] worker got sentinel -- exiting
[DEBUG/PoolWorker-64] worker got sentinel -- exiting
[DEBUG/PoolWorker-63] worker got sentinel -- exiting
[DEBUG/PoolWorker-62] worker got sentinel -- exiting
[DEBUG/PoolWorker-59] worker got sentinel -- exiting
[DEBUG/PoolWorker-58] worker got sentinel -- exiting
[DEBUG/PoolWorker-64] worker got sentinel -- exiting
[DEBUG/PoolWorker-63] worker got sentinel -- exiting
[DEBUG/PoolWorker-61] worker exiting after 0 tasks
[DEBUG/PoolWorker-59] worker got sentinel -- exiting
[DEBUG/PoolWorker-57] worker got sentinel -- exiting
[DEBUG/PoolWorker-60] worker got sentinel -- exiting
[DEBUG/PoolWorker-58] worker got sentinel -- exiting
[DEBUG/PoolWorker-64] worker got sentinel -- exiting
[DEBUG/PoolWorker-61] worker exiting after 0 tasks
[DEBUG/PoolWorker-63] worker got sentinel -- exiting
[DEBUG/PoolWorker-59] worker got sentinel -- exiting
[DEBUG/PoolWorker-62] worker exiting after 0 tasks
[DEBUG/PoolWorker-58] worker got sentinel -- exiting
[DEBUG/PoolWorker-64] worker got sentinel -- exiting
[DEBUG/PoolWorker-61] worker exiting after 0 tasks
[DEBUG/PoolWorker-57] worker got sentinel -- exiting
[DEBUG/PoolWorker-63] worker got sentinel -- exiting
[DEBUG/PoolWorker-59] worker got sentinel -- exiting
[DEBUG/PoolWorker-58] worker got sentinel -- exiting
[DEBUG/PoolWorker-62] worker exiting after 0 tasks
[DEBUG/PoolWorker-60] worker got sentinel -- exiting
[DEBUG/PoolWorker-64] worker got sentinel -- exiting
[DEBUG/PoolWorker-61] worker exiting after 0 tasks
[DEBUG/PoolWorker-57] worker got sentinel -- exiting
[DEBUG/PoolWorker-59] worker got sentinel -- exiting
[DEBUG/PoolWorker-62] worker exiting after 0 tasks
[DEBUG/PoolWorker-58] worker got sentinel -- exiting
[DEBUG/PoolWorker-60] worker got sentinel -- exiting
[DEBUG/PoolWorker-61] worker exiting after 0 tasks
[DEBUG/PoolWorker-57] worker got sentinel -- exiting
[DEBUG/PoolWorker-59] worker got sentinel -- exiting
[DEBUG/PoolWorker-62] worker exiting after 0 tasks
[DEBUG/PoolWorker-60] worker got sentinel -- exiting
[DEBUG/PoolWorker-61] worker exiting after 0 tasks
[DEBUG/PoolWorker-57] worker got sentinel -- exiting
[DEBUG/PoolWorker-59] worker got sentinel -- exiting
[DEBUG/PoolWorker-63] worker exiting after 0 tasks
[DEBUG/PoolWorker-62] worker exiting after 0 tasks
[DEBUG/PoolWorker-60] worker got sentinel -- exiting
[DEBUG/PoolWorker-61] worker exiting after 0 tasks
[DEBUG/PoolWorker-64] worker exiting after 0 tasks
[DEBUG/PoolWorker-57] worker got sentinel -- exiting
[DEBUG/PoolWorker-63] worker exiting after 0 tasks
[DEBUG/PoolWorker-58] worker exiting after 1 tasks
[DEBUG/PoolWorker-62] worker exiting after 0 tasks
[DEBUG/PoolWorker-60] worker got sentinel -- exiting
[DEBUG/PoolWorker-57] worker got sentinel -- exiting
[DEBUG/PoolWorker-64] worker exiting after 0 tasks
[DEBUG/PoolWorker-63] worker exiting after 0 tasks
[DEBUG/PoolWorker-62] worker exiting after 0 tasks
[DEBUG/PoolWorker-58] worker exiting after 1 tasks
[DEBUG/PoolWorker-60] worker got sentinel -- exiting
[DEBUG/PoolWorker-59] worker exiting after 1 tasks
[DEBUG/PoolWorker-64] worker exiting after 0 tasks
[DEBUG/PoolWorker-63] worker exiting after 0 tasks
[DEBUG/PoolWorker-58] worker exiting after 1 tasks
[DEBUG/PoolWorker-59] worker exiting after 1 tasks
[DEBUG/PoolWorker-64] worker exiting after 0 tasks
[DEBUG/PoolWorker-63] worker exiting after 0 tasks
[INFO/PoolWorker-61] process shutting down
[DEBUG/PoolWorker-58] worker exiting after 1 tasks
[DEBUG/PoolWorker-57] worker exiting after 1 tasks
[DEBUG/PoolWorker-59] worker exiting after 1 tasks
[DEBUG/PoolWorker-64] worker exiting after 0 tasks
[DEBUG/PoolWorker-63] worker exiting after 0 tasks
[INFO/PoolWorker-61] process shutting down
[DEBUG/PoolWorker-60] worker exiting after 1 tasks
[DEBUG/PoolWorker-58] worker exiting after 1 tasks
[INFO/PoolWorker-62] process shutting down
[DEBUG/PoolWorker-57] worker exiting after 1 tasks
[DEBUG/PoolWorker-59] worker exiting after 1 tasks
[DEBUG/PoolWorker-63] worker exiting after 0 tasks
[DEBUG/PoolWorker-64] worker exiting after 0 tasks
[INFO/PoolWorker-61] process shutting down
[DEBUG/PoolWorker-60] worker exiting after 1 tasks
[DEBUG/PoolWorker-58] worker exiting after 1 tasks
[INFO/PoolWorker-62] process shutting down
[DEBUG/PoolWorker-57] worker exiting after 1 tasks
[INFO/PoolWorker-61] process shutting down
[DEBUG/PoolWorker-64] worker exiting after 0 tasks
[DEBUG/PoolWorker-59] worker exiting after 1 tasks
[DEBUG/PoolWorker-60] worker exiting after 1 tasks
[DEBUG/PoolWorker-58] worker exiting after 1 tasks
[INFO/PoolWorker-62] process shutting down
[DEBUG/PoolWorker-57] worker exiting after 1 tasks
[INFO/PoolWorker-61] process shutting down
[DEBUG/PoolWorker-59] worker exiting after 1 tasks
[DEBUG/PoolWorker-60] worker exiting after 1 tasks
[INFO/PoolWorker-62] process shutting down
[DEBUG/PoolWorker-57] worker exiting after 1 tasks
[INFO/PoolWorker-61] process shutting down
[INFO/PoolWorker-63] process shutting down
[DEBUG/PoolWorker-59] worker exiting after 1 tasks
[DEBUG/PoolWorker-60] worker exiting after 1 tasks
[INFO/PoolWorker-62] process shutting down
[DEBUG/PoolWorker-57] worker exiting after 1 tasks
[INFO/PoolWorker-64] process shutting down
[INFO/PoolWorker-61] process shutting down
[INFO/PoolWorker-58] process shutting down
[INFO/PoolWorker-63] process shutting down
[DEBUG/PoolWorker-60] worker exiting after 1 tasks
[INFO/PoolWorker-62] process shutting down
[DEBUG/PoolWorker-57] worker exiting after 1 tasks
[INFO/PoolWorker-64] process shutting down
[INFO/PoolWorker-58] process shutting down
[INFO/PoolWorker-63] process shutting down
[INFO/PoolWorker-62] process shutting down
[DEBUG/PoolWorker-60] worker exiting after 1 tasks
[INFO/PoolWorker-64] process shutting down
[INFO/PoolWorker-58] process shutting down
[INFO/PoolWorker-63] process shutting down
[INFO/PoolWorker-59] process shutting down
[DEBUG/PoolWorker-61] running all "atexit" finalizers with priority >= 0
[INFO/PoolWorker-64] process shutting down
[INFO/PoolWorker-58] process shutting down
[INFO/PoolWorker-59] process shutting down
[INFO/PoolWorker-63] process shutting down
[DEBUG/PoolWorker-61] running all "atexit" finalizers with priority >= 0
[INFO/PoolWorker-64] process shutting down
[INFO/PoolWorker-57] process shutting down
[DEBUG/PoolWorker-62] running all "atexit" finalizers with priority >= 0
[INFO/PoolWorker-58] process shutting down
[INFO/PoolWorker-63] process shutting down
[INFO/PoolWorker-59] process shutting down
[DEBUG/PoolWorker-61] running all "atexit" finalizers with priority >= 0
[INFO/PoolWorker-60] process shutting down
[INFO/PoolWorker-64] process shutting down
[INFO/PoolWorker-57] process shutting down
[INFO/PoolWorker-58] process shutting down
[DEBUG/PoolWorker-62] running all "atexit" finalizers with priority >= 0
[INFO/PoolWorker-59] process shutting down
[INFO/PoolWorker-63] process shutting down
[DEBUG/PoolWorker-61] running all "atexit" finalizers with priority >= 0
[INFO/PoolWorker-60] process shutting down
[INFO/PoolWorker-64] process shutting down
[INFO/PoolWorker-57] process shutting down
[DEBUG/PoolWorker-62] running all "atexit" finalizers with priority >= 0
[INFO/PoolWorker-58] process shutting down
[INFO/PoolWorker-59] process shutting down
[DEBUG/PoolWorker-61] running all "atexit" finalizers with priority >= 0
[INFO/PoolWorker-60] process shutting down
[INFO/PoolWorker-57] process shutting down
[DEBUG/PoolWorker-62] running all "atexit" finalizers with priority >= 0
[INFO/PoolWorker-59] process shutting down
[DEBUG/PoolWorker-61] running all "atexit" finalizers with priority >= 0
[INFO/PoolWorker-60] process shutting down
[DEBUG/PoolWorker-63] running all "atexit" finalizers with priority >= 0
[INFO/PoolWorker-57] process shutting down
[DEBUG/PoolWorker-62] running all "atexit" finalizers with priority >= 0
[DEBUG/PoolWorker-64] running all "atexit" finalizers with priority >= 0
[INFO/PoolWorker-59] process shutting down
[DEBUG/PoolWorker-61] running all "atexit" finalizers with priority >= 0
[DEBUG/PoolWorker-58] running all "atexit" finalizers with priority >= 0
[INFO/PoolWorker-60] process shutting down
[DEBUG/PoolWorker-63] running all "atexit" finalizers with priority >= 0
[INFO/PoolWorker-57] process shutting down
[DEBUG/PoolWorker-62] running all "atexit" finalizers with priority >= 0
[DEBUG/PoolWorker-64] running all "atexit" finalizers with priority >= 0
[DEBUG/PoolWorker-58] running all "atexit" finalizers with priority >= 0
[INFO/PoolWorker-60] process shutting down
[DEBUG/PoolWorker-63] running all "atexit" finalizers with priority >= 0
[INFO/PoolWorker-57] process shutting down
[DEBUG/PoolWorker-62] running all "atexit" finalizers with priority >= 0
[DEBUG/PoolWorker-64] running all "atexit" finalizers with priority >= 0
[DEBUG/PoolWorker-58] running all "atexit" finalizers with priority >= 0
[DEBUG/PoolWorker-59] running all "atexit" finalizers with priority >= 0
[INFO/PoolWorker-60] process shutting down
[DEBUG/PoolWorker-63] running all "atexit" finalizers with priority >= 0
[DEBUG/PoolWorker-64] running all "atexit" finalizers with priority >= 0
[DEBUG/PoolWorker-58] running all "atexit" finalizers with priority >= 0
[DEBUG/PoolWorker-63] running all "atexit" finalizers with priority >= 0
[DEBUG/PoolWorker-59] running all "atexit" finalizers with priority >= 0
[DEBUG/PoolWorker-61] running the remaining "atexit" finalizers
[DEBUG/PoolWorker-57] running all "atexit" finalizers with priority >= 0
[DEBUG/PoolWorker-64] running all "atexit" finalizers with priority >= 0
[DEBUG/PoolWorker-58] running all "atexit" finalizers with priority >= 0
[DEBUG/PoolWorker-59] running all "atexit" finalizers with priority >= 0
[DEBUG/PoolWorker-63] running all "atexit" finalizers with priority >= 0
[DEBUG/PoolWorker-61] running the remaining "atexit" finalizers
[DEBUG/PoolWorker-60] running all "atexit" finalizers with priority >= 0
[DEBUG/PoolWorker-57] running all "atexit" finalizers with priority >= 0
[DEBUG/PoolWorker-64] running all "atexit" finalizers with priority >= 0
[DEBUG/PoolWorker-58] running all "atexit" finalizers with priority >= 0
[DEBUG/PoolWorker-59] running all "atexit" finalizers with priority >= 0
[DEBUG/PoolWorker-63] running all "atexit" finalizers with priority >= 0
[DEBUG/PoolWorker-62] running the remaining "atexit" finalizers
[DEBUG/PoolWorker-61] running the remaining "atexit" finalizers
[DEBUG/PoolWorker-60] running all "atexit" finalizers with priority >= 0
[DEBUG/PoolWorker-57] running all "atexit" finalizers with priority >= 0
[DEBUG/PoolWorker-64] running all "atexit" finalizers with priority >= 0
[DEBUG/PoolWorker-58] running all "atexit" finalizers with priority >= 0
[DEBUG/PoolWorker-59] running all "atexit" finalizers with priority >= 0
[DEBUG/PoolWorker-62] running the remaining "atexit" finalizers
[DEBUG/PoolWorker-61] running the remaining "atexit" finalizers
[DEBUG/PoolWorker-57] running all "atexit" finalizers with priority >= 0
[DEBUG/PoolWorker-60] running all "atexit" finalizers with priority >= 0
[DEBUG/PoolWorker-62] running the remaining "atexit" finalizers
[DEBUG/PoolWorker-59] running all "atexit" finalizers with priority >= 0
[DEBUG/PoolWorker-61] running the remaining "atexit" finalizers
[DEBUG/PoolWorker-57] running all "atexit" finalizers with priority >= 0
[DEBUG/PoolWorker-60] running all "atexit" finalizers with priority >= 0
[DEBUG/PoolWorker-62] running the remaining "atexit" finalizers
[DEBUG/PoolWorker-59] running all "atexit" finalizers with priority >= 0
[DEBUG/PoolWorker-61] running the remaining "atexit" finalizers
[DEBUG/PoolWorker-57] running all "atexit" finalizers with priority >= 0
[DEBUG/PoolWorker-60] running all "atexit" finalizers with priority >= 0
[DEBUG/PoolWorker-63] running the remaining "atexit" finalizers
[DEBUG/PoolWorker-62] running the remaining "atexit" finalizers
[DEBUG/PoolWorker-61] running the remaining "atexit" finalizers
[DEBUG/PoolWorker-64] running the remaining "atexit" finalizers
[DEBUG/PoolWorker-58] running the remaining "atexit" finalizers
[DEBUG/PoolWorker-57] running all "atexit" finalizers with priority >= 0
[DEBUG/PoolWorker-60] running all "atexit" finalizers with priority >= 0
[DEBUG/PoolWorker-63] running the remaining "atexit" finalizers
[DEBUG/PoolWorker-62] running the remaining "atexit" finalizers
[DEBUG/PoolWorker-64] running the remaining "atexit" finalizers
[DEBUG/PoolWorker-58] running the remaining "atexit" finalizers
[DEBUG/PoolWorker-60] running all "atexit" finalizers with priority >= 0
[DEBUG/PoolWorker-63] running the remaining "atexit" finalizers
[DEBUG/PoolWorker-62] running the remaining "atexit" finalizers
[DEBUG/PoolWorker-64] running the remaining "atexit" finalizers
[DEBUG/PoolWorker-58] running the remaining "atexit" finalizers
[DEBUG/PoolWorker-59] running the remaining "atexit" finalizers
[DEBUG/PoolWorker-63] running the remaining "atexit" finalizers
[DEBUG/PoolWorker-64] running the remaining "atexit" finalizers
[INFO/PoolWorker-61] process exiting with exitcode 0
[DEBUG/PoolWorker-58] running the remaining "atexit" finalizers
[DEBUG/PoolWorker-59] running the remaining "atexit" finalizers
[DEBUG/PoolWorker-57] running the remaining "atexit" finalizers
[DEBUG/PoolWorker-63] running the remaining "atexit" finalizers
[INFO/PoolWorker-61] process exiting with exitcode 0
[DEBUG/PoolWorker-64] running the remaining "atexit" finalizers
[DEBUG/PoolWorker-58] running the remaining "atexit" finalizers
[DEBUG/PoolWorker-59] running the remaining "atexit" finalizers
[DEBUG/PoolWorker-60] running the remaining "atexit" finalizers
[INFO/PoolWorker-62] process exiting with exitcode 0
[DEBUG/PoolWorker-57] running the remaining "atexit" finalizers
[DEBUG/PoolWorker-63] running the remaining "atexit" finalizers
[INFO/PoolWorker-61] process exiting with exitcode 0
[DEBUG/PoolWorker-64] running the remaining "atexit" finalizers
[DEBUG/PoolWorker-58] running the remaining "atexit" finalizers
[DEBUG/PoolWorker-59] running the remaining "atexit" finalizers
[DEBUG/PoolWorker-60] running the remaining "atexit" finalizers
[INFO/PoolWorker-62] process exiting with exitcode 0
[DEBUG/PoolWorker-57] running the remaining "atexit" finalizers
[DEBUG/PoolWorker-63] running the remaining "atexit" finalizers
[INFO/PoolWorker-61] process exiting with exitcode 0
[DEBUG/PoolWorker-64] running the remaining "atexit" finalizers
[DEBUG/PoolWorker-58] running the remaining "atexit" finalizers
[DEBUG/PoolWorker-59] running the remaining "atexit" finalizers
[DEBUG/PoolWorker-60] running the remaining "atexit" finalizers
[INFO/PoolWorker-62] process exiting with exitcode 0
[DEBUG/PoolWorker-57] running the remaining "atexit" finalizers
[INFO/PoolWorker-61] process exiting with exitcode 0
[DEBUG/PoolWorker-59] running the remaining "atexit" finalizers
[DEBUG/PoolWorker-60] running the remaining "atexit" finalizers
[INFO/PoolWorker-62] process exiting with exitcode 0
[DEBUG/PoolWorker-57] running the remaining "atexit" finalizers
[INFO/PoolWorker-61] process exiting with exitcode 0
[DEBUG/PoolWorker-59] running the remaining "atexit" finalizers
[DEBUG/PoolWorker-60] running the remaining "atexit" finalizers
[INFO/PoolWorker-62] process exiting with exitcode 0
[DEBUG/PoolWorker-57] running the remaining "atexit" finalizers
[INFO/PoolWorker-64] process exiting with exitcode 0
[INFO/PoolWorker-61] process exiting with exitcode 0
[INFO/PoolWorker-63] process exiting with exitcode 0
[INFO/PoolWorker-58] process exiting with exitcode 0
[DEBUG/PoolWorker-60] running the remaining "atexit" finalizers
[DEBUG/PoolWorker-57] running the remaining "atexit" finalizers
[INFO/PoolWorker-62] process exiting with exitcode 0
[INFO/PoolWorker-64] process exiting with exitcode 0
[INFO/PoolWorker-63] process exiting with exitcode 0
[INFO/PoolWorker-58] process exiting with exitcode 0
[DEBUG/PoolWorker-60] running the remaining "atexit" finalizers
[INFO/PoolWorker-62] process exiting with exitcode 0
[INFO/PoolWorker-63] process exiting with exitcode 0
[INFO/PoolWorker-59] process exiting with exitcode 0
[INFO/PoolWorker-58] process exiting with exitcode 0
[INFO/PoolWorker-64] process exiting with exitcode 0
[INFO/PoolWorker-59] process exiting with exitcode 0
[INFO/PoolWorker-63] process exiting with exitcode 0
[INFO/PoolWorker-57] process exiting with exitcode 0
[INFO/PoolWorker-58] process exiting with exitcode 0
[INFO/PoolWorker-63] process exiting with exitcode 0
[INFO/PoolWorker-59] process exiting with exitcode 0
[INFO/PoolWorker-60] process exiting with exitcode 0
[INFO/PoolWorker-64] process exiting with exitcode 0
[INFO/PoolWorker-57] process exiting with exitcode 0
[INFO/PoolWorker-63] process exiting with exitcode 0
[INFO/PoolWorker-59] process exiting with exitcode 0
[INFO/PoolWorker-60] process exiting with exitcode 0
[INFO/PoolWorker-57] process exiting with exitcode 0
[INFO/PoolWorker-58] process exiting with exitcode 0
[INFO/PoolWorker-59] process exiting with exitcode 0
[INFO/PoolWorker-63] process exiting with exitcode 0
[INFO/PoolWorker-60] process exiting with exitcode 0
[INFO/PoolWorker-64] process exiting with exitcode 0
[INFO/PoolWorker-57] process exiting with exitcode 0
[INFO/PoolWorker-59] process exiting with exitcode 0
[INFO/PoolWorker-60] process exiting with exitcode 0
[INFO/PoolWorker-58] process exiting with exitcode 0
[INFO/PoolWorker-57] process exiting with exitcode 0
[INFO/PoolWorker-64] process exiting with exitcode 0
[INFO/PoolWorker-60] process exiting with exitcode 0
[INFO/PoolWorker-57] process exiting with exitcode 0
[INFO/PoolWorker-59] process exiting with exitcode 0
[INFO/PoolWorker-58] process exiting with exitcode 0
[INFO/PoolWorker-60] process exiting with exitcode 0
[INFO/PoolWorker-57] process exiting with exitcode 0
[INFO/PoolWorker-64] process exiting with exitcode 0
[INFO/PoolWorker-60] process exiting with exitcode 0
[DEBUG/MainProcess] ensuring that outqueue is not full
[DEBUG/MainProcess] task handler exiting
[DEBUG/MainProcess] ensuring that outqueue is not full
[DEBUG/MainProcess] task handler exiting
[DEBUG/MainProcess] ensuring that outqueue is not full
[DEBUG/MainProcess] task handler exiting
[DEBUG/MainProcess] ensuring that outqueue is not full
[DEBUG/MainProcess] task handler exiting
[DEBUG/MainProcess] task handler exiting
[DEBUG/MainProcess] ensuring that outqueue is not full
[DEBUG/MainProcess] ensuring that outqueue is not full
[DEBUG/MainProcess] task handler exiting
[DEBUG/MainProcess] ensuring that outqueue is not full
[DEBUG/MainProcess] task handler exiting
[DEBUG/MainProcess] task handler exiting
[DEBUG/MainProcess] result handler exiting: len(cache)=0, thread._state=0
[DEBUG/MainProcess] result handler exiting: len(cache)=0, thread._state=0
[DEBUG/MainProcess] result handler exiting: len(cache)=0, thread._state=0
[DEBUG/MainProcess] result handler exiting: len(cache)=0, thread._state=0
[DEBUG/MainProcess] result handler exiting: len(cache)=0, thread._state=0
[DEBUG/MainProcess] result handler exiting: len(cache)=0, thread._state=0
[DEBUG/MainProcess] result handler exiting: len(cache)=0, thread._state=0
[DEBUG/MainProcess] result handler exiting: len(cache)=0, thread._state=0
[DEBUG/MainProcess] finalizing pool
[DEBUG/MainProcess] finalizing pool
[DEBUG/MainProcess] finalizing pool
[DEBUG/MainProcess] finalizing pool
[DEBUG/MainProcess] finalizing pool
[DEBUG/MainProcess] finalizing pool
[DEBUG/MainProcess] finalizing pool
[DEBUG/MainProcess] finalizing pool
[DEBUG/MainProcess] helping task handler/workers to finish
[DEBUG/MainProcess] helping task handler/workers to finish
[DEBUG/MainProcess] helping task handler/workers to finish
[DEBUG/MainProcess] helping task handler/workers to finish
[DEBUG/MainProcess] helping task handler/workers to finish
[DEBUG/MainProcess] helping task handler/workers to finish
[DEBUG/MainProcess] helping task handler/workers to finish
[DEBUG/MainProcess] helping task handler/workers to finish
[DEBUG/MainProcess] removing tasks from inqueue until task handler finished
[DEBUG/MainProcess] removing tasks from inqueue until task handler finished
[DEBUG/MainProcess] removing tasks from inqueue until task handler finished
[DEBUG/MainProcess] removing tasks from inqueue until task handler finished
[DEBUG/MainProcess] removing tasks from inqueue until task handler finished
[DEBUG/MainProcess] removing tasks from inqueue until task handler finished
[DEBUG/MainProcess] removing tasks from inqueue until task handler finished
[DEBUG/MainProcess] removing tasks from inqueue until task handler finished
[DEBUG/MainProcess] joining worker handler
[DEBUG/MainProcess] joining worker handler
[DEBUG/MainProcess] joining worker handler
[DEBUG/MainProcess] joining worker handler
[DEBUG/MainProcess] joining worker handler
[DEBUG/MainProcess] joining worker handler
[DEBUG/MainProcess] joining worker handler
[DEBUG/MainProcess] joining worker handler
[DEBUG/MainProcess] terminating workers
[DEBUG/MainProcess] terminating workers
[DEBUG/MainProcess] terminating workers
[DEBUG/MainProcess] terminating workers
[DEBUG/MainProcess] terminating workers
[DEBUG/MainProcess] terminating workers
[DEBUG/MainProcess] terminating workers
[DEBUG/MainProcess] terminating workers
[DEBUG/MainProcess] joining task handler
[DEBUG/MainProcess] joining task handler
[DEBUG/MainProcess] joining task handler
[DEBUG/MainProcess] joining task handler
[DEBUG/MainProcess] joining task handler
[DEBUG/MainProcess] joining task handler
[DEBUG/MainProcess] joining task handler
[DEBUG/MainProcess] joining task handler
[DEBUG/MainProcess] joining result handler
[DEBUG/MainProcess] joining result handler
[DEBUG/MainProcess] joining result handler
[DEBUG/MainProcess] joining result handler
[DEBUG/MainProcess] joining result handler
[DEBUG/MainProcess] joining result handler
[DEBUG/MainProcess] joining result handler
[DEBUG/MainProcess] joining result handler
[DEBUG/MainProcess] joining pool workers
[DEBUG/MainProcess] joining pool workers
[DEBUG/MainProcess] joining pool workers
[DEBUG/MainProcess] joining pool workers
[DEBUG/MainProcess] joining pool workers
[DEBUG/MainProcess] joining pool workers
[DEBUG/MainProcess] joining pool workers
[DEBUG/MainProcess] joining pool workers
ok
test_snow_filter (fogpy.test.test_filters.Test_SnowFilter) ... ok
test_spatial_cth_filter_artifical (fogpy.test.test_filters.Test_SpatialCloudTopHeightFilter) ... ok
test_spatial_homogenity_filter_highsd (fogpy.test.test_filters.Test_SpatialHomogeneityFilter) ... FAIL
test_spatial_homogenity_filter_lowsd (fogpy.test.test_filters.Test_SpatialHomogeneityFilter) ... ok
test_spatial_homogenity_filter_maxsize (fogpy.test.test_filters.Test_SpatialHomogeneityFilter) ... ok
test_spatial_homogenity_filter_nomask_high (fogpy.test.test_filters.Test_SpatialHomogeneityFilter) ... ok
test_spatial_homogenity_filter_nomask_low (fogpy.test.test_filters.Test_SpatialHomogeneityFilter) ... ok
test_dem_interpolation_method (fogpy.test.test_filters.Test_StationFusionFilter) ... ok
test_fusion_filter_bufr_import (fogpy.test.test_filters.Test_StationFusionFilter) ... ERROR
test_fusion_filter_dem_interpolation (fogpy.test.test_filters.Test_StationFusionFilter) ... ERROR
test_water_cloud_filter (fogpy.test.test_filters.Test_WaterCloudFilter) ... ok
Failure: ImportError (No module named utils) ... ERROR
test_cloud_layer (fogpy.test.test_lowwatercloud.Test_LowWaterCloud) ... ok
test_cloud_layer_small (fogpy.test.test_lowwatercloud.Test_LowWaterCloud) ... ok
test_cloud_layer_small2 (fogpy.test.test_lowwatercloud.Test_LowWaterCloud) ... ok
test_get_air_pressure (fogpy.test.test_lowwatercloud.Test_LowWaterCloud) ... ok
test_get_cloud_based_vapour_mixing_ratio (fogpy.test.test_lowwatercloud.Test_LowWaterCloud) ... ok
test_get_effective_radius (fogpy.test.test_lowwatercloud.Test_LowWaterCloud) ... ok
test_get_effective_radius_with_cbh (fogpy.test.test_lowwatercloud.Test_LowWaterCloud) ... ok
test_get_fog_cloud_height (fogpy.test.test_lowwatercloud.Test_LowWaterCloud) ... ok
test_get_fog_cloud_height2 (fogpy.test.test_lowwatercloud.Test_LowWaterCloud) ... /media/nas/x21324/miniconda3/envs/py27b/lib/python2.7/site-packages/scipy/optimize/_minimize.py:517: RuntimeWarning: Method BFGS cannot handle constraints nor bounds.
RuntimeWarning)
ok
test_get_incloud_mixing_ratio (fogpy.test.test_lowwatercloud.Test_LowWaterCloud) ... ok
test_get_incloud_mixing_ratio_limit (fogpy.test.test_lowwatercloud.Test_LowWaterCloud) ... ok
test_get_liquid_density (fogpy.test.test_lowwatercloud.Test_LowWaterCloud) ... ok
test_get_liquid_mixing_ratio (fogpy.test.test_lowwatercloud.Test_LowWaterCloud) ... ok
test_get_liquid_water_content (fogpy.test.test_lowwatercloud.Test_LowWaterCloud) ... ok
test_get_liquid_water_path (fogpy.test.test_lowwatercloud.Test_LowWaterCloud) ... ok
test_get_liquid_water_path2 (fogpy.test.test_lowwatercloud.Test_LowWaterCloud) ... ok
test_get_moist_adiabatic_lapse_temp (fogpy.test.test_lowwatercloud.Test_LowWaterCloud) ... ok
test_get_moist_air_density (fogpy.test.test_lowwatercloud.Test_LowWaterCloud) ... ok
test_get_sat_vapour_pressure_buck (fogpy.test.test_lowwatercloud.Test_LowWaterCloud) ... ok
test_get_sat_vapour_pressure_magnus (fogpy.test.test_lowwatercloud.Test_LowWaterCloud) ... ok
test_get_vapour_mixing_ratio (fogpy.test.test_lowwatercloud.Test_LowWaterCloud) ... ok
test_get_visibility (fogpy.test.test_lowwatercloud.Test_LowWaterCloud) ... ok
test_init_cloud_layers (fogpy.test.test_lowwatercloud.Test_LowWaterCloud) ... ok
test_optimize_cbh_basin (fogpy.test.test_lowwatercloud.Test_LowWaterCloud) ... ok
test_optimize_cbh_brute (fogpy.test.test_lowwatercloud.Test_LowWaterCloud) ... ok
======================================================================
ERROR: test_fls_algorithm (fogpy.test.test_algorithms.Test_DayFogLowStratusAlgorithm)
----------------------------------------------------------------------
Traceback (most recent call last):
File "/home/gholl/checkouts/fogpy/fogpy/test/test_algorithms.py", line 202, in test_fls_algorithm
stationfile, bgimg=self.input['ir108'])
File "/home/gholl/checkouts/fogpy/fogpy/utils/add_synop.py", line 123, in add_to_image
stations = read_synop(bufr, 'visibility')
File "/home/gholl/checkouts/fogpy/fogpy/utils/import_synop.py", line 55, in read_synop
bfr.decode(blob)
File "/media/nas/x21324/miniconda3/envs/py27b/lib/python2.7/site-packages/trollbufr/bufr.py", line 385, in decode
self.decode_meta(bin_data, load_tables)
File "/media/nas/x21324/miniconda3/envs/py27b/lib/python2.7/site-packages/trollbufr/bufr.py", line 369, in decode_meta
raise tables_fail
BufrTableError: BufrTableError: Table not found: '/data/tleppelt/git/trollbufr/table_b_013'
-------------------- >> begin captured logging << --------------------
fogpy.algorithms: INFO: Starting fog and low cloud detection algorithm in daytime mode
fogpy.filters: INFO: Applying Cloud Filter
fogpy.filters: DEBUG: Histogram range for cloudy/clear sky pixels: -19.7446861967 - 1.11645277953
fogpy.filters: DEBUG: Cloud mask difference threshold set to -3.51935588185
fogpy.filters: INFO: Filter results for CloudFilter
Cloud filtering for satellite images.
Array size: 42018
Masking: 20551
Previous masked: 0
New filtered: 20551
Remaining: 21467
trollimage.image: DEBUG: Applying stretch crude with parameters {}
trollimage.image: DEBUG: Applying invert with parameters True
trollimage.image: DEBUG: Applying stretch crude with parameters {}
trollimage.image: DEBUG: Applying invert with parameters True
fogpy.filters: INFO: CloudFilter results are plotted to: /tmp/FLS/CloudFilter_201311120830.png
trollimage.image: DEBUG: Applying stretch crude with parameters {}
trollimage.image: WARNING: Nothing to stretch !
trollimage.image: DEBUG: Applying invert with parameters True
fogpy.filters: INFO: Applying Snow Filter
fogpy.filters: INFO: Filter results for SnowFilter
Snow filtering for satellite images.
Array size: 42018
Masking: 577
Previous masked: 20551
New filtered: 0
Remaining: 21467
trollimage.image: DEBUG: Applying stretch crude with parameters {}
trollimage.image: DEBUG: Applying invert with parameters True
trollimage.image: DEBUG: Applying stretch crude with parameters {}
trollimage.image: DEBUG: Applying invert with parameters True
fogpy.filters: INFO: SnowFilter results are plotted to: /tmp/FLS/SnowFilter_201311120830.png
trollimage.image: DEBUG: Applying stretch crude with parameters {}
trollimage.image: WARNING: Nothing to stretch !
trollimage.image: DEBUG: Applying invert with parameters True
fogpy.filters: INFO: Applying Snow Filter
fogpy.filters: INFO: Filter results for IceCloudFilter
Ice cloud filtering for satellite images.
Array size: 42018
Masking: 36632
Previous masked: 20551
New filtered: 16473
Remaining: 4994
trollimage.image: DEBUG: Applying stretch crude with parameters {}
trollimage.image: DEBUG: Applying invert with parameters True
trollimage.image: DEBUG: Applying stretch crude with parameters {}
trollimage.image: DEBUG: Applying invert with parameters True
fogpy.filters: INFO: IceCloudFilter results are plotted to: /tmp/FLS/IceCloudFilter_201311120830.png
trollimage.image: DEBUG: Applying stretch crude with parameters {}
trollimage.image: WARNING: Nothing to stretch !
trollimage.image: DEBUG: Applying invert with parameters True
fogpy.filters: INFO: Applying Cirrus Filter
fogpy.filters: DEBUG: Found solar zenith angles from 71.45427646160117 to 81.94458529861542°
fogpy.filters: DEBUG: Set BT difference thresholds for cirrus: 1.1 to 2.3 K
fogpy.filters: INFO: Filter results for CirrusCloudFilter
Thin cirrus cloud filtering for satellite images.
Array size: 42018
Masking: 9398
Previous masked: 37024
New filtered: 7
Remaining: 4987
trollimage.image: DEBUG: Applying stretch crude with parameters {}
trollimage.image: DEBUG: Applying invert with parameters True
trollimage.image: DEBUG: Applying stretch crude with parameters {}
trollimage.image: DEBUG: Applying invert with parameters True
fogpy.filters: INFO: CirrusCloudFilter results are plotted to: /tmp/FLS/CirrusCloudFilter_201311120830.png
trollimage.image: DEBUG: Applying stretch crude with parameters {}
trollimage.image: WARNING: Nothing to stretch !
trollimage.image: DEBUG: Applying invert with parameters True
fogpy.filters: INFO: Applying Water Cloud Filter
fogpy.filters: DEBUG: Mean latitudinal threshold for cloudfree areas: 271.07 K
fogpy.filters: INFO: Filter results for WaterCloudFilter
Water cloud filtering for satellite images.
Array size: 42018
Masking: 19857
Previous masked: 37031
New filtered: 112
Remaining: 4875
trollimage.image: DEBUG: Applying stretch crude with parameters {}
trollimage.image: DEBUG: Applying invert with parameters True
trollimage.image: DEBUG: Applying stretch crude with parameters {}
trollimage.image: DEBUG: Applying invert with parameters True
fogpy.filters: INFO: WaterCloudFilter results are plotted to: /tmp/FLS/WaterCloudFilter_201311120830.png
trollimage.image: DEBUG: Applying stretch crude with parameters {}
trollimage.image: WARNING: Nothing to stretch !
trollimage.image: DEBUG: Applying invert with parameters True
fogpy.algorithms: INFO: Clustering low clouds
fogpy.algorithms: DEBUG: Number of spatial coherent fog cloud clusters: 151
trollimage.image: DEBUG: Applying stretch crude with parameters {}
fogpy.algorithms: INFO: DayFogLowStratusAlgorithm results are plotted to: /tmp/FLS
fogpy.filters: INFO: Applying Spatial Cloud Top Height Filter
fogpy.filters: INFO: Filter results for SpatialCloudTopHeightFilter
Filtering cloud clusters by height for satellite images.
Array size: 42018
Masking: 17144
Previous masked: 37143
New filtered: 514
Remaining: 4361
trollimage.image: DEBUG: Applying stretch crude with parameters {}
trollimage.image: DEBUG: Applying invert with parameters True
trollimage.image: DEBUG: Applying stretch crude with parameters {}
trollimage.image: DEBUG: Applying invert with parameters True
fogpy.filters: INFO: SpatialCloudTopHeightFilter results are plotted to: /tmp/FLS/SpatialCloudTopHeightFilter_201311120830.png
trollimage.image: DEBUG: Applying stretch crude with parameters {}
trollimage.image: WARNING: Nothing to stretch !
trollimage.image: DEBUG: Applying invert with parameters True
fogpy.algorithms: INFO: Clustering low clouds
fogpy.algorithms: DEBUG: Number of spatial coherent fog cloud clusters: 91
fogpy.filters: INFO: Applying Spatial Clustering Inhomogeneity Filter
fogpy.filters: INFO: Filter results for SpatialHomogeneityFilter
Filtering cloud clusters by StDev for satellite images.
Array size: 42018
Masking: 37657
Previous masked: 37657
New filtered: 0
Remaining: 4361
trollimage.image: DEBUG: Applying stretch crude with parameters {}
trollimage.image: DEBUG: Applying invert with parameters True
trollimage.image: DEBUG: Applying stretch crude with parameters {}
trollimage.image: DEBUG: Applying invert with parameters True
fogpy.filters: INFO: SpatialHomogeneityFilter results are plotted to: /tmp/FLS/SpatialHomogeneityFilter_201311120830.png
trollimage.image: DEBUG: Applying stretch crude with parameters {}
trollimage.image: WARNING: Nothing to stretch !
trollimage.image: DEBUG: Applying invert with parameters True
fogpy.filters: INFO: Applying Spatial Clustering Inhomogenity Filter
fogpy.filters: INFO: Filter results for CloudPhysicsFilter
Filtering cloud microphysics for satellite images.
Array size: 42018
Masking: 14340
Previous masked: 37657
New filtered: 568
Remaining: 3793
trollimage.image: DEBUG: Applying stretch crude with parameters {}
trollimage.image: DEBUG: Applying invert with parameters True
trollimage.image: DEBUG: Applying stretch crude with parameters {}
trollimage.image: DEBUG: Applying invert with parameters True
fogpy.filters: INFO: CloudPhysicsFilter results are plotted to: /tmp/FLS/CloudPhysicsFilter_201311120830.png
trollimage.image: DEBUG: Applying stretch crude with parameters {}
trollimage.image: WARNING: Nothing to stretch !
trollimage.image: DEBUG: Applying invert with parameters True
fogpy.algorithms: INFO: Clustering low clouds
fogpy.algorithms: DEBUG: Number of spatial coherent fog cloud clusters: 117
fogpy.filters: INFO: Applying Low Cloud Filter
fogpy.filters: INFO: Run low cloud models for single cells
fogpy.filters: INFO: 3790 Tasks Remaining --- 0.08 % Complete
fogpy.filters: INFO: 3775 Tasks Remaining --- 0.47 % Complete
fogpy.filters: INFO: 3758 Tasks Remaining --- 0.92 % Complete
fogpy.filters: INFO: 3744 Tasks Remaining --- 1.29 % Complete
fogpy.filters: INFO: 3730 Tasks Remaining --- 1.66 % Complete
fogpy.filters: INFO: 3713 Tasks Remaining --- 2.11 % Complete
fogpy.filters: INFO: 3698 Tasks Remaining --- 2.50 % Complete
fogpy.filters: INFO: 3683 Tasks Remaining --- 2.90 % Complete
fogpy.filters: INFO: 3671 Tasks Remaining --- 3.22 % Complete
fogpy.filters: INFO: 3660 Tasks Remaining --- 3.51 % Complete
fogpy.filters: INFO: 3645 Tasks Remaining --- 3.90 % Complete
fogpy.filters: INFO: 3632 Tasks Remaining --- 4.24 % Complete
fogpy.filters: INFO: 3620 Tasks Remaining --- 4.56 % Complete
fogpy.filters: INFO: 3605 Tasks Remaining --- 4.96 % Complete
fogpy.filters: INFO: 3592 Tasks Remaining --- 5.30 % Complete
fogpy.filters: INFO: 3573 Tasks Remaining --- 5.80 % Complete
fogpy.filters: INFO: 3558 Tasks Remaining --- 6.20 % Complete
fogpy.filters: INFO: 3544 Tasks Remaining --- 6.56 % Complete
fogpy.filters: INFO: 3530 Tasks Remaining --- 6.93 % Complete
fogpy.filters: INFO: 3513 Tasks Remaining --- 7.38 % Complete
fogpy.filters: INFO: 3499 Tasks Remaining --- 7.75 % Complete
fogpy.filters: INFO: 3483 Tasks Remaining --- 8.17 % Complete
fogpy.filters: INFO: 3465 Tasks Remaining --- 8.65 % Complete
fogpy.filters: INFO: 3448 Tasks Remaining --- 9.10 % Complete
fogpy.filters: INFO: 3436 Tasks Remaining --- 9.41 % Complete
fogpy.filters: INFO: 3419 Tasks Remaining --- 9.86 % Complete
fogpy.filters: INFO: 3405 Tasks Remaining --- 10.23 % Complete
fogpy.filters: INFO: 3394 Tasks Remaining --- 10.52 % Complete
fogpy.filters: INFO: 3379 Tasks Remaining --- 10.91 % Complete
fogpy.filters: INFO: 3371 Tasks Remaining --- 11.13 % Complete
fogpy.filters: INFO: 3361 Tasks Remaining --- 11.39 % Complete
fogpy.filters: INFO: 3351 Tasks Remaining --- 11.65 % Complete
fogpy.filters: INFO: 3339 Tasks Remaining --- 11.97 % Complete
fogpy.filters: INFO: 3330 Tasks Remaining --- 12.21 % Complete
fogpy.filters: INFO: 3320 Tasks Remaining --- 12.47 % Complete
fogpy.filters: INFO: 3308 Tasks Remaining --- 12.79 % Complete
fogpy.filters: INFO: 3299 Tasks Remaining --- 13.02 % Complete
fogpy.filters: INFO: 3288 Tasks Remaining --- 13.31 % Complete
fogpy.filters: INFO: 3276 Tasks Remaining --- 13.63 % Complete
fogpy.filters: INFO: 3267 Tasks Remaining --- 13.87 % Complete
fogpy.filters: INFO: 3258 Tasks Remaining --- 14.10 % Complete
fogpy.filters: INFO: 3245 Tasks Remaining --- 14.45 % Complete
fogpy.filters: INFO: 3231 Tasks Remaining --- 14.82 % Complete
fogpy.filters: INFO: 3222 Tasks Remaining --- 15.05 % Complete
fogpy.filters: INFO: 3214 Tasks Remaining --- 15.26 % Complete
fogpy.filters: INFO: 3204 Tasks Remaining --- 15.53 % Complete
fogpy.filters: INFO: 3189 Tasks Remaining --- 15.92 % Complete
fogpy.filters: INFO: 3176 Tasks Remaining --- 16.27 % Complete
fogpy.filters: INFO: 3168 Tasks Remaining --- 16.48 % Complete
fogpy.filters: INFO: 3157 Tasks Remaining --- 16.77 % Complete
fogpy.filters: INFO: 3144 Tasks Remaining --- 17.11 % Complete
fogpy.filters: INFO: 3130 Tasks Remaining --- 17.48 % Complete
fogpy.filters: INFO: 3116 Tasks Remaining --- 17.85 % Complete
fogpy.filters: INFO: 3104 Tasks Remaining --- 18.17 % Complete
fogpy.filters: INFO: 3093 Tasks Remaining --- 18.46 % Complete
fogpy.filters: INFO: 3084 Tasks Remaining --- 18.69 % Complete
fogpy.filters: INFO: 3073 Tasks Remaining --- 18.98 % Complete
fogpy.filters: INFO: 3055 Tasks Remaining --- 19.46 % Complete
fogpy.filters: INFO: 3045 Tasks Remaining --- 19.72 % Complete
fogpy.filters: INFO: 3035 Tasks Remaining --- 19.98 % Complete
fogpy.filters: INFO: 3020 Tasks Remaining --- 20.38 % Complete
fogpy.filters: INFO: 3011 Tasks Remaining --- 20.62 % Complete
fogpy.filters: INFO: 2994 Tasks Remaining --- 21.07 % Complete
fogpy.filters: INFO: 2984 Tasks Remaining --- 21.33 % Complete
fogpy.filters: INFO: 2974 Tasks Remaining --- 21.59 % Complete
fogpy.filters: INFO: 2963 Tasks Remaining --- 21.88 % Complete
fogpy.filters: INFO: 2950 Tasks Remaining --- 22.23 % Complete
fogpy.filters: INFO: 2936 Tasks Remaining --- 22.59 % Complete
fogpy.filters: INFO: 2924 Tasks Remaining --- 22.91 % Complete
fogpy.filters: INFO: 2914 Tasks Remaining --- 23.17 % Complete
fogpy.filters: INFO: 2904 Tasks Remaining --- 23.44 % Complete
fogpy.filters: INFO: 2891 Tasks Remaining --- 23.78 % Complete
fogpy.filters: INFO: 2879 Tasks Remaining --- 24.10 % Complete
fogpy.filters: INFO: 2861 Tasks Remaining --- 24.57 % Complete
fogpy.filters: INFO: 2851 Tasks Remaining --- 24.84 % Complete
fogpy.filters: INFO: 2840 Tasks Remaining --- 25.13 % Complete
fogpy.filters: INFO: 2828 Tasks Remaining --- 25.44 % Complete
fogpy.filters: INFO: 2815 Tasks Remaining --- 25.78 % Complete
fogpy.filters: INFO: 2801 Tasks Remaining --- 26.15 % Complete
fogpy.filters: INFO: 2785 Tasks Remaining --- 26.58 % Complete
fogpy.filters: INFO: 2772 Tasks Remaining --- 26.92 % Complete
fogpy.filters: INFO: 2763 Tasks Remaining --- 27.16 % Complete
fogpy.filters: INFO: 2754 Tasks Remaining --- 27.39 % Complete
fogpy.filters: INFO: 2739 Tasks Remaining --- 27.79 % Complete
fogpy.filters: INFO: 2726 Tasks Remaining --- 28.13 % Complete
fogpy.filters: INFO: 2712 Tasks Remaining --- 28.50 % Complete
fogpy.filters: INFO: 2698 Tasks Remaining --- 28.87 % Complete
fogpy.filters: INFO: 2688 Tasks Remaining --- 29.13 % Complete
fogpy.filters: INFO: 2678 Tasks Remaining --- 29.40 % Complete
fogpy.filters: INFO: 2665 Tasks Remaining --- 29.74 % Complete
fogpy.filters: INFO: 2649 Tasks Remaining --- 30.16 % Complete
fogpy.filters: INFO: 2639 Tasks Remaining --- 30.42 % Complete
fogpy.filters: INFO: 2624 Tasks Remaining --- 30.82 % Complete
fogpy.filters: INFO: 2611 Tasks Remaining --- 31.16 % Complete
fogpy.filters: INFO: 2599 Tasks Remaining --- 31.48 % Complete
fogpy.filters: INFO: 2590 Tasks Remaining --- 31.72 % Complete
fogpy.filters: INFO: 2580 Tasks Remaining --- 31.98 % Complete
fogpy.filters: INFO: 2567 Tasks Remaining --- 32.32 % Complete
fogpy.filters: INFO: 2553 Tasks Remaining --- 32.69 % Complete
fogpy.filters: INFO: 2542 Tasks Remaining --- 32.98 % Complete
fogpy.filters: INFO: 2526 Tasks Remaining --- 33.40 % Complete
fogpy.filters: INFO: 2513 Tasks Remaining --- 33.75 % Complete
fogpy.filters: INFO: 2502 Tasks Remaining --- 34.04 % Complete
fogpy.filters: INFO: 2490 Tasks Remaining --- 34.35 % Complete
fogpy.filters: INFO: 2482 Tasks Remaining --- 34.56 % Complete
fogpy.filters: INFO: 2466 Tasks Remaining --- 34.99 % Complete
fogpy.filters: INFO: 2454 Tasks Remaining --- 35.30 % Complete
fogpy.filters: INFO: 2441 Tasks Remaining --- 35.64 % Complete
fogpy.filters: INFO: 2430 Tasks Remaining --- 35.93 % Complete
fogpy.filters: INFO: 2418 Tasks Remaining --- 36.25 % Complete
fogpy.filters: INFO: 2406 Tasks Remaining --- 36.57 % Complete
fogpy.filters: INFO: 2394 Tasks Remaining --- 36.88 % Complete
fogpy.filters: INFO: 2384 Tasks Remaining --- 37.15 % Complete
fogpy.filters: INFO: 2371 Tasks Remaining --- 37.49 % Complete
fogpy.filters: INFO: 2357 Tasks Remaining --- 37.86 % Complete
fogpy.filters: INFO: 2346 Tasks Remaining --- 38.15 % Complete
fogpy.filters: INFO: 2334 Tasks Remaining --- 38.47 % Complete
fogpy.filters: INFO: 2322 Tasks Remaining --- 38.78 % Complete
fogpy.filters: INFO: 2311 Tasks Remaining --- 39.07 % Complete
fogpy.filters: INFO: 2293 Tasks Remaining --- 39.55 % Complete
fogpy.filters: INFO: 2285 Tasks Remaining --- 39.76 % Complete
fogpy.filters: INFO: 2275 Tasks Remaining --- 40.02 % Complete
fogpy.filters: INFO: 2260 Tasks Remaining --- 40.42 % Complete
fogpy.filters: INFO: 2250 Tasks Remaining --- 40.68 % Complete
fogpy.filters: INFO: 2236 Tasks Remaining --- 41.05 % Complete
fogpy.filters: INFO: 2225 Tasks Remaining --- 41.34 % Complete
fogpy.filters: INFO: 2213 Tasks Remaining --- 41.66 % Complete
fogpy.filters: INFO: 2202 Tasks Remaining --- 41.95 % Complete
fogpy.filters: INFO: 2189 Tasks Remaining --- 42.29 % Complete
fogpy.filters: INFO: 2178 Tasks Remaining --- 42.58 % Complete
fogpy.filters: INFO: 2170 Tasks Remaining --- 42.79 % Complete
fogpy.filters: INFO: 2157 Tasks Remaining --- 43.13 % Complete
fogpy.filters: INFO: 2146 Tasks Remaining --- 43.42 % Complete
fogpy.filters: INFO: 2132 Tasks Remaining --- 43.79 % Complete
fogpy.filters: INFO: 2122 Tasks Remaining --- 44.05 % Complete
fogpy.filters: INFO: 2110 Tasks Remaining --- 44.37 % Complete
fogpy.filters: INFO: 2099 Tasks Remaining --- 44.66 % Complete
fogpy.filters: INFO: 2086 Tasks Remaining --- 45.00 % Complete
fogpy.filters: INFO: 2071 Tasks Remaining --- 45.40 % Complete
fogpy.filters: INFO: 2058 Tasks Remaining --- 45.74 % Complete
fogpy.filters: INFO: 2046 Tasks Remaining --- 46.06 % Complete
fogpy.filters: INFO: 2034 Tasks Remaining --- 46.37 % Complete
fogpy.filters: INFO: 2024 Tasks Remaining --- 46.64 % Complete
fogpy.filters: INFO: 2012 Tasks Remaining --- 46.95 % Complete
fogpy.filters: INFO: 1999 Tasks Remaining --- 47.30 % Complete
fogpy.filters: INFO: 1984 Tasks Remaining --- 47.69 % Complete
fogpy.filters: INFO: 1969 Tasks Remaining --- 48.09 % Complete
fogpy.filters: INFO: 1955 Tasks Remaining --- 48.46 % Complete
fogpy.filters: INFO: 1944 Tasks Remaining --- 48.75 % Complete
fogpy.filters: INFO: 1930 Tasks Remaining --- 49.12 % Complete
fogpy.filters: INFO: 1920 Tasks Remaining --- 49.38 % Complete
fogpy.filters: INFO: 1903 Tasks Remaining --- 49.83 % Complete
fogpy.filters: INFO: 1891 Tasks Remaining --- 50.15 % Complete
fogpy.filters: INFO: 1879 Tasks Remaining --- 50.46 % Complete
fogpy.filters: INFO: 1868 Tasks Remaining --- 50.75 % Complete
fogpy.filters: INFO: 1853 Tasks Remaining --- 51.15 % Complete
fogpy.filters: INFO: 1840 Tasks Remaining --- 51.49 % Complete
fogpy.filters: INFO: 1828 Tasks Remaining --- 51.81 % Complete
fogpy.filters: INFO: 1817 Tasks Remaining --- 52.10 % Complete
fogpy.filters: INFO: 1805 Tasks Remaining --- 52.41 % Complete
fogpy.filters: INFO: 1792 Tasks Remaining --- 52.76 % Complete
fogpy.filters: INFO: 1782 Tasks Remaining --- 53.02 % Complete
fogpy.filters: INFO: 1769 Tasks Remaining --- 53.36 % Complete
fogpy.filters: INFO: 1758 Tasks Remaining --- 53.65 % Complete
fogpy.filters: INFO: 1743 Tasks Remaining --- 54.05 % Complete
fogpy.filters: INFO: 1730 Tasks Remaining --- 54.39 % Complete
fogpy.filters: INFO: 1721 Tasks Remaining --- 54.63 % Complete
fogpy.filters: INFO: 1708 Tasks Remaining --- 54.97 % Complete
fogpy.filters: INFO: 1697 Tasks Remaining --- 55.26 % Complete
fogpy.filters: INFO: 1682 Tasks Remaining --- 55.66 % Complete
fogpy.filters: INFO: 1674 Tasks Remaining --- 55.87 % Complete
fogpy.filters: INFO: 1660 Tasks Remaining --- 56.24 % Complete
fogpy.filters: INFO: 1650 Tasks Remaining --- 56.50 % Complete
fogpy.filters: INFO: 1633 Tasks Remaining --- 56.95 % Complete
fogpy.filters: INFO: 1618 Tasks Remaining --- 57.34 % Complete
fogpy.filters: INFO: 1606 Tasks Remaining --- 57.66 % Complete
fogpy.filters: INFO: 1596 Tasks Remaining --- 57.92 % Complete
fogpy.filters: INFO: 1584 Tasks Remaining --- 58.24 % Complete
fogpy.filters: INFO: 1573 Tasks Remaining --- 58.53 % Complete
fogpy.filters: INFO: 1559 Tasks Remaining --- 58.90 % Complete
fogpy.filters: INFO: 1549 Tasks Remaining --- 59.16 % Complete
fogpy.filters: INFO: 1537 Tasks Remaining --- 59.48 % Complete
fogpy.filters: INFO: 1524 Tasks Remaining --- 59.82 % Complete
fogpy.filters: INFO: 1512 Tasks Remaining --- 60.14 % Complete
fogpy.filters: INFO: 1496 Tasks Remaining --- 60.56 % Complete
fogpy.filters: INFO: 1483 Tasks Remaining --- 60.90 % Complete
fogpy.filters: INFO: 1472 Tasks Remaining --- 61.19 % Complete
fogpy.filters: INFO: 1461 Tasks Remaining --- 61.48 % Complete
fogpy.filters: INFO: 1449 Tasks Remaining --- 61.80 % Complete
fogpy.filters: INFO: 1434 Tasks Remaining --- 62.19 % Complete
fogpy.filters: INFO: 1419 Tasks Remaining --- 62.59 % Complete
fogpy.filters: INFO: 1408 Tasks Remaining --- 62.88 % Complete
fogpy.filters: INFO: 1393 Tasks Remaining --- 63.27 % Complete
fogpy.filters: INFO: 1377 Tasks Remaining --- 63.70 % Complete
fogpy.filters: INFO: 1366 Tasks Remaining --- 63.99 % Complete
fogpy.filters: INFO: 1353 Tasks Remaining --- 64.33 % Complete
fogpy.filters: INFO: 1339 Tasks Remaining --- 64.70 % Complete
fogpy.filters: INFO: 1328 Tasks Remaining --- 64.99 % Complete
fogpy.filters: INFO: 1314 Tasks Remaining --- 65.36 % Complete
fogpy.filters: INFO: 1303 Tasks Remaining --- 65.65 % Complete
fogpy.filters: INFO: 1292 Tasks Remaining --- 65.94 % Complete
fogpy.filters: INFO: 1280 Tasks Remaining --- 66.25 % Complete
fogpy.filters: INFO: 1266 Tasks Remaining --- 66.62 % Complete
fogpy.filters: INFO: 1252 Tasks Remaining --- 66.99 % Complete
fogpy.filters: INFO: 1238 Tasks Remaining --- 67.36 % Complete
fogpy.filters: INFO: 1224 Tasks Remaining --- 67.73 % Complete
fogpy.filters: INFO: 1206 Tasks Remaining --- 68.20 % Complete
fogpy.filters: INFO: 1196 Tasks Remaining --- 68.47 % Complete
fogpy.filters: INFO: 1184 Tasks Remaining --- 68.78 % Complete
fogpy.filters: INFO: 1170 Tasks Remaining --- 69.15 % Complete
fogpy.filters: INFO: 1158 Tasks Remaining --- 69.47 % Complete
fogpy.filters: INFO: 1146 Tasks Remaining --- 69.79 % Complete
fogpy.filters: INFO: 1131 Tasks Remaining --- 70.18 % Complete
fogpy.filters: INFO: 1119 Tasks Remaining --- 70.50 % Complete
fogpy.filters: INFO: 1107 Tasks Remaining --- 70.81 % Complete
fogpy.filters: INFO: 1088 Tasks Remaining --- 71.32 % Complete
fogpy.filters: INFO: 1079 Tasks Remaining --- 71.55 % Complete
fogpy.filters: INFO: 1068 Tasks Remaining --- 71.84 % Complete
fogpy.filters: INFO: 1055 Tasks Remaining --- 72.19 % Complete
fogpy.filters: INFO: 1042 Tasks Remaining --- 72.53 % Complete
fogpy.filters: INFO: 1031 Tasks Remaining --- 72.82 % Complete
fogpy.filters: INFO: 1017 Tasks Remaining --- 73.19 % Complete
fogpy.filters: INFO: 1005 Tasks Remaining --- 73.50 % Complete
fogpy.filters: INFO: 996 Tasks Remaining --- 73.74 % Complete
fogpy.filters: INFO: 981 Tasks Remaining --- 74.14 % Complete
fogpy.filters: INFO: 967 Tasks Remaining --- 74.51 % Complete
fogpy.filters: INFO: 955 Tasks Remaining --- 74.82 % Complete
fogpy.filters: INFO: 944 Tasks Remaining --- 75.11 % Complete
fogpy.filters: INFO: 932 Tasks Remaining --- 75.43 % Complete
fogpy.filters: INFO: 919 Tasks Remaining --- 75.77 % Complete
fogpy.filters: INFO: 904 Tasks Remaining --- 76.17 % Complete
fogpy.filters: INFO: 889 Tasks Remaining --- 76.56 % Complete
fogpy.filters: INFO: 873 Tasks Remaining --- 76.98 % Complete
fogpy.filters: INFO: 864 Tasks Remaining --- 77.22 % Complete
fogpy.filters: INFO: 853 Tasks Remaining --- 77.51 % Complete
fogpy.filters: INFO: 839 Tasks Remaining --- 77.88 % Complete
fogpy.filters: INFO: 829 Tasks Remaining --- 78.14 % Complete
fogpy.filters: INFO: 819 Tasks Remaining --- 78.41 % Complete
fogpy.filters: INFO: 802 Tasks Remaining --- 78.86 % Complete
fogpy.filters: INFO: 786 Tasks Remaining --- 79.28 % Complete
fogpy.filters: INFO: 776 Tasks Remaining --- 79.54 % Complete
fogpy.filters: INFO: 767 Tasks Remaining --- 79.78 % Complete
fogpy.filters: INFO: 751 Tasks Remaining --- 80.20 % Complete
fogpy.filters: INFO: 738 Tasks Remaining --- 80.54 % Complete
fogpy.filters: INFO: 726 Tasks Remaining --- 80.86 % Complete
fogpy.filters: INFO: 711 Tasks Remaining --- 81.25 % Complete
fogpy.filters: INFO: 697 Tasks Remaining --- 81.62 % Complete
fogpy.filters: INFO: 685 Tasks Remaining --- 81.94 % Complete
fogpy.filters: INFO: 669 Tasks Remaining --- 82.36 % Complete
fogpy.filters: INFO: 660 Tasks Remaining --- 82.60 % Complete
fogpy.filters: INFO: 648 Tasks Remaining --- 82.92 % Complete
fogpy.filters: INFO: 632 Tasks Remaining --- 83.34 % Complete
fogpy.filters: INFO: 621 Tasks Remaining --- 83.63 % Complete
fogpy.filters: INFO: 606 Tasks Remaining --- 84.02 % Complete
fogpy.filters: INFO: 596 Tasks Remaining --- 84.29 % Complete
fogpy.filters: INFO: 584 Tasks Remaining --- 84.60 % Complete
fogpy.filters: INFO: 570 Tasks Remaining --- 84.97 % Complete
fogpy.filters: INFO: 549 Tasks Remaining --- 85.53 % Complete
fogpy.filters: INFO: 539 Tasks Remaining --- 85.79 % Complete
fogpy.filters: INFO: 527 Tasks Remaining --- 86.11 % Complete
fogpy.filters: INFO: 512 Tasks Remaining --- 86.50 % Complete
fogpy.filters: INFO: 498 Tasks Remaining --- 86.87 % Complete
fogpy.filters: INFO: 479 Tasks Remaining --- 87.37 % Complete
fogpy.filters: INFO: 468 Tasks Remaining --- 87.66 % Complete
fogpy.filters: INFO: 455 Tasks Remaining --- 88.00 % Complete
fogpy.filters: INFO: 443 Tasks Remaining --- 88.32 % Complete
fogpy.filters: INFO: 414 Tasks Remaining --- 89.09 % Complete
fogpy.filters: INFO: 402 Tasks Remaining --- 89.40 % Complete
fogpy.filters: INFO: 393 Tasks Remaining --- 89.64 % Complete
fogpy.filters: INFO: 378 Tasks Remaining --- 90.03 % Complete
fogpy.filters: INFO: 356 Tasks Remaining --- 90.61 % Complete
fogpy.filters: INFO: 335 Tasks Remaining --- 91.17 % Complete
fogpy.filters: INFO: 319 Tasks Remaining --- 91.59 % Complete
fogpy.filters: INFO: 309 Tasks Remaining --- 91.85 % Complete
fogpy.filters: INFO: 290 Tasks Remaining --- 92.35 % Complete
fogpy.filters: INFO: 270 Tasks Remaining --- 92.88 % Complete
fogpy.filters: INFO: 257 Tasks Remaining --- 93.22 % Complete
fogpy.filters: INFO: 245 Tasks Remaining --- 93.54 % Complete
fogpy.filters: INFO: 215 Tasks Remaining --- 94.33 % Complete
fogpy.filters: INFO: 202 Tasks Remaining --- 94.67 % Complete
fogpy.filters: INFO: 191 Tasks Remaining --- 94.96 % Complete
fogpy.filters: INFO: 182 Tasks Remaining --- 95.20 % Complete
fogpy.filters: INFO: 164 Tasks Remaining --- 95.68 % Complete
fogpy.filters: INFO: 132 Tasks Remaining --- 96.52 % Complete
fogpy.filters: INFO: 122 Tasks Remaining --- 96.78 % Complete
fogpy.filters: INFO: 111 Tasks Remaining --- 97.07 % Complete
fogpy.filters: INFO: 98 Tasks Remaining --- 97.42 % Complete
fogpy.filters: INFO: 82 Tasks Remaining --- 97.84 % Complete
fogpy.filters: INFO: 58 Tasks Remaining --- 98.47 % Complete
fogpy.filters: INFO: 38 Tasks Remaining --- 99.00 % Complete
fogpy.filters: INFO: 27 Tasks Remaining --- 99.29 % Complete
fogpy.filters: INFO: 15 Tasks Remaining --- 99.60 % Complete
fogpy.filters: INFO: 5 Tasks Remaining --- 99.87 % Complete
fogpy.filters: INFO: All Done. Completed 3793 tasks
fogpy.filters: INFO: Finished low cloud models for 3793 cells
fogpy.filters: INFO: Filter results for LowCloudFilter
Filtering low clouds for satellite images.
Array size: 42018
Masking: 41828
Previous masked: 38225
New filtered: 3603
Remaining: 190
trollimage.image: DEBUG: Applying stretch crude with parameters {}
trollimage.image: DEBUG: Applying invert with parameters True
trollimage.image: DEBUG: Applying stretch crude with parameters {}
trollimage.image: DEBUG: Applying invert with parameters True
fogpy.filters: INFO: LowCloudFilter results are plotted to: /tmp/FLS/LowCloudFilter_201311120830.png
trollimage.image: DEBUG: Applying stretch crude with parameters {}
trollimage.image: WARNING: Nothing to stretch !
trollimage.image: DEBUG: Applying invert with parameters True
fogpy.filters: INFO: Plotting filter attribute cbh to /tmp/FLS/LowCloudFilter_cbh_201311120830.png
trollimage.image: DEBUG: Applying stretch crude with parameters {}
trollimage.image: DEBUG: Applying invert with parameters True
fogpy.filters: INFO: Plotting filter attribute fbh to /tmp/FLS/LowCloudFilter_fbh_201311120830.png
trollimage.image: DEBUG: Applying stretch crude with parameters {}
trollimage.image: DEBUG: Applying invert with parameters True
fogpy.algorithms: INFO: Finish fog and low cloud detection algorithm
trollimage.image: DEBUG: Applying stretch crude with parameters {}
fogpy.algorithms: INFO: Set color range to (267.44605080253444, 274.3928131405534)
fogpy.algorithms: INFO: DayFogLowStratusAlgorithm results are plotted to: /tmp/FLS
trollimage.image: DEBUG: Applying stretch crude with parameters {}
--------------------- >> end captured logging << ---------------------
======================================================================
ERROR: test_fls_algorithm_other (fogpy.test.test_algorithms.Test_DayFogLowStratusAlgorithm)
----------------------------------------------------------------------
Traceback (most recent call last):
File "/home/gholl/checkouts/fogpy/fogpy/test/test_algorithms.py", line 232, in test_fls_algorithm_other
stationfile2, bgimg=self.input2['ir108'])
File "/home/gholl/checkouts/fogpy/fogpy/utils/add_synop.py", line 123, in add_to_image
stations = read_synop(bufr, 'visibility')
File "/home/gholl/checkouts/fogpy/fogpy/utils/import_synop.py", line 55, in read_synop
bfr.decode(blob)
File "/media/nas/x21324/miniconda3/envs/py27b/lib/python2.7/site-packages/trollbufr/bufr.py", line 385, in decode
self.decode_meta(bin_data, load_tables)
File "/media/nas/x21324/miniconda3/envs/py27b/lib/python2.7/site-packages/trollbufr/bufr.py", line 369, in decode_meta
raise tables_fail
BufrTableError: BufrTableError: Table not found: '/data/tleppelt/git/trollbufr/table_b_013'
-------------------- >> begin captured logging << --------------------
fogpy.algorithms: INFO: Starting fog and low cloud detection algorithm in daytime mode
fogpy.filters: INFO: Applying Cloud Filter
fogpy.filters: DEBUG: Histogram range for cloudy/clear sky pixels: -6.48294205488 - 2.5771321229
fogpy.filters: DEBUG: Cloud mask difference threshold set to -1.95290496599
fogpy.filters: INFO: Filter results for CloudFilter
Cloud filtering for satellite images.
Array size: 42018
Masking: 16336
Previous masked: 0
New filtered: 16336
Remaining: 25682
trollimage.image: DEBUG: Applying stretch crude with parameters {}
trollimage.image: DEBUG: Applying invert with parameters True
trollimage.image: DEBUG: Applying stretch crude with parameters {}
trollimage.image: DEBUG: Applying invert with parameters True
fogpy.filters: INFO: CloudFilter results are plotted to: /tmp/FLS/CloudFilter_201408270715.png
trollimage.image: DEBUG: Applying stretch crude with parameters {}
trollimage.image: WARNING: Nothing to stretch !
trollimage.image: DEBUG: Applying invert with parameters True
fogpy.filters: INFO: Applying Snow Filter
fogpy.filters: INFO: Filter results for SnowFilter
Snow filtering for satellite images.
Array size: 42018
Masking: 183
Previous masked: 16336
New filtered: 144
Remaining: 25538
trollimage.image: DEBUG: Applying stretch crude with parameters {}
trollimage.image: DEBUG: Applying invert with parameters True
trollimage.image: DEBUG: Applying stretch crude with parameters {}
trollimage.image: DEBUG: Applying invert with parameters True
fogpy.filters: INFO: SnowFilter results are plotted to: /tmp/FLS/SnowFilter_201408270715.png
trollimage.image: DEBUG: Applying stretch crude with parameters {}
trollimage.image: WARNING: Nothing to stretch !
trollimage.image: DEBUG: Applying invert with parameters True
fogpy.filters: INFO: Applying Snow Filter
fogpy.filters: INFO: Filter results for IceCloudFilter
Ice cloud filtering for satellite images.
Array size: 42018
Masking: 35413
Previous masked: 16480
New filtered: 19524
Remaining: 6014
trollimage.image: DEBUG: Applying stretch crude with parameters {}
trollimage.image: DEBUG: Applying invert with parameters True
trollimage.image: DEBUG: Applying stretch crude with parameters {}
trollimage.image: DEBUG: Applying invert with parameters True
fogpy.filters: INFO: IceCloudFilter results are plotted to: /tmp/FLS/IceCloudFilter_201408270715.png
trollimage.image: DEBUG: Applying stretch crude with parameters {}
trollimage.image: WARNING: Nothing to stretch !
trollimage.image: DEBUG: Applying invert with parameters True
fogpy.filters: INFO: Applying Cirrus Filter
fogpy.filters: DEBUG: Found solar zenith angles from 59.83404307196856 to 69.19908223088952°
fogpy.filters: DEBUG: Set BT difference thresholds for cirrus: 1.1 to 4.73 K
fogpy.filters: INFO: Filter results for CirrusCloudFilter
Thin cirrus cloud filtering for satellite images.
Array size: 42018
Masking: 6617
Previous masked: 36004
New filtered: 15
Remaining: 5999
trollimage.image: DEBUG: Applying stretch crude with parameters {}
trollimage.image: DEBUG: Applying invert with parameters True
trollimage.image: DEBUG: Applying stretch crude with parameters {}
trollimage.image: DEBUG: Applying invert with parameters True
fogpy.filters: INFO: CirrusCloudFilter results are plotted to: /tmp/FLS/CirrusCloudFilter_201408270715.png
trollimage.image: DEBUG: Applying stretch crude with parameters {}
trollimage.image: WARNING: Nothing to stretch !
trollimage.image: DEBUG: Applying invert with parameters True
fogpy.filters: INFO: Applying Water Cloud Filter
fogpy.filters: DEBUG: Mean latitudinal threshold for cloudfree areas: 280.81 K
fogpy.filters: INFO: Filter results for WaterCloudFilter
Water cloud filtering for satellite images.
Array size: 42018
Masking: 21489
Previous masked: 36019
New filtered: 765
Remaining: 5234
trollimage.image: DEBUG: Applying stretch crude with parameters {}
trollimage.image: DEBUG: Applying invert with parameters True
trollimage.image: DEBUG: Applying stretch crude with parameters {}
trollimage.image: DEBUG: Applying invert with parameters True
fogpy.filters: INFO: WaterCloudFilter results are plotted to: /tmp/FLS/WaterCloudFilter_201408270715.png
trollimage.image: DEBUG: Applying stretch crude with parameters {}
trollimage.image: WARNING: Nothing to stretch !
trollimage.image: DEBUG: Applying invert with parameters True
fogpy.algorithms: INFO: Clustering low clouds
fogpy.algorithms: DEBUG: Number of spatial coherent fog cloud clusters: 318
trollimage.image: DEBUG: Applying stretch crude with parameters {}
fogpy.algorithms: INFO: DayFogLowStratusAlgorithm results are plotted to: /tmp/FLS
fogpy.filters: INFO: Applying Spatial Cloud Top Height Filter
fogpy.filters: INFO: Filter results for SpatialCloudTopHeightFilter
Filtering cloud clusters by height for satellite images.
Array size: 42018
Masking: 20746
Previous masked: 36784
New filtered: 2526
Remaining: 2708
trollimage.image: DEBUG: Applying stretch crude with parameters {}
trollimage.image: DEBUG: Applying invert with parameters True
trollimage.image: DEBUG: Applying stretch crude with parameters {}
trollimage.image: DEBUG: Applying invert with parameters True
fogpy.filters: INFO: SpatialCloudTopHeightFilter results are plotted to: /tmp/FLS/SpatialCloudTopHeightFilter_201408270715.png
trollimage.image: DEBUG: Applying stretch crude with parameters {}
trollimage.image: WARNING: Nothing to stretch !
trollimage.image: DEBUG: Applying invert with parameters True
fogpy.algorithms: INFO: Clustering low clouds
fogpy.algorithms: DEBUG: Number of spatial coherent fog cloud clusters: 142
fogpy.filters: INFO: Applying Spatial Clustering Inhomogeneity Filter
fogpy.filters: INFO: Filter results for SpatialHomogeneityFilter
Filtering cloud clusters by StDev for satellite images.
Array size: 42018
Masking: 39310
Previous masked: 39310
New filtered: 0
Remaining: 2708
trollimage.image: DEBUG: Applying stretch crude with parameters {}
trollimage.image: DEBUG: Applying invert with parameters True
trollimage.image: DEBUG: Applying stretch crude with parameters {}
trollimage.image: DEBUG: Applying invert with parameters True
fogpy.filters: INFO: SpatialHomogeneityFilter results are plotted to: /tmp/FLS/SpatialHomogeneityFilter_201408270715.png
trollimage.image: DEBUG: Applying stretch crude with parameters {}
trollimage.image: WARNING: Nothing to stretch !
trollimage.image: DEBUG: Applying invert with parameters True
fogpy.filters: INFO: Applying Spatial Clustering Inhomogenity Filter
fogpy.filters: INFO: Filter results for CloudPhysicsFilter
Filtering cloud microphysics for satellite images.
Array size: 42018
Masking: 11139
Previous masked: 39310
New filtered: 43
Remaining: 2665
trollimage.image: DEBUG: Applying stretch crude with parameters {}
trollimage.image: DEBUG: Applying invert with parameters True
trollimage.image: DEBUG: Applying stretch crude with parameters {}
trollimage.image: DEBUG: Applying invert with parameters True
fogpy.filters: INFO: CloudPhysicsFilter results are plotted to: /tmp/FLS/CloudPhysicsFilter_201408270715.png
trollimage.image: DEBUG: Applying stretch crude with parameters {}
trollimage.image: WARNING: Nothing to stretch !
trollimage.image: DEBUG: Applying invert with parameters True
fogpy.algorithms: INFO: Clustering low clouds
fogpy.algorithms: DEBUG: Number of spatial coherent fog cloud clusters: 148
fogpy.filters: INFO: Applying Low Cloud Filter
fogpy.filters: INFO: Run low cloud models for cloud clusters
fogpy.filters: INFO: 148 Tasks Remaining --- 0.00 % Complete
fogpy.filters: INFO: 146 Tasks Remaining --- 1.35 % Complete
fogpy.filters: INFO: 141 Tasks Remaining --- 4.73 % Complete
fogpy.filters: INFO: 137 Tasks Remaining --- 7.43 % Complete
fogpy.filters: INFO: 135 Tasks Remaining --- 8.78 % Complete
fogpy.filters: INFO: 126 Tasks Remaining --- 14.86 % Complete
fogpy.filters: INFO: 117 Tasks Remaining --- 20.95 % Complete
fogpy.filters: INFO: 112 Tasks Remaining --- 24.32 % Complete
fogpy.filters: INFO: 108 Tasks Remaining --- 27.03 % Complete
fogpy.filters: INFO: 102 Tasks Remaining --- 31.08 % Complete
fogpy.filters: INFO: 97 Tasks Remaining --- 34.46 % Complete
fogpy.filters: INFO: 92 Tasks Remaining --- 37.84 % Complete
fogpy.filters: INFO: 88 Tasks Remaining --- 40.54 % Complete
fogpy.filters: INFO: 83 Tasks Remaining --- 43.92 % Complete
fogpy.filters: INFO: 78 Tasks Remaining --- 47.30 % Complete
fogpy.filters: INFO: 74 Tasks Remaining --- 50.00 % Complete
fogpy.filters: INFO: 71 Tasks Remaining --- 52.03 % Complete
fogpy.filters: INFO: 68 Tasks Remaining --- 54.05 % Complete
fogpy.filters: INFO: 63 Tasks Remaining --- 57.43 % Complete
fogpy.filters: INFO: 60 Tasks Remaining --- 59.46 % Complete
fogpy.filters: INFO: 59 Tasks Remaining --- 60.14 % Complete
fogpy.filters: INFO: 56 Tasks Remaining --- 62.16 % Complete
fogpy.filters: INFO: 54 Tasks Remaining --- 63.51 % Complete
fogpy.filters: INFO: 50 Tasks Remaining --- 66.22 % Complete
fogpy.filters: INFO: 48 Tasks Remaining --- 67.57 % Complete
fogpy.filters: INFO: 46 Tasks Remaining --- 68.92 % Complete
fogpy.filters: INFO: 45 Tasks Remaining --- 69.59 % Complete
fogpy.filters: INFO: 41 Tasks Remaining --- 72.30 % Complete
fogpy.filters: INFO: 38 Tasks Remaining --- 74.32 % Complete
fogpy.filters: INFO: 33 Tasks Remaining --- 77.70 % Complete
fogpy.filters: INFO: 31 Tasks Remaining --- 79.05 % Complete
fogpy.filters: INFO: 28 Tasks Remaining --- 81.08 % Complete
fogpy.filters: INFO: 24 Tasks Remaining --- 83.78 % Complete
fogpy.filters: INFO: 23 Tasks Remaining --- 84.46 % Complete
fogpy.filters: INFO: 17 Tasks Remaining --- 88.51 % Complete
fogpy.filters: INFO: 15 Tasks Remaining --- 89.86 % Complete
fogpy.filters: INFO: 12 Tasks Remaining --- 91.89 % Complete
fogpy.filters: INFO: 9 Tasks Remaining --- 93.92 % Complete
fogpy.filters: INFO: 7 Tasks Remaining --- 95.27 % Complete
fogpy.filters: INFO: 5 Tasks Remaining --- 96.62 % Complete
fogpy.filters: INFO: 2 Tasks Remaining --- 98.65 % Complete
fogpy.filters: INFO: 2 Tasks Remaining --- 98.65 % Complete
fogpy.filters: INFO: 1 Tasks Remaining --- 99.32 % Complete
fogpy.filters: INFO: All Done. Completed 148 tasks
fogpy.filters: INFO: Filter results for LowCloudFilter
Filtering low clouds for satellite images.
Array size: 42018
Masking: 41758
Previous masked: 39353
New filtered: 2405
Remaining: 260
trollimage.image: DEBUG: Applying stretch crude with parameters {}
trollimage.image: DEBUG: Applying invert with parameters True
trollimage.image: DEBUG: Applying stretch crude with parameters {}
trollimage.image: DEBUG: Applying invert with parameters True
fogpy.filters: INFO: LowCloudFilter results are plotted to: /tmp/FLS/LowCloudFilter_201408270715.png
trollimage.image: DEBUG: Applying stretch crude with parameters {}
trollimage.image: WARNING: Nothing to stretch !
trollimage.image: DEBUG: Applying invert with parameters True
fogpy.filters: INFO: Plotting filter attribute cbh to /tmp/FLS/LowCloudFilter_cbh_201408270715.png
trollimage.image: DEBUG: Applying stretch crude with parameters {}
trollimage.image: DEBUG: Applying invert with parameters True
fogpy.filters: INFO: Plotting filter attribute fbh to /tmp/FLS/LowCloudFilter_fbh_201408270715.png
trollimage.image: DEBUG: Applying stretch crude with parameters {}
trollimage.image: DEBUG: Applying invert with parameters True
fogpy.algorithms: INFO: Finish fog and low cloud detection algorithm
trollimage.image: DEBUG: Applying stretch crude with parameters {}
fogpy.algorithms: INFO: Set color range to (270.74371804537725, 284.14751440203855)
fogpy.algorithms: INFO: DayFogLowStratusAlgorithm results are plotted to: /tmp/FLS
trollimage.image: DEBUG: Applying stretch crude with parameters {}
--------------------- >> end captured logging << ---------------------
======================================================================
ERROR: test_nightfls_algorithm (fogpy.test.test_algorithms.Test_NightFogLowStratusAlgorithm)
----------------------------------------------------------------------
Traceback (most recent call last):
File "/home/gholl/checkouts/fogpy/fogpy/test/test_algorithms.py", line 622, in setUp
line2=self.tle.line2)
File "/media/nas/x21324/miniconda3/envs/py27b/lib/python2.7/site-packages/pyorbital/orbital.py", line 167, in __init__
self._sgdp4 = _SGDP4(self.orbit_elements)
File "/media/nas/x21324/miniconda3/envs/py27b/lib/python2.7/site-packages/pyorbital/orbital.py", line 706, in __init__
raise NotImplementedError('Deep space calculations not supported')
NotImplementedError: Deep space calculations not supported
======================================================================
ERROR: test_nightfls_algorithm2 (fogpy.test.test_algorithms.Test_NightFogLowStratusAlgorithm)
----------------------------------------------------------------------
Traceback (most recent call last):
File "/home/gholl/checkouts/fogpy/fogpy/test/test_algorithms.py", line 622, in setUp
line2=self.tle.line2)
File "/media/nas/x21324/miniconda3/envs/py27b/lib/python2.7/site-packages/pyorbital/orbital.py", line 167, in __init__
self._sgdp4 = _SGDP4(self.orbit_elements)
File "/media/nas/x21324/miniconda3/envs/py27b/lib/python2.7/site-packages/pyorbital/orbital.py", line 706, in __init__
raise NotImplementedError('Deep space calculations not supported')
NotImplementedError: Deep space calculations not supported
======================================================================
ERROR: test_nightfls_slope (fogpy.test.test_algorithms.Test_NightFogLowStratusAlgorithm)
----------------------------------------------------------------------
Traceback (most recent call last):
File "/home/gholl/checkouts/fogpy/fogpy/test/test_algorithms.py", line 622, in setUp
line2=self.tle.line2)
File "/media/nas/x21324/miniconda3/envs/py27b/lib/python2.7/site-packages/pyorbital/orbital.py", line 167, in __init__
self._sgdp4 = _SGDP4(self.orbit_elements)
File "/media/nas/x21324/miniconda3/envs/py27b/lib/python2.7/site-packages/pyorbital/orbital.py", line 706, in __init__
raise NotImplementedError('Deep space calculations not supported')
NotImplementedError: Deep space calculations not supported
======================================================================
ERROR: test_nightfls_turningpoints_no_valley (fogpy.test.test_algorithms.Test_NightFogLowStratusAlgorithm)
----------------------------------------------------------------------
Traceback (most recent call last):
File "/home/gholl/checkouts/fogpy/fogpy/test/test_algorithms.py", line 622, in setUp
line2=self.tle.line2)
File "/media/nas/x21324/miniconda3/envs/py27b/lib/python2.7/site-packages/pyorbital/orbital.py", line 167, in __init__
self._sgdp4 = _SGDP4(self.orbit_elements)
File "/media/nas/x21324/miniconda3/envs/py27b/lib/python2.7/site-packages/pyorbital/orbital.py", line 706, in __init__
raise NotImplementedError('Deep space calculations not supported')
NotImplementedError: Deep space calculations not supported
======================================================================
ERROR: test_nightfls_turningpoints_with_thres (fogpy.test.test_algorithms.Test_NightFogLowStratusAlgorithm)
----------------------------------------------------------------------
Traceback (most recent call last):
File "/home/gholl/checkouts/fogpy/fogpy/test/test_algorithms.py", line 622, in setUp
line2=self.tle.line2)
File "/media/nas/x21324/miniconda3/envs/py27b/lib/python2.7/site-packages/pyorbital/orbital.py", line 167, in __init__
self._sgdp4 = _SGDP4(self.orbit_elements)
File "/media/nas/x21324/miniconda3/envs/py27b/lib/python2.7/site-packages/pyorbital/orbital.py", line 706, in __init__
raise NotImplementedError('Deep space calculations not supported')
NotImplementedError: Deep space calculations not supported
======================================================================
ERROR: test_nightfls_turningpoints_with_valley (fogpy.test.test_algorithms.Test_NightFogLowStratusAlgorithm)
----------------------------------------------------------------------
Traceback (most recent call last):
File "/home/gholl/checkouts/fogpy/fogpy/test/test_algorithms.py", line 622, in setUp
line2=self.tle.line2)
File "/media/nas/x21324/miniconda3/envs/py27b/lib/python2.7/site-packages/pyorbital/orbital.py", line 167, in __init__
self._sgdp4 = _SGDP4(self.orbit_elements)
File "/media/nas/x21324/miniconda3/envs/py27b/lib/python2.7/site-packages/pyorbital/orbital.py", line 706, in __init__
raise NotImplementedError('Deep space calculations not supported')
NotImplementedError: Deep space calculations not supported
======================================================================
ERROR: test_cloud_motion_filter (fogpy.test.test_filters.Test_CloudMotionFilter)
----------------------------------------------------------------------
Traceback (most recent call last):
File "/home/gholl/checkouts/fogpy/fogpy/test/test_filters.py", line 689, in test_cloud_motion_filter
ret, mask = testfilter.apply()
File "/home/gholl/checkouts/fogpy/fogpy/filters.py", line 128, in apply
self.filter_function()
File "/home/gholl/checkouts/fogpy/fogpy/filters.py", line 1091, in filter_function
optflow = self.cv2.createOptFlow_DualTVL1()
AttributeError: 'CloudMotionFilter' object has no attribute 'cv2'
-------------------- >> begin captured logging << --------------------
fogpy.filters: DEBUG: Setting filter reference time to current time: 2019-02-19 13:27:57.331902
fogpy.filters: INFO: Applying Cloud Motion Filter
fogpy.filters: INFO: Calculate optical flow...
--------------------- >> end captured logging << ---------------------
======================================================================
ERROR: test_fusion_filter_bufr_import (fogpy.test.test_filters.Test_StationFusionFilter)
----------------------------------------------------------------------
Traceback (most recent call last):
File "/home/gholl/checkouts/fogpy/fogpy/test/test_filters.py", line 727, in test_fusion_filter_bufr_import
ret, mask = testfilter.apply()
File "/home/gholl/checkouts/fogpy/fogpy/filters.py", line 128, in apply
self.filter_function()
File "/home/gholl/checkouts/fogpy/fogpy/filters.py", line 1222, in filter_function
stations = read_synop(self.bufrfile, 'visibility')
File "/home/gholl/checkouts/fogpy/fogpy/utils/import_synop.py", line 55, in read_synop
bfr.decode(blob)
File "/media/nas/x21324/miniconda3/envs/py27b/lib/python2.7/site-packages/trollbufr/bufr.py", line 385, in decode
self.decode_meta(bin_data, load_tables)
File "/media/nas/x21324/miniconda3/envs/py27b/lib/python2.7/site-packages/trollbufr/bufr.py", line 369, in decode_meta
raise tables_fail
BufrTableError: BufrTableError: Table not found: '/data/tleppelt/git/trollbufr/table_b_013'
-------------------- >> begin captured logging << --------------------
fogpy.filters: DEBUG: Setting filter reference time to current time: 2019-02-19 13:28:39.781717
fogpy.filters: INFO: Applying Cloud Filter
fogpy.filters: DEBUG: Histogram range for cloudy/clear sky pixels: -19.7446861967 - 1.11645277953
fogpy.filters: DEBUG: Cloud mask difference threshold set to -3.51935588185
fogpy.filters: INFO: Filter results for CloudFilter
Cloud filtering for satellite images.
Array size: 42018
Masking: 20551
Previous masked: 0
New filtered: 20551
Remaining: 21467
fogpy.filters: INFO: Applying Station Data Fusion Filter
--------------------- >> end captured logging << ---------------------
======================================================================
ERROR: test_fusion_filter_dem_interpolation (fogpy.test.test_filters.Test_StationFusionFilter)
----------------------------------------------------------------------
Traceback (most recent call last):
File "/home/gholl/checkouts/fogpy/fogpy/test/test_filters.py", line 747, in test_fusion_filter_dem_interpolation
ret, mask = testfilter.apply()
File "/home/gholl/checkouts/fogpy/fogpy/filters.py", line 128, in apply
self.filter_function()
File "/home/gholl/checkouts/fogpy/fogpy/filters.py", line 1222, in filter_function
stations = read_synop(self.bufrfile, 'visibility')
File "/home/gholl/checkouts/fogpy/fogpy/utils/import_synop.py", line 55, in read_synop
bfr.decode(blob)
File "/media/nas/x21324/miniconda3/envs/py27b/lib/python2.7/site-packages/trollbufr/bufr.py", line 385, in decode
self.decode_meta(bin_data, load_tables)
File "/media/nas/x21324/miniconda3/envs/py27b/lib/python2.7/site-packages/trollbufr/bufr.py", line 369, in decode_meta
raise tables_fail
BufrTableError: BufrTableError: Table not found: '/data/tleppelt/git/trollbufr/table_b_013'
-------------------- >> begin captured logging << --------------------
fogpy.filters: DEBUG: Setting filter reference time to current time: 2019-02-19 13:28:39.790132
fogpy.filters: INFO: Applying Cloud Filter
fogpy.filters: DEBUG: Histogram range for cloudy/clear sky pixels: -19.7446861967 - 1.11645277953
fogpy.filters: DEBUG: Cloud mask difference threshold set to -3.51935588185
fogpy.filters: INFO: Filter results for CloudFilter
Cloud filtering for satellite images.
Array size: 42018
Masking: 20551
Previous masked: 0
New filtered: 20551
Remaining: 21467
fogpy.filters: INFO: Applying Station Data Fusion Filter
--------------------- >> end captured logging << ---------------------
======================================================================
ERROR: Failure: ImportError (No module named utils)
----------------------------------------------------------------------
Traceback (most recent call last):
File "/media/nas/x21324/miniconda3/envs/py27b/lib/python2.7/site-packages/nose/loader.py", line 418, in loadTestsFromName
addr.filename, addr.module)
File "/media/nas/x21324/miniconda3/envs/py27b/lib/python2.7/site-packages/nose/importer.py", line 47, in importFromPath
return self.importFromDir(dir_path, fqname)
File "/media/nas/x21324/miniconda3/envs/py27b/lib/python2.7/site-packages/nose/importer.py", line 94, in importFromDir
mod = load_module(part_fqname, fh, filename, desc)
File "/home/gholl/checkouts/fogpy/fogpy/test/test_fogpy.py", line 36, in <module>
from utils import get_time_period
ImportError: No module named utils
======================================================================
FAIL: test_spatial_homogenity_filter_highsd (fogpy.test.test_filters.Test_SpatialHomogeneityFilter)
----------------------------------------------------------------------
Traceback (most recent call last):
File "/home/gholl/checkouts/fogpy/fogpy/test/test_filters.py", line 489, in test_spatial_homogenity_filter_highsd
self.assertEqual(np.nansum(testfilter.mask), msum)
AssertionError: 97 != 58
-------------------- >> begin captured logging << --------------------
fogpy.algorithms: INFO: Clustering low clouds
fogpy.algorithms: DEBUG: Number of spatial coherent fog cloud clusters: 9
fogpy.algorithms: INFO: Clustering low clouds
fogpy.algorithms: DEBUG: Number of spatial coherent fog cloud clusters: 8
fogpy.algorithms: INFO: Clustering low clouds
fogpy.algorithms: DEBUG: Number of spatial coherent fog cloud clusters: 1
fogpy.filters: DEBUG: Setting filter reference time to current time: 2019-02-19 13:28:39.752344
fogpy.filters: INFO: Applying Spatial Clustering Inhomogeneity Filter
fogpy.filters: INFO: Filter results for SpatialHomogeneityFilter
Filtering cloud clusters by StDev for satellite images.
Array size: 100
Masking: 97
Previous masked: 39
New filtered: 58
Remaining: 3
--------------------- >> end captured logging << ---------------------
----------------------------------------------------------------------
Ran 74 tests in 554.615s
FAILED (errors=12, failures=1)
[INFO/MainProcess] process shutting down
[INFO/MainProcess] process shutting down
[INFO/MainProcess] process shutting down
[INFO/MainProcess] process shutting down
[INFO/MainProcess] process shutting down
[INFO/MainProcess] process shutting down
[INFO/MainProcess] process shutting down
[INFO/MainProcess] process shutting down
[DEBUG/MainProcess] running all "atexit" finalizers with priority >= 0
[DEBUG/MainProcess] running all "atexit" finalizers with priority >= 0
[DEBUG/MainProcess] running all "atexit" finalizers with priority >= 0
[DEBUG/MainProcess] running all "atexit" finalizers with priority >= 0
[DEBUG/MainProcess] running all "atexit" finalizers with priority >= 0
[DEBUG/MainProcess] running all "atexit" finalizers with priority >= 0
[DEBUG/MainProcess] running all "atexit" finalizers with priority >= 0
[DEBUG/MainProcess] running all "atexit" finalizers with priority >= 0
[DEBUG/MainProcess] running the remaining "atexit" finalizers
[DEBUG/MainProcess] running the remaining "atexit" finalizers
[DEBUG/MainProcess] running the remaining "atexit" finalizers
[DEBUG/MainProcess] running the remaining "atexit" finalizers
[DEBUG/MainProcess] running the remaining "atexit" finalizers
[DEBUG/MainProcess] running the remaining "atexit" finalizers
[DEBUG/MainProcess] running the remaining "atexit" finalizers
[DEBUG/MainProcess] running the remaining "atexit" finalizers
Could be interesting to compare the fog observations with forecasts from the ECMWF model
From Cermak (2006), §4.2.5, “an entity is a set of adjoined pixels belonging to the same cloud class”. I'm not sure what type of classes Cermak (2006) uses, but fogpy seems to only use cloud or no cloud:
In my interpretation this differs from what Cermak (2006) describes. But maybe the implementation is more practical than the theory in this case, because neither the DEM CTH approach (Cermak (2006), Equation 4.29, or https://github.com/gerritholl/fogpy/blob/2c9aa9436e4924f55879d52a9de14817d370df5a/fogpy/algorithms.py#L680-L683) nor the lapse rate approach (Cermak (2006), Equation 4.30, or https://github.com/gerritholl/fogpy/blob/2c9aa9436e4924f55879d52a9de14817d370df5a/fogpy/algorithms.py#L684-L691) will work if one type of cloud is immediately neighboured by another. But it does seem an aspect that leaves room for improvement.
Some methods are apparently unused in fogpy. Apart from plotting-related functionality which I have suspended, these include:
algorithms.DayFogLowStratusAlgorithm.get_lowcloud_cth
algorithms.PanSharpeningAlgorithm.get_dist_threshold
algorithms.PanSharpeningAlgorithm.get_sza_in_range
algorithms.PanSharpeningAlgorithm.get_bt_dist
algorithms.PanSharpeningAlgorithm.get_turning_points
algorithms.PanSharpeningAlgorithm.get_slope
filters.CloudFilter.get_slope_decline
(used by plotting routines only?)SpatialCloudTopHeightFilter_old.filter_function
lowwatercloud.LowWaterCloud.get_vapour_pressure
Two tests are failing on oflks333 because bufr tables are missing. Those tables should be found by being included or the tests should mock whatever external is missing:
def load_tab_b(tables, fname):
"""Load table B (elements) from 'fname' into object Tables."""
if not os.path.exists(fname):
> raise BufrTableError(_text_file_not_found % fname)
E trollbufr.coder.errors.BufrTableError: BufrTableError: Table not found: '/media/x22264/nwcsaf/COTS/bufrtables/table_b_013'
that hardcoding isn't very useful.
The CloudPhysicsFilter
is not covered by any unit test, even without skipping anything.
Note that the StationFusionFilter
also appears to be skipped but this is only true on travis, because it needs to read a BUFR file and needs BUFR tables.
With latest fogpy and satpy master, there are three tests that fail with AttributeError:
$ pytest [382/1994]
========================================= test session starts ==========================================
platform linux -- Python 3.9.4, pytest-6.2.4, py-1.10.0, pluggy-0.13.1
rootdir: /home/gholl/checkouts/fogpy
plugins: cov-2.11.1, socket-0.4.0
collected 95 items
test_algorithms.py .sss...........F.......... [ 27%]
test_composites.py ........ [ 35%]
test_filters.py .....s...........s........FF... [ 68%]
test_lowwatercloud.py ............................x. [100%]
=============================================== FAILURES ===============================================
__________________________ Test_PanSharpeningAlgorithm.test_pansharp_resample __________________________
self = <fogpy.test.test_algorithms.Test_PanSharpeningAlgorithm testMethod=test_pansharp_resample>
def test_pansharp_resample(self):
"""Test resampling to degraded multispectral channel resolution"""
# Run pansharpening algorithm
panshalgo = PanSharpeningAlgorithm(**self.input)
> ret, mask = panshalgo.run()
test_algorithms.py:652:
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _
../algorithms.py:114: in run
self.procedure()
../algorithms.py:1174: in procedure
self.apply_hill_sharpening(chn, panrow, pancol, panshrp_chn)
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _
self = <fogpy.algorithms.PanSharpeningAlgorithm object at 0x7ff01b608b50>
chn = array([[[ 8.2132086 ],
[ 9.11465832],
[ 9.81578588],
...,
[ 8.91433616],
[ 8.9...3.72206802],
[12.31981289],
...,
[15.22448423],
[14.72367882],
[14.12271234]]])
panrow = array([[ 0, 0, 0, ..., 0, 0, 0],
[ 0, 0, 0, ..., 0, 0, 0],
[ 0, 0, 0, ..., ... 140, 140, 140],
[140, 140, 140, ..., 140, 140, 140],
[140, 140, 140, ..., 140, 140, 140]], dtype=uint16)
pancol = array([[ 0, 0, 0, ..., 297, 297, 297],
[ 0, 0, 0, ..., 297, 297, 297],
[ 0, 0, 0, ..., 29... 297, 297, 297],
[ 0, 0, 0, ..., 297, 297, 297],
[ 0, 0, 0, ..., 297, 297, 297]], dtype=uint16)
output = array([[4.65102510e-310, 6.95006358e-310, 0.00000000e+000, ...,
0.00000000e+000, 0.00000000e+000, 0.00000000e+... [0.00000000e+000, 0.00000000e+000, 0.00000000e+000, ...,
0.00000000e+000, 0.00000000e+000, 0.00000000e+000]])
def apply_hill_sharpening(self, chn, panrow, pancol, output):
""" Local regresssion based pansharpening algorithm by HILL et al.
1999. The nearest neighbor search is based on the scipy KDtree
implementation, whereas remapping is done with pyresample methods.
"""
logger.info("Using local regression approach by Hill")
# Setup KDtree for nearest neighbor search
indices = np.indices(chn.shape)
tree = spatial.KDTree(list(zip(indices[0].ravel(),
indices[1].ravel())))
# Track progress
todo = chn.size
ready = 1
# Array of evaluation criteria
eval_array = np.empty(chn.shape)
# Compute global regression
gm, gc, grsqrt, gmean = self.apply_linear_regression(
chn.ravel(), self.pan_degrad.ravel())
# Loop over channel array
for index, val in np.ndenumerate(chn):
row = index[0]
col = index[1]
# Query tree for neighbors
queryresult = tree.query(np.array([[row, col]]), k=25)
neighs = tree.data[queryresult[1][0][1:]]
# Get channel values for neighbors
> chn_neigh = chn[tuple(neighs.T)].squeeze()
E IndexError: arrays used as indices must be of integer (or boolean) type
../algorithms.py:1249: IndexError
----------------------------------------- Captured stderr call -----------------------------------------
2021-05-18 18:03:47,739 - fogpy.algorithms - INFO - Starting pansharpening algorithm for 1 images
2021-05-18 18:03:48,076 - fogpy.algorithms - INFO - Sharpen (141, 298, 1) image to (422, 893)
2021-05-18 18:03:48,076 - fogpy.algorithms - INFO - Using local regression approach by Hill
------------------------------------------ Captured log call -------------------------------------------
INFO fogpy.algorithms:algorithms.py:1151 Starting pansharpening algorithm for 1 images
INFO fogpy.algorithms:algorithms.py:1171 Sharpen (141, 298, 1) image to (422, 893)
INFO fogpy.algorithms:algorithms.py:1226 Using local regression approach by Hill
_______________________ Test_StationFusionFilter.test_fusion_filter_bufr_import ________________________
self = <fogpy.test.test_filters.Test_StationFusionFilter testMethod=test_fusion_filter_bufr_import>
@unittest.skipUnless(os.getenv("BUFR_TABLES"),
"BUFR tables not defined, skipping bufr-related tests")
def test_fusion_filter_bufr_import(self):
# Create fusion filter
testfilter = StationFusionFilter(self.ir108,
ir108=self.ir108,
ir039=self.ir039,
lowcloudmask=self.lowcloudmask,
elev=self.elev,
bufrfile=testbufr,
time=self.time,
area=area_def)
> ret, mask = testfilter.apply()
test_filters.py:6607:
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _
../filters.py:133: in apply
self.filter_function()
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _
self = <fogpy.filters.StationFusionFilter object at 0x7ff01b198400>
def filter_function(self):
"""Station data fusion filter routine
This filter provide a data fusion approach for satellite derived low
cloud masked raster data with vector data of visibilities observed by
sensors at weather stations. This raster/vector data fusion is done in
several steps.
First a BUFR file with WMO standardized weather station data is
imported. Next the visibility measurements are extracted and resampled
to the given cloud mask raster array shape. Then a fog mask for the
station data is created and a DEM based interpolation is performed.
Afterwards the stations are compared to the low cloud and cloud masks
and case dependant mask corrections are performed.
Args:
| ir108 (:obj:`ndarray`): Array for the 10.8 μm channel.
| ir039 (:obj:`ndarray`): Array for the 3.9 μm channel.
| lowcloudmask (:obj:`ndarray`): Low cloud mask array.
| cloudmask (:obj:`ndarray`): General cloud mask array.
| elev (:obj:`ndarray`): Array of elevation.
| bufrfile (:obj:`str`): Path to weather station BUFR-file.
| time (:obj:`Datetime`): Time instance of station data
as *datetime* object.
| area (:obj:`area_def`): Corresponding area definition for
cloud masks.
| heightvar (:obj:`float`): Height variance for fog masking in m.
Default is 50 m.
| fogthres (:obj:`float`): Visibility threshold for fog masking
in m. Default is 1000 m.
| limit (:obj:`bool`): Boolean to limit the output region to
station data coverage.
Returns:
Filter image and filter mask.
"""
logger.info("Applying Station Data Fusion Filter")
# 1. Import BUFR file
stations = read_synop(self.bufrfile, 'visibility')
currentstations = stations[self.time.strftime("%Y%m%d%H0000")]
lats = [i[2] for i in currentstations]
lons = [i[3] for i in currentstations]
vis = [i[4] for i in currentstations]
# 2. Port visibility vector data to raster array shape
self.visarr = np.empty(self.arr.shape[:2])
self.visarr.fill(np.nan)
x, y = (self.area.get_xy_from_lonlat(lons, lats))
xmin, xmax, ymin, ymax = [np.nanmin(x), np.nanmax(x), np.nanmin(y),
np.nanmax(y)]
vis_ma = np.ma.array(vis, mask=x.mask)
> self.visarr[y.compressed(), x.compressed()] = vis_ma.compressed()
E IndexError: shape mismatch: indexing arrays could not be broadcast together with shapes (265,) (267,)
../filters.py:1291: IndexError
----------------------------------------- Captured stderr call -----------------------------------------
2021-05-18 18:03:59,303 - fogpy.filters - INFO - Applying Cloud Filter
2021-05-18 18:03:59,308 - fogpy.filters - INFO - Filter results for CloudFilter
Cloud filtering for satellite images.
Array size: 42018
Masking: 20551
Previous masked: 0
New filtered: 20551
Remaining: 21467
2021-05-18 18:03:59,308 - fogpy.filters - INFO - Applying Station Data Fusion Filter
------------------------------------------ Captured log call -------------------------------------------
INFO fogpy.filters:filters.py:397 Applying Cloud Filter
INFO fogpy.filters:filters.py:182 Filter results for CloudFilter
Cloud filtering for satellite images.
Array size: 42018
Masking: 20551
Previous masked: 0
New filtered: 20551
Remaining: 21467
INFO fogpy.filters:filters.py:1274 Applying Station Data Fusion Filter
____________________ Test_StationFusionFilter.test_fusion_filter_dem_interpolation _____________________
self = <fogpy.test.test_filters.Test_StationFusionFilter testMethod=test_fusion_filter_dem_interpolation>
@unittest.skipUnless(os.getenv("BUFR_TABLES"),
"BUFR tables not defined, skipping bufr-related tests")
def test_fusion_filter_dem_interpolation(self):
# Create fusion filter
testfilter = StationFusionFilter(self.ir108,
ir108=self.ir108,
ir039=self.ir039,
lowcloudmask=self.lowcloudmask,
elev=self.elev,
bufrfile=testbufr,
time=self.time,
area=area_def,
plot=False,
save=True,
resize=5)
> ret, mask = testfilter.apply()
test_filters.py:6629:
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _
../filters.py:133: in apply
self.filter_function()
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _
self = <fogpy.filters.StationFusionFilter object at 0x7ff01b198220>
def filter_function(self):
"""Station data fusion filter routine
This filter provide a data fusion approach for satellite derived low
cloud masked raster data with vector data of visibilities observed by
sensors at weather stations. This raster/vector data fusion is done in
several steps.
First a BUFR file with WMO standardized weather station data is
imported. Next the visibility measurements are extracted and resampled
to the given cloud mask raster array shape. Then a fog mask for the
station data is created and a DEM based interpolation is performed.
Afterwards the stations are compared to the low cloud and cloud masks
and case dependant mask corrections are performed.
Args:
| ir108 (:obj:`ndarray`): Array for the 10.8 μm channel.
| ir039 (:obj:`ndarray`): Array for the 3.9 μm channel.
| lowcloudmask (:obj:`ndarray`): Low cloud mask array.
| cloudmask (:obj:`ndarray`): General cloud mask array.
| elev (:obj:`ndarray`): Array of elevation.
| bufrfile (:obj:`str`): Path to weather station BUFR-file.
| time (:obj:`Datetime`): Time instance of station data
as *datetime* object.
| area (:obj:`area_def`): Corresponding area definition for
cloud masks.
| heightvar (:obj:`float`): Height variance for fog masking in m.
Default is 50 m.
| fogthres (:obj:`float`): Visibility threshold for fog masking
in m. Default is 1000 m.
| limit (:obj:`bool`): Boolean to limit the output region to
station data coverage.
Returns:
Filter image and filter mask.
"""
logger.info("Applying Station Data Fusion Filter")
# 1. Import BUFR file
stations = read_synop(self.bufrfile, 'visibility')
currentstations = stations[self.time.strftime("%Y%m%d%H0000")]
lats = [i[2] for i in currentstations]
lons = [i[3] for i in currentstations]
vis = [i[4] for i in currentstations]
# 2. Port visibility vector data to raster array shape
self.visarr = np.empty(self.arr.shape[:2])
self.visarr.fill(np.nan)
x, y = (self.area.get_xy_from_lonlat(lons, lats))
xmin, xmax, ymin, ymax = [np.nanmin(x), np.nanmax(x), np.nanmin(y),
np.nanmax(y)]
vis_ma = np.ma.array(vis, mask=x.mask)
> self.visarr[y.compressed(), x.compressed()] = vis_ma.compressed()
E IndexError: shape mismatch: indexing arrays could not be broadcast together with shapes (265,) (267,)
../filters.py:1291: IndexError
----------------------------------------- Captured stderr call -----------------------------------------
2021-05-18 18:04:03,852 - fogpy.filters - INFO - Applying Cloud Filter
2021-05-18 18:04:03,857 - fogpy.filters - INFO - Filter results for CloudFilter
Cloud filtering for satellite images.
Array size: 42018
Masking: 20551
Previous masked: 0
New filtered: 20551
Remaining: 21467
2021-05-18 18:04:03,858 - fogpy.filters - INFO - Applying Station Data Fusion Filter
------------------------------------------ Captured log call -------------------------------------------
INFO fogpy.filters:filters.py:397 Applying Cloud Filter
INFO fogpy.filters:filters.py:182 Filter results for CloudFilter
Cloud filtering for satellite images.
Array size: 42018
Masking: 20551
Previous masked: 0
New filtered: 20551
Remaining: 21467
INFO fogpy.filters:filters.py:1274 Applying Station Data Fusion Filter
=========================================== warnings summary ===========================================
fogpy/test/test_algorithms.py::Test_BaseSatelliteAlgorithm::test_base_algorithm
/home/gholl/checkouts/fogpy/fogpy/test/test_algorithms.py:122: DeprecationWarning: `np.float` is a deprecated alias for the builtin `float`. To silence this warning, use `float` by itself. Doing this will not modify any behavior and is safe. If you specifically wanted the numpy scalar type, use `np.float64` here.
Deprecated in NumPy 1.20; for more details and guidance: https://numpy.org/devdocs/release/1.20.0-notes.html#deprecations
self.testarray = np.arange(0, 16, dtype=np.float).reshape((4, 4))
fogpy/test/test_algorithms.py::Test_LowCloudHeightAlgorithm::test_lcth_algorithm_artificial
fogpy/test/test_algorithms.py::Test_LowCloudHeightAlgorithm::test_lcth_algorithm_artificial_complement
fogpy/test/test_algorithms.py::Test_LowCloudHeightAlgorithm::test_lcth_algorithm_artificial_next
fogpy/test/test_algorithms.py::Test_LowCloudHeightAlgorithm::test_lcth_algorithm_linreg_cluster
fogpy/test/test_algorithms.py::Test_LowCloudHeightAlgorithm::test_lcth_algorithm_nan_neighbor
fogpy/test/test_algorithms.py::Test_LowCloudHeightAlgorithm::test_lcth_algorithm_real
/home/gholl/checkouts/fogpy/fogpy/algorithms.py:665: DeprecationWarning: `np.float` is a deprecated alias for the builtin `float`. To silence this warning, use `float` by itself. Doing this will not modify any behavior and is safe. If you specifically wanted the numpy scalar type, use `np.float64` here.
Deprecated in NumPy 1.20; for more details and guidance: https://numpy.org/devdocs/release/1.20.0-notes.html#deprecations
self.dz = np.empty(self.ir108.shape, dtype=np.float)
fogpy/test/test_algorithms.py::Test_LowCloudHeightAlgorithm::test_lcth_algorithm_artificial
fogpy/test/test_algorithms.py::Test_LowCloudHeightAlgorithm::test_lcth_algorithm_artificial_complement
fogpy/test/test_algorithms.py::Test_LowCloudHeightAlgorithm::test_lcth_algorithm_artificial_next
fogpy/test/test_algorithms.py::Test_LowCloudHeightAlgorithm::test_lcth_algorithm_linreg_cluster
fogpy/test/test_algorithms.py::Test_LowCloudHeightAlgorithm::test_lcth_algorithm_nan_neighbor
fogpy/test/test_algorithms.py::Test_LowCloudHeightAlgorithm::test_lcth_algorithm_real
/home/gholl/checkouts/fogpy/fogpy/algorithms.py:666: DeprecationWarning: `np.float` is a deprecated alias for the builtin `float`. To silence this warning, use `float` by itself. Doing this will not modify any behavior and is safe. If you specifically wanted the numpy scalar type, use `np.float64` here.
Deprecated in NumPy 1.20; for more details and guidance: https://numpy.org/devdocs/release/1.20.0-notes.html#deprecations
self.cth = np.empty(self.ir108.shape, dtype=np.float)
fogpy/test/test_algorithms.py::Test_LowCloudHeightAlgorithm::test_lcth_algorithm_artificial
fogpy/test/test_algorithms.py::Test_LowCloudHeightAlgorithm::test_lcth_algorithm_artificial_complement
fogpy/test/test_algorithms.py::Test_LowCloudHeightAlgorithm::test_lcth_algorithm_artificial_next
fogpy/test/test_algorithms.py::Test_LowCloudHeightAlgorithm::test_lcth_algorithm_linreg
fogpy/test/test_algorithms.py::Test_LowCloudHeightAlgorithm::test_lcth_algorithm_linreg_cluster
fogpy/test/test_algorithms.py::Test_LowCloudHeightAlgorithm::test_lcth_algorithm_real
/home/gholl/checkouts/fogpy/fogpy/algorithms.py:826: FutureWarning: `rcond` parameter will change to the default of machine precision times ``max(M, N)`` where M and N are the input matrix dimensions.
To use the future default and silence this warning we advise to pass `rcond=None`, to keep using the old, explicitly pass `rcond=-1`.
m, c = np.linalg.lstsq(A, y)[0]
fogpy/test/test_algorithms.py::Test_LowCloudHeightAlgorithm::test_lcth_algorithm_linreg_cluster
fogpy/test/test_algorithms.py::Test_LowCloudHeightAlgorithm::test_lcth_algorithm_real
/home/gholl/checkouts/fogpy/fogpy/algorithms.py:1079: RuntimeWarning: Mean of empty slice
cth = np.nanmean(cthmargin)
fogpy/test/test_algorithms.py::Test_LowCloudHeightAlgorithm::test_lcth_algorithm_nan_neighbor
/home/gholl/checkouts/fogpy/fogpy/algorithms.py:714: RuntimeWarning: All-NaN slice encountered
self.minheight = np.nanmin(self.result)
fogpy/test/test_algorithms.py::Test_LowCloudHeightAlgorithm::test_lcth_algorithm_nan_neighbor
/home/gholl/checkouts/fogpy/fogpy/algorithms.py:715: RuntimeWarning: Mean of empty slice
self.meanheight = np.nanmean(self.result)
fogpy/test/test_algorithms.py::Test_LowCloudHeightAlgorithm::test_lcth_algorithm_nan_neighbor
/home/gholl/checkouts/fogpy/fogpy/algorithms.py:716: RuntimeWarning: All-NaN slice encountered
self.maxheight = np.nanmax(self.result)
fogpy/test/test_algorithms.py::Test_LowCloudHeightAlgorithm::test_lcth_algorithm_nan_neighbor
/home/gholl/checkouts/fogpy/fogpy/test/test_algorithms.py:448: RuntimeWarning: All-NaN slice encountered
self.assertEqual(np.isnan(np.nanmax(lcthalgo.dz)), True)
fogpy/test/test_algorithms.py::Test_LowCloudHeightAlgorithm::test_lcth_algorithm_nan_neighbor
/home/gholl/checkouts/fogpy/fogpy/test/test_algorithms.py:449: RuntimeWarning: All-NaN slice encountered
self.assertEqual(np.isnan(np.nanmax(lcthalgo.cth)), True)
fogpy/test/test_algorithms.py::Test_PanSharpeningAlgorithm::test_pansharp_resample
fogpy/test/test_algorithms.py::Test_PanSharpeningAlgorithm::test_pansharp_resample
/home/gholl/checkouts/pyresample/pyresample/image.py:60: FutureWarning: Usage of ImageContainer is deprecated, please use NumpyResamplerBilinear class instead
warnings.warn(
fogpy/test/test_algorithms.py::Test_PanSharpeningAlgorithm::test_pansharp_resample
/home/gholl/checkouts/fogpy/fogpy/algorithms.py:1207: FutureWarning: `rcond` parameter will change to the default of machine precision times ``max(M, N)`` where M and N are the input matrix dimensions.
To use the future default and silence this warning we advise to pass `rcond=None`, to keep using the old, explicitly pass `rcond=-1`.
results, resids, rank, s = np.linalg.lstsq(A, y)
fogpy/test/test_algorithms.py: 21 warnings
<__array_function__ internals>:5: DeprecationWarning: `np.alen` is deprecated, use `len` instead
fogpy/test/test_composites.py::test_get_area_lat_lon
fogpy/test/test_composites.py::test_interim
fogpy/test/test_composites.py::test_fog_comp_night
/home/gholl/checkouts/satpy/satpy/composites/__init__.py:204: UserWarning: satpy.composites.CompositeBase.check_areas is deprecated, use satpy.composites.CompositeBase.match_data_arrays instead
warnings.warn('satpy.composites.CompositeBase.check_areas is deprecated, use '
fogpy/test/test_composites.py::test_get_area_lat_lon
fogpy/test/test_composites.py::test_get_area_lat_lon
fogpy/test/test_composites.py::test_interim
fogpy/test/test_composites.py::test_interim
fogpy/test/test_composites.py::test_fog_comp_day
fogpy/test/test_composites.py::test_fog_comp_night
fogpy/test/test_composites.py::test_fog_comp_night
/data/gholl/miniconda3/envs/py39/lib/python3.9/site-packages/pyproj/crs/crs.py:543: UserWarning: You will likely lose important projection information when converting to a PROJ string from another format. See: https://proj.org/faq.html#what-is-the-best-format-for-describing-coordinate-reference-systems
proj_string = self.to_proj4()
fogpy/test/test_composites.py::test_interim
/data/gholl/miniconda3/envs/py39/lib/python3.9/site-packages/pkg_resources/__init__.py:1143: DeprecationWarning: Use of .. or absolute path in a resource path is not allowed and will raise exceptions in a future release.
return get_provider(package_or_requirement).get_resource_filename(
fogpy/test/test_composites.py::test_save_extras
fogpy/test/test_composites.py::test_save_extras
/home/gholl/checkouts/satpy/satpy/writers/cf_writer.py:638: UserWarning: Dtype bool not compatible with CF-1.7.
warnings.warn('Dtype {} not compatible with {}.'.format(str(ds.dtype), CF_VERSION))
fogpy/test/test_filters.py::Test_ArrayFilter::test_array_filter
fogpy/test/test_filters.py::Test_ArrayFilter::test_array_filter_param
fogpy/test/test_filters.py::Test_ArrayFilter::test_marray_filter
/home/gholl/checkouts/fogpy/fogpy/test/test_filters.py:92: DeprecationWarning: `np.float` is a deprecated alias for the builtin `float`. To silence this warning, use `float` by itself. Doing this will not modify any behavior and is safe. If you specifically wanted the numpy scalar type, use `np.float64` here.
Deprecated in NumPy 1.20; for more details and guidance: https://numpy.org/devdocs/release/1.20.0-notes.html#deprecations
self.testarray = np.arange(0, 16, dtype=np.float).reshape((4, 4))
fogpy/test/test_filters.py::Test_LowCloudFilter::test_lowcloud_filter_clusters
fogpy/test/test_filters.py::Test_LowCloudFilter::test_lowcloud_filter_single
fogpy/test/test_filters.py::Test_LowCloudFilter::test_lowcloud_filter_single_lwp_allfog
fogpy/test/test_filters.py::Test_LowCloudFilter::test_lowcloud_filter_single_lwp_nofog
fogpy/test/test_filters.py::Test_LowCloudFilter::test_lowcloud_filter_single_lwp_randomfog
/home/gholl/checkouts/fogpy/fogpy/filters.py:925: DeprecationWarning: `np.float` is a deprecated alias for the builtin `float`. To silence this warning, use `float` by itself. Doing this will not modify any behavior and is safe. If you specifically wanted the numpy scalar type, use `np.float64` here.
Deprecated in NumPy 1.20; for more details and guidance: https://numpy.org/devdocs/release/1.20.0-notes.html#deprecations
self.cbh = np.empty(self.clusters.shape, dtype=np.float)
fogpy/test/test_filters.py::Test_LowCloudFilter::test_lowcloud_filter_clusters
fogpy/test/test_filters.py::Test_LowCloudFilter::test_lowcloud_filter_single
fogpy/test/test_filters.py::Test_LowCloudFilter::test_lowcloud_filter_single_lwp_allfog
fogpy/test/test_filters.py::Test_LowCloudFilter::test_lowcloud_filter_single_lwp_nofog
fogpy/test/test_filters.py::Test_LowCloudFilter::test_lowcloud_filter_single_lwp_randomfog
/home/gholl/checkouts/fogpy/fogpy/filters.py:926: DeprecationWarning: `np.float` is a deprecated alias for the builtin `float`. To silence this warning, use `float` by itself. Doing this will not modify any behavior and is safe. If you specifically wanted the numpy scalar type, use `np.float64` here.
Deprecated in NumPy 1.20; for more details and guidance: https://numpy.org/devdocs/release/1.20.0-notes.html#deprecations
self.fbh = np.empty(self.clusters.shape, dtype=np.float)
fogpy/test/test_filters.py::Test_StationFusionFilter::test_fusion_filter_bufr_import
fogpy/test/test_filters.py::Test_StationFusionFilter::test_fusion_filter_dem_interpolation
/home/gholl/checkouts/pyresample/pyresample/geometry.py:1920: DeprecationWarning: 'get_xy_from_lonlat' is deprecated, please use 'get_array_indices_from_lonlat' instead.
warnings.warn("'get_xy_from_lonlat' is deprecated, please use "
fogpy/test/test_filters.py::Test_StationFusionFilter::test_fusion_validation
/home/gholl/checkouts/fogpy/fogpy/filters.py:1463: RuntimeWarning: All-NaN axis encountered
np.nanmin(self.check_zerolist(elev[lowcloudhit])),
fogpy/test/test_filters.py::Test_StationFusionFilter::test_fusion_validation
/home/gholl/checkouts/fogpy/fogpy/filters.py:1464: RuntimeWarning: Mean of empty slice
np.nanmean(self.check_zerolist(
fogpy/test/test_filters.py::Test_StationFusionFilter::test_fusion_validation
/home/gholl/checkouts/fogpy/fogpy/filters.py:1466: RuntimeWarning: All-NaN axis encountered
np.nanmax(self.check_zerolist(elev[lowcloudhit])),
fogpy/test/test_filters.py::Test_StationFusionFilter::test_fusion_validation
/home/gholl/checkouts/fogpy/fogpy/filters.py:1482: RuntimeWarning: All-NaN axis encountered
np.nanmin(self.check_zerolist(
fogpy/test/test_filters.py::Test_StationFusionFilter::test_fusion_validation
/home/gholl/checkouts/fogpy/fogpy/filters.py:1484: RuntimeWarning: Mean of empty slice
np.nanmean(self.check_zerolist(
fogpy/test/test_filters.py::Test_StationFusionFilter::test_fusion_validation
/home/gholl/checkouts/fogpy/fogpy/filters.py:1486: RuntimeWarning: All-NaN axis encountered
np.nanmax(self.check_zerolist(
fogpy/test/test_lowwatercloud.py: 265 warnings
/data/gholl/miniconda3/envs/py39/lib/python3.9/site-packages/scipy/optimize/_minimize.py:535: RuntimeWarning: Method BFGS cannot handle constraints nor bounds.
warn('Method %s cannot handle constraints nor bounds.' % method,
-- Docs: https://docs.pytest.org/en/stable/warnings.html
======================================= short test summary info ========================================
FAILED test_algorithms.py::Test_PanSharpeningAlgorithm::test_pansharp_resample - IndexError: arrays u...
FAILED test_filters.py::Test_StationFusionFilter::test_fusion_filter_bufr_import - IndexError: shape ...
FAILED test_filters.py::Test_StationFusionFilter::test_fusion_filter_dem_interpolation - IndexError: ...
================== 3 failed, 86 passed, 5 skipped, 1 xfailed, 349 warnings in 37.93s ===================
Fogpy can work with DEMs for central Europe or New England, but those DEMs are too large to fit in a Github repository. They should be published somewhere, for example on Zenodo. At present tests are failing due to their absence, but it would also much ease installation if they were present or automatically downloaded. I think pyspectral does something like that for Relative Spectral Response functions (RSRs)
Fogpy 1.1, which was based on mpop, had the option to return additional "debugging" information when calculating a composite:
Lines 106 to 124 in 3b67135
At the time, this was called through
scene.image.fls_day(..., validate=True)
Today, a scene is loaded as
scene.load(["fls_day"])
which doesn't allow to pass extra keyword arguments through the same API. However, some code needs this functionality; for example, we may want to write geotiffs with the cloud base height, fog base height, and other parameters, for validation or statistical analysis purposes.
Fogpy needs to reintroduce a path to get those parameters as datasets. What would be a good way? Perhaps
scene.load(["fls_day", "cbh", "fbh", "lcth"])
or maybe in another way... In any case those are intermediates for calculating fog anyway so should not need to be recalculated wasting valuable computation time...
Currently, I have a setup.py with a self-hacked git revision in the version number. This should be replaced by setuptools-scm. Now that I'm at it, I should also use pyproject.toml, which is apparently the most modern way of setting up stuff.
There are some major DRY violations in fogpy. For example:
Needless to say, this is bad for maintainability and needs to be fixed.
In fogpy.test.test_lowwatercloud.Test_LowWaterCloud.test_optimize_cbh_start_thin
, it is apparently expected that in at least 8 cases, the CBH is estimated to be 421m:
In practice, I find that this is the case for 0:
>>> print(listresult)
[1867.0078834795156, 1898.4940580829307, 2957.950231409033, 699.3604527454505, 1856.701273063093, 1832.028336011312, 1894.3922645949594, 1880.2672655709196, 2201.2275823144937, 100.0, 1778.1183698227826, 1899.0896455777947]
In fact, if I call it several times, I get widely different results... for a starting guess of 100 m, the retrieved cloud base height varies from 100 metre to 2379 metre:
>>> [self.thinlwc.optimize_cbh(100., method='basin') for _ in range(10)]
[1796.6280971323695, 2378.811619607044, 100.0, 1894.4384007975327, 1866.3537472568476, 1885.6555720495462, 1854.8449664665986, 1880.2325912638637, 1893.578354678866, 2406.25380243318]
With brute force, it always returns 0 m:
>>> print([self.thinlwc.optimize_cbh(100., method='brute') for _ in range(10)])
[0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0]
Something seems very wrong here.
Currently fogpy will (I think) happily process nighttime pixels even if they are taken daytime, reporting them as being removed by various filters (presumably). It needs to explicitly filter out pixels that it can't process to begin with, to get better statistics of which pixels are removed for the right reasons.
When trying to regenerate the fog composite for 2019-04-15, that I have done before, I get an IndexError
. The full command below uses the show-fog
command from fogtools:
PPP_CONFIG_DIR=/data/gholl/miniconda3/envs/py38/lib/python3.8/site-packages/fogpy/etc/ \
show-fog $PLOTDIR/eurol-2019-04-15.tiff --seviri SEVIRI/*201904151000* --nwcsaf NWCSAF/20190415/*100000Z*
It fails in fogpy.algorithms.LowCloudHeightAlgorithm.procedure
when idmargin == [0, 1, 2, 4, 7]
but tneigh.shape = (6,)
:
Cloud filtering for satellite images.
Array size: 5242880
Masking: 1004342
Previous masked: 241336
New filtered: 1004342
Remaining: 3997202
[INFO: 2020-03-24 16:04:46 : fogpy.filters] Applying Snow Filter
/data/gholl/miniconda3/envs/py38/lib/python3.8/site-packages/fogpy/filters.py:517: RuntimeWarning: invalid value encountered in greater_equal
temp_thres = (self.vis008 / 100 >= 0.11) & (self.ir108 >= 256)
/data/gholl/miniconda3/envs/py38/lib/python3.8/site-packages/fogpy/filters.py:518: RuntimeWarning: invalid value encountered in greater_equal
ndsi_thres = self.ndsi >= 0.4
[INFO: 2020-03-24 16:04:46 : fogpy.filters] Filter results for SnowFilter
Snow filtering for satellite images.
Array size: 5242880
Masking: 50274
Previous masked: 1245678
New filtered: 15403
Remaining: 3981799
[INFO: 2020-03-24 16:04:46 : fogpy.filters] Applying Snow Filter
/data/gholl/miniconda3/envs/py38/lib/python3.8/site-packages/fogpy/filters.py:554: RuntimeWarning: invalid value encountered in less
ice_mask = (self.ic_diff < 2.5) | (self.ir108 < 250)
[INFO: 2020-03-24 16:04:46 : fogpy.filters] Filter results for IceCloudFilter
Ice cloud filtering for satellite images.
Array size: 5242880
Masking: 3552503
Previous masked: 1261081
New filtered: 2696327
Remaining: 1285472
[INFO: 2020-03-24 16:04:46 : fogpy.filters] Applying Cirrus Filter
[DEBUG: 2020-03-24 16:04:46 : fogpy.filters] Found solar zenith angles from 9.093614193345056 to 87.3190975181772°
[DEBUG: 2020-03-24 16:05:45 : fogpy.filters] Set BT difference thresholds for cirrus: 0.55 to 11.22 K
/data/gholl/miniconda3/envs/py38/lib/python3.8/site-packages/fogpy/filters.py:617: RuntimeWarning: invalid value encountered in greater
self.bt_ci_mask = self.bt_diff > self.bt_thres
/data/gholl/miniconda3/envs/py38/lib/python3.8/site-packages/fogpy/filters.py:621: RuntimeWarning: invalid value encountered in greater
self.strong_ci_mask = self.strong_ci_diff > 0
[INFO: 2020-03-24 16:05:45 : fogpy.filters] Filter results for CirrusCloudFilter
Thin cirrus cloud filtering for satellite images.
Array size: 5242880
Masking: 1919514
Previous masked: 3957408
New filtered: 46742
Remaining: 1238730
[INFO: 2020-03-24 16:05:45 : fogpy.filters] Applying Water Cloud Filter
/data/gholl/miniconda3/envs/py38/lib/python3.8/site-packages/fogpy/filters.py:687: RuntimeWarning: invalid value encountered in greater
water_mask = self.ndsi_ci > 0.1
[DEBUG: 2020-03-24 16:05:45 : fogpy.filters] Mean latitudinal threshold for cloudfree areas: 279.63 K
/data/gholl/miniconda3/envs/py38/lib/python3.8/site-packages/fogpy/filters.py:716: RuntimeWarning: invalid value encountered in less_equal
res = lat <= thres[self.line]
[INFO: 2020-03-24 16:05:45 : fogpy.filters] Filter results for WaterCloudFilter
Water cloud filtering for satellite images.
Array size: 5242880
Masking: 2513723
Previous masked: 4004150
New filtered: 45772
Remaining: 1192958
[INFO: 2020-03-24 16:05:45 : fogpy.algorithms] Clustering low clouds
[DEBUG: 2020-03-24 16:05:45 : fogpy.algorithms] Number of spatial coherent fog cloud clusters: 961
[INFO: 2020-03-24 16:05:45 : fogpy.algorithms] Starting low cloud height assignment algorithm
[INFO: 2020-03-24 16:05:45 : fogpy.algorithms] Clustering low clouds
[DEBUG: 2020-03-24 16:05:45 : fogpy.algorithms] Number of spatial coherent fog cloud clusters: 961
Traceback (most recent call last):
File "/data/gholl/miniconda3/envs/py38/bin/show-fog", line 8, in
sys.exit(main())
File "/data/gholl/miniconda3/envs/py38/lib/python3.8/site-packages/fogtools/processing/show_fog.py", line 50, in main
rv = vis.get_fog_blend_from_seviri_nwcsaf(
File "/data/gholl/miniconda3/envs/py38/lib/python3.8/site-packages/fogtools/vis.py", line 75, in get_fog_blend_from_seviri_nwcsaf
ls.load(["fls_day", "fls_day_extra"], unload=False)
File "/data/gholl/miniconda3/envs/py38/lib/python3.8/site-packages/satpy/scene.py", line 972, in load
keepables = self.generate_composites()
File "/data/gholl/miniconda3/envs/py38/lib/python3.8/site-packages/satpy/scene.py", line 887, in generate_composites
return self._read_composites(nodes)
File "/data/gholl/miniconda3/envs/py38/lib/python3.8/site-packages/satpy/scene.py", line 862, in _read_composites
self._generate_composite(item, keepables)
File "/data/gholl/miniconda3/envs/py38/lib/python3.8/site-packages/satpy/scene.py", line 801, in _generate_composite
prereq_datasets = self._get_prereq_datasets(
File "/data/gholl/miniconda3/envs/py38/lib/python3.8/site-packages/satpy/scene.py", line 751, in _get_prereq_datasets
self._generate_composite(prereq_node, keepables)
File "/data/gholl/miniconda3/envs/py38/lib/python3.8/site-packages/satpy/scene.py", line 835, in _generate_composite
composite = compositor(prereq_datasets,
File "/data/gholl/miniconda3/envs/py38/lib/python3.8/site-packages/fogpy/composites.py", line 176, in call
fls, mask = flsalgo.run()
File "/data/gholl/miniconda3/envs/py38/lib/python3.8/site-packages/fogpy/algorithms.py", line 114, in run
self.procedure()
File "/data/gholl/miniconda3/envs/py38/lib/python3.8/site-packages/fogpy/algorithms.py", line 458, in procedure
lcthalgo.run()
File "/data/gholl/miniconda3/envs/py38/lib/python3.8/site-packages/fogpy/algorithms.py", line 114, in run
self.procedure()
File "/data/gholl/miniconda3/envs/py38/lib/python3.8/site-packages/fogpy/algorithms.py", line 716, in procedure
tmargin = [tneigh[i] for i in idmargin]
File "/data/gholl/miniconda3/envs/py38/lib/python3.8/site-packages/fogpy/algorithms.py", line 716, in
tmargin = [tneigh[i] for i in idmargin]
IndexError: index 7 is out of bounds for axis 0 with size 6
Exception ignored in: <function Pool.del at 0x7f0992a130d0>
Traceback (most recent call last):
File "/data/gholl/miniconda3/envs/py38/lib/python3.8/multiprocessing/pool.py", line 268, in del
File "/data/gholl/miniconda3/envs/py38/lib/python3.8/multiprocessing/queues.py", line 362, in put
AttributeError: 'NoneType' object has no attribute 'dumps'
In fogpy.filters
, there are two calls to time.sleep
:
Why?
Incidentally, this code is also a violation of DRY.
Rename master branch to main to be consistent with rest of pytroll
The cloud base filter is slow. SMHI reportedly has a machine-learning based cloud base height retrieval. We should investigate if this works for fog cases.
When running the unit tests, filters.LowCloudFilter.filter_function
gives an IndexError
. Apparently, this function assumes that self.result_list
is at least as long as self.index_list
:
however, when debugging the unit test, I find that len(self.index_list)=3793
whereas len(self.result_list)=67
.
ERROR: test_fls_algorithm (fogpy.test.test_algorithms.Test_DayFogLowStratusAlgorithm)
----------------------------------------------------------------------
Traceback (most recent call last):
File "/home/gholl/checkouts/fogpy/fogpy/test/test_algorithms.py", line 191, in test_fls_algorithm
ret, mask = flsalgo.run()
File "/home/gholl/checkouts/fogpy/fogpy/algorithms.py", line 98, in run
self.procedure()
File "/home/gholl/checkouts/fogpy/fogpy/algorithms.py", line 497, in procedure
lowcloudfilter.apply()
File "/home/gholl/checkouts/fogpy/fogpy/filters.py", line 131, in apply
self.filter_function()
File "/home/gholl/checkouts/fogpy/fogpy/filters.py", line 970, in filter_function
self.cbh[r, c] = self.result_list[i][0]
IndexError: list index out of range
3793 corresponds to the number of tasks, I don't know why self.result_list
only has 67 elements. self.result_list
is appended to by self.log_result
:
so it appears the algorithm assumes that every iteration has exactly one result, which appears to be not the case in the test run.
The way Fogpy is setup now, the visualisation of fls_day
is white:
import glob
import sattools.ptc
from satpy import Scene
fn_sev = glob.glob("/media/nas/x21308/scratch/SEVIRI/2013/12/12/*")
fn_cmsaf = ["/media/nas/x20629/SEVIRI/repr2/level2/cpp/2013/12/12/CPPin20131212100000305SVMSG01MD.nc"]
reader_sev = "seviri_l1b_hrit"
reader_cmsaf = "cmsaf-claas2_l2_nc"
sc = Scene(filenames={
reader_sev: fn_sev,
reader_cmsaf: fn_cmsaf})
sc.load(["VIS006", "IR_120", "IR_087", "VIS008", "IR_108", "IR_039", "IR_016",
"cot", "cwp", "reff"])
sattools.ptc.add_pkg_comps_mods(sc, "fogpy", sensors=["seviri"])
ls = sc.resample("germ2")
ls.load(["fls_day"])
ls.show("germ2")
This is a screenshot from an image viewer, because transparency shows up as white when displayed by my browser, so this better illustrates the transparency vs. white:
There are two problems here:
stretch
between 0 and 1 defined in fogpy/fogpy/etc/enhancements/generic.yaml
Lines 2 to 15 in 1f82e46
Generating composites issues numerous warnings:
from satpy import Scene
from glob import glob
from satpy.utils import debug_on
debug_on()
fn_nwcsaf = glob("/media/nas/x21308/scratch/NWCSAF/*100000Z.nc")
fn_sev = glob("/media/nas/x21308/scratch/SEVIRI/*201904151000*")
fn_dem=["/media/nas/x21308/DEM/dem_eu_1km.tif"]
sc = Scene(filenames={"seviri_l1b_hrit": fn_sev, "nwcsaf-geo": fn_nwcsaf})
sc.load(["cmic_reff", "IR_108", "IR_087", "cmic_cot", "IR_016", "VIS006",
"IR_120", "VIS008", "cmic_lwp", "IR_039"])
ls = sc.resample("eurol")
ls.load(["fls_night"])
ls.show("fls_night")
ls.load(["fls_day", "fls_night"])
ls.show("fls_day")
Running this gives:
/media/nas/x21324/miniconda3/envs/py37d/lib/python3.7/site-packages/pyresample/spherical.py:123: RuntimeWarning: invalid value encountered in true_divide
/media/nas/x21324/miniconda3/envs/py37d/lib/python3.7/site-packages/fogpy/algorithms.py:1446: RuntimeWarning: invalid value encountered in less
/media/nas/x21324/miniconda3/envs/py37d/lib/python3.7/site-packages/dask/core.py:119: RuntimeWarning: invalid value encountered in less_equal
/media/nas/x21324/miniconda3/envs/py37d/lib/python3.7/site-packages/dask/core.py:119: RuntimeWarning: invalid value encountered in greater_equal
/media/nas/x21324/miniconda3/envs/py37d/lib/python3.7/site-packages/fogpy/filters.py:433: RuntimeWarning: invalid value encountered in greater
/media/nas/x21324/miniconda3/envs/py37d/lib/python3.7/site-packages/fogpy/filters.py:434: RuntimeWarning: invalid value encountered in less
/media/nas/x21324/miniconda3/envs/py37d/lib/python3.7/site-packages/fogpy/filters.py:437: RuntimeWarning: invalid value encountered in greater
/media/nas/x21324/miniconda3/envs/py37d/lib/python3.7/site-packages/fogpy/filters.py:498: RuntimeWarning: invalid value encountered in greater_equal
/media/nas/x21324/miniconda3/envs/py37d/lib/python3.7/site-packages/fogpy/filters.py:499: RuntimeWarning: invalid value encountered in greater_equal
/media/nas/x21324/miniconda3/envs/py37d/lib/python3.7/site-packages/fogpy/filters.py:535: RuntimeWarning: invalid value encountered in less
/media/nas/x21324/miniconda3/envs/py37d/lib/python3.7/site-packages/fogpy/filters.py:598: RuntimeWarning: invalid value encountered in greater
/media/nas/x21324/miniconda3/envs/py37d/lib/python3.7/site-packages/fogpy/filters.py:602: RuntimeWarning: invalid value encountered in greater
/media/nas/x21324/miniconda3/envs/py37d/lib/python3.7/site-packages/fogpy/filters.py:668: RuntimeWarning: invalid value encountered in greater
/media/nas/x21324/miniconda3/envs/py37d/lib/python3.7/site-packages/fogpy/filters.py:697: RuntimeWarning: invalid value encountered in less_equal
/media/nas/x21324/miniconda3/envs/py37d/lib/python3.7/site-packages/fogpy/algorithms.py:692: RuntimeWarning: Mean of empty slice
/media/nas/x21324/miniconda3/envs/py37d/lib/python3.7/site-packages/fogpy/filters.py:757: RuntimeWarning: invalid value encountered in greater
/media/nas/x21324/miniconda3/envs/py37d/lib/python3.7/site-packages/fogpy/filters.py:855: RuntimeWarning: invalid value encountered in greater
/media/nas/x21324/miniconda3/envs/py37d/lib/python3.7/site-packages/fogpy/filters.py:1055: RuntimeWarning: Mean of empty slice
/media/nas/x21324/miniconda3/envs/py37d/lib/python3.7/site-packages/scipy/optimize/_minimize.py:517: RuntimeWarning: Method BFGS cannot handle constraints nor bounds.
The last warning is printed 4385 times, but that may be related to https://bugs.python.org/issue29672 .
Running fogpy for ABI fails with an AttributeError. Calling fogpy via fogtools with:
show-fog $PLOTDIR/abi-ne.tiff -m abi_l1b --sat import/Sat_data/OR_ABI-L1b-RadF-M3C*_G16_s20170731606102_e*.nc --nwcsaf export/CMIC/S_NWC_CMIC_GOES16_NEW-ENGLAND-NR_20170314T160610Z.nc
fails after about 8 minutes with:
[INFO: 2020-04-06 11:39:16 : fogpy.algorithms] Finish fog and low cloud detection algorithm
Traceback (most recent call last):
File "/opt/pytroll/pytroll_inst/miniconda3-exp/envs/py38/bin/show-fog", line 8, in <module>
sys.exit(main())
File "/opt/pytroll/pytroll_inst/miniconda3-exp/envs/py38/lib/python3.8/site-packages/fogtools/processing/show_fog.py", line 56, in main
rv = vis.get_fog_blend_for_sat(
File "/opt/pytroll/pytroll_inst/miniconda3-exp/envs/py38/lib/python3.8/site-packages/fogtools/vis.py", line 52, in get_fog_blend_for_sat
ls.load(["fls_day", "fls_day_extra"], unload=False)
File "/opt/pytroll/pytroll_inst/miniconda3-exp/envs/py38/lib/python3.8/site-packages/satpy/scene.py", line 973, in load
keepables = self.generate_composites()
File "/opt/pytroll/pytroll_inst/miniconda3-exp/envs/py38/lib/python3.8/site-packages/satpy/scene.py", line 888, in generate_composites
return self._read_composites(nodes)
File "/opt/pytroll/pytroll_inst/miniconda3-exp/envs/py38/lib/python3.8/site-packages/satpy/scene.py", line 863, in _read_composites
self._generate_composite(item, keepables)
File "/opt/pytroll/pytroll_inst/miniconda3-exp/envs/py38/lib/python3.8/site-packages/satpy/scene.py", line 836, in _generate_composite
composite = compositor(prereq_datasets,
File "/opt/pytroll/pytroll_inst/miniconda3-exp/envs/py38/lib/python3.8/site-packages/fogpy/composites.py", line 178, in __call__
(xrfls, xrmsk, xrvmask, xrcbh, xrfbh, xrlcth) = self._convert_ma_to_xr(
File "/opt/pytroll/pytroll_inst/miniconda3-exp/envs/py38/lib/python3.8/site-packages/fogpy/composites.py", line 123, in _convert_ma_to_xr
attrs = {k: projectables[0].attrs[k]
File "/opt/pytroll/pytroll_inst/miniconda3-exp/envs/py38/lib/python3.8/site-packages/fogpy/composites.py", line 123, in <dictcomp>
attrs = {k: projectables[0].attrs[k]
KeyError: 'satellite_longitude'
The _convert_ma_to_xr
method appears hardcoded for attributes expected on SEVIRI, but those are not the same on ABI.
A declarative, efficient, and flexible JavaScript library for building user interfaces.
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
An Open Source Machine Learning Framework for Everyone
The Web framework for perfectionists with deadlines.
A PHP framework for web artisans
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
Some thing interesting about web. New door for the world.
A server is a program made to process requests and deliver data to clients.
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Some thing interesting about visualization, use data art
Some thing interesting about game, make everyone happy.
We are working to build community through open source technology. NB: members must have two-factor auth.
Open source projects and samples from Microsoft.
Google ❤️ Open Source for everyone.
Alibaba Open Source for everyone
Data-Driven Documents codes.
China tencent open source team.