search

silx-kit / fabio

I/O library for images produced by 2D X-ray detector
Other
57 stars 52 forks source link

[debian-ci] #192

Closed picca closed 1 year ago

picca commented 6 years ago

Hello, I activated the debian-ci for fabio, so now the unit test are run each time a build dependency changed.

you can find the log here

https://ci.debian.net/packages/p/python-fabio/unstable/amd64/

For now there is a bunch of warning with python3 for unclosed files and ERROR about data stream unfinished but I do not know if this is ok. the test pass but is it normal ?

thanks

Frederic

.................../usr/lib/python3/dist-packages/fabio/test/utilstest.py:211: ResourceWarning: unclosed file <_io.BufferedWriter name='/tmp/fabio_testimages_debci/F2K_Seb_Lyso0675.edf'>
  open(fullimagename_raw, "wb").write(decompressed)
/usr/lib/python3/dist-packages/fabio/test/utilstest.py:211: ResourceWarning: unclosed file <_io.BufferedWriter name='/tmp/fabio_testimages_debci/id13_badPadding.edf'>
  open(fullimagename_raw, "wb").write(decompressed)
../usr/lib/python3/dist-packages/fabio/test/utilstest.py:211: ResourceWarning: unclosed file <_io.BufferedWriter name='/tmp/fabio_testimages_debci/edfGzip_U16.edf'>
  open(fullimagename_raw, "wb").write(decompressed)
/usr/lib/python3/dist-packages/fabio/test/utilstest.py:211: ResourceWarning: unclosed file <_io.BufferedWriter name='/tmp/fabio_testimages_debci/edfCompressed_U16.edf'>
  open(fullimagename_raw, "wb").write(decompressed)
/usr/lib/python3/dist-packages/fabio/test/utilstest.py:211: ResourceWarning: unclosed file <_io.BufferedWriter name='/tmp/fabio_testimages_debci/edfUncompressed_U16.edf'>
  open(fullimagename_raw, "wb").write(decompressed)
WARNING:fabio.compression:Encounter the python-gzip bug with trailing garbage, trying subprocess gzip
./usr/lib/python3/dist-packages/fabio/test/utilstest.py:211: ResourceWarning: unclosed file <_io.BufferedWriter name='/tmp/fabio_testimages_debci/MultiFrame.edf'>
  open(fullimagename_raw, "wb").write(decompressed)
/usr/lib/python3/dist-packages/fabio/test/utilstest.py:211: ResourceWarning: unclosed file <_io.BufferedWriter name='/tmp/fabio_testimages_debci/MultiFrame-Frame0.edf'>
  open(fullimagename_raw, "wb").write(decompressed)
/usr/lib/python3/dist-packages/fabio/test/utilstest.py:211: ResourceWarning: unclosed file <_io.BufferedWriter name='/tmp/fabio_testimages_debci/MultiFrame-Frame1.edf'>
  open(fullimagename_raw, "wb").write(decompressed)
............WARNING:fabio.edfimage:Under-short header frame 1: only 75 bytes
.ERROR:fabio.edfimage:Data stream is incomplete: 131072 < expected 262144 bytes
.WARNING:fabio.edfimage:Under-short header frame 1: only 150 bytes
.WARNING:fabio.edfimage:Under-short header frame 0: only 75 bytes
.ERROR:fabio.edfimage:Data stream is incomplete: 131072 < expected 262144 bytes
.WARNING:fabio.edfimage:Under-short header frame 0: only 150 bytes
......WARNING:fabio.edfimage:Under-short header frame 1: only 150 bytes
...WARNING:fabio.edfimage:Under-short header frame 0: only 150 bytes
../usr/lib/python3/dist-packages/fabio/test/utilstest.py:211: ResourceWarning: unclosed file <_io.BufferedWriter name='/tmp/fabio_testimages_debci/run2_1_00148.edf'>
  open(fullimagename_raw, "wb").write(decompressed)
/usr/lib/python3/dist-packages/fabio/test/utilstest.py:211: ResourceWarning: unclosed file <_io.BufferedWriter name='/tmp/fabio_testimages_debci/run2_1_00148.cbf'>
  open(fullimagename_raw, "wb").write(decompressed)
....................../usr/lib/python3/dist-packages/fabio/test/utilstest.py:211: ResourceWarning: unclosed file <_io.BufferedWriter name='/tmp/fabio_testimages_debci/mb_LP_1_001.img'>
  open(fullimagename_raw, "wb").write(decompressed)
/usr/lib/python3/dist-packages/fabio/test/utilstest.py:211: ResourceWarning: unclosed file <_io.BufferedWriter name='/tmp/fabio_testimages_debci/mb_LP_1_001.edf'>
  open(fullimagename_raw, "wb").write(decompressed)
../usr/lib/python3/dist-packages/fabio/test/utilstest.py:211: ResourceWarning: unclosed file <_io.BufferedWriter name='/tmp/fabio_testimages_debci/face.msk'>
  open(fullimagename_raw, "wb").write(decompressed)
/usr/lib/python3/dist-packages/fabio/test/utilstest.py:211: ResourceWarning: unclosed file <_io.BufferedWriter name='/tmp/fabio_testimages_debci/face.edf'>
  open(fullimagename_raw, "wb").write(decompressed)
./usr/lib/python3/dist-packages/fabio/test/utilstest.py:211: ResourceWarning: unclosed file <_io.BufferedWriter name='/tmp/fabio_testimages_debci/fit2d_click.msk'>
  open(fullimagename_raw, "wb").write(decompressed)
/usr/lib/python3/dist-packages/fabio/test/utilstest.py:211: ResourceWarning: unclosed file <_io.BufferedWriter name='/tmp/fabio_testimages_debci/fit2d_click.edf'>
  open(fullimagename_raw, "wb").write(decompressed)
...../usr/lib/python3/dist-packages/fabio/test/utilstest.py:211: ResourceWarning: unclosed file <_io.BufferedWriter name='/tmp/fabio_testimages_debci/GE_aSI_detector_image_1529'>
  open(fullimagename_raw, "wb").write(decompressed)
../usr/lib/python3/dist-packages/fabio/test/utilstest.py:211: ResourceWarning: unclosed file <_io.BufferedWriter name='/tmp/fabio_testimages_debci/example.mar2300'>
  open(fullimagename_raw, "wb").write(decompressed)
/usr/lib/python3/dist-packages/fabio/test/utilstest.py:211: ResourceWarning: unclosed file <_io.BufferedWriter name='/tmp/fabio_testimages_debci/Fe3O4_023_101.mar2560'>
  open(fullimagename_raw, "wb").write(decompressed)
..s...../usr/lib/python3/dist-packages/fabio/test/utilstest.py:211: ResourceWarning: unclosed file <_io.BufferedWriter name='/tmp/fabio_testimages_debci/Cr8F8140k103.0026'>
  open(fullimagename_raw, "wb").write(decompressed)
..WARNING:fabio.brukerimage:performing correction with slope=5.96038383093e-08, offset=1.36171e-05 (LINEAR=5.96038383093e-08 1.36171e-05)
./usr/lib/python3/dist-packages/fabio/test/utilstest.py:211: ResourceWarning: unclosed file <_io.BufferedWriter name='/tmp/fabio_testimages_debci/NaCl_10_01_0009.npy'>
  open(fullimagename_raw, "wb").write(decompressed)
/usr/lib/python3/dist-packages/fabio/test/utilstest.py:211: ResourceWarning: unclosed file <_io.BufferedWriter name='/tmp/fabio_testimages_debci/NaCl_10_01_0009.sfrm'>
  open(fullimagename_raw, "wb").write(decompressed)
.../usr/lib/python3/dist-packages/fabio/test/utilstest.py:211: ResourceWarning: unclosed file <_io.BufferedWriter name='/tmp/fabio_testimages_debci/corkcont2_H_0089.mccd'>
  open(fullimagename_raw, "wb").write(decompressed)
/usr/lib/python3/dist-packages/fabio/test/utilstest.py:211: ResourceWarning: unclosed file <_io.BufferedWriter name='/tmp/fabio_testimages_debci/somedata_0001.mccd'>
  open(fullimagename_raw, "wb").write(decompressed)
../usr/lib/python3/dist-packages/fabio/test/utilstest.py:211: ResourceWarning: unclosed file <_io.BufferedWriter name='/tmp/fabio_testimages_debci/F2K_Seb_Lyso0675_header_only.edf'>
  open(fullimagename_raw, "wb").write(decompressed)
................/usr/lib/python3/dist-packages/fabio/test/utilstest.py:211: ResourceWarning: unclosed file <_io.BufferedWriter name='/tmp/fabio_testimages_debci/b191_1_9_1.img'>
  open(fullimagename_raw, "wb").write(decompressed)
./usr/lib/python3/dist-packages/fabio/test/utilstest.py:211: ResourceWarning: unclosed file <_io.BufferedWriter name='/tmp/fabio_testimages_debci/b191_1_9_1_uncompressed.img'>
  open(fullimagename_raw, "wb").write(decompressed)
./usr/lib/python3/dist-packages/fabio/test/utilstest.py:211: ResourceWarning: unclosed file <_io.BufferedWriter name='/tmp/fabio_testimages_debci/100nmfilmonglass_1_1.img'>
  open(fullimagename_raw, "wb").write(decompressed)
/usr/lib/python3/dist-packages/fabio/test/utilstest.py:211: ResourceWarning: unclosed file <_io.BufferedWriter name='/tmp/fabio_testimages_debci/pilatus300k.rod_img'>
  open(fullimagename_raw, "wb").write(decompressed)
.../usr/lib/python3/dist-packages/fabio/test/utilstest.py:211: ResourceWarning: unclosed file <_io.BufferedWriter name='/tmp/fabio_testimages_debci/d80_60s.img'>
  open(fullimagename_raw, "wb").write(decompressed)
/usr/lib/python3/dist-packages/fabio/test/utilstest.py:211: ResourceWarning: unclosed file <_io.BufferedWriter name='/tmp/fabio_testimages_debci/d80_60s.edf'>
  open(fullimagename_raw, "wb").write(decompressed)
WARNING:fabio.edfimage:Unknown compression scheme TY1
.WARNING:fabio.OXDimage:Enforce TY1 compression
./usr/lib/python3/dist-packages/fabio/test/utilstest.py:211: ResourceWarning: unclosed file <_io.BufferedWriter name='/tmp/fabio_testimages_debci/i01f0001.kcd'>
  open(fullimagename_raw, "wb").write(decompressed)
/usr/lib/python3/dist-packages/fabio/test/utilstest.py:211: ResourceWarning: unclosed file <_io.BufferedWriter name='/tmp/fabio_testimages_debci/i01f0001.edf'>
  open(fullimagename_raw, "wb").write(decompressed)
../usr/lib/python3/dist-packages/fabio/test/utilstest.py:211: ResourceWarning: unclosed file <_io.BufferedWriter name='/tmp/fabio_testimages_debci/Feb09-bright-00.300s_WAXS'>
  open(fullimagename_raw, "wb").write(decompressed)
WARNING:fabio.TiffIO:Bogus StripByteCounts information
WARNING:fabio.TiffIO:Bogus StripByteCounts information
WARNING:fabio.TiffIO:Bogus StripByteCounts information
./usr/lib/python3/dist-packages/fabio/test/utilstest.py:211: ResourceWarning: unclosed file <_io.BufferedWriter name='/tmp/fabio_testimages_debci/oPPA_5grains_0001.tif'>
  open(fullimagename_raw, "wb").write(decompressed)
./usr/lib/python3/dist-packages/fabio/test/utilstest.py:211: ResourceWarning: unclosed file <_io.BufferedWriter name='/tmp/fabio_testimages_debci/testmap1_0002.tif'>
  open(fullimagename_raw, "wb").write(decompressed)
./usr/lib/python3/dist-packages/fabio/test/utilstest.py:211: ResourceWarning: unclosed file <_io.BufferedWriter name='/tmp/fabio_testimages_debci/a0009.tif'>
  open(fullimagename_raw, "wb").write(decompressed)
/usr/lib/python3/dist-packages/fabio/test/utilstest.py:211: ResourceWarning: unclosed file <_io.BufferedWriter name='/tmp/fabio_testimages_debci/a0009.edf'>
  open(fullimagename_raw, "wb").write(decompressed)
WARNING:fabio.TiffIO:Non standard TIFF. Rows per strip TAG missing
WARNING:fabio.TiffIO:Non standard TIFF. Strip byte counts TAG missing
./usr/lib/python3/dist-packages/fabio/test/utilstest.py:211: ResourceWarning: unclosed file <_io.BufferedWriter name='/tmp/fabio_testimages_debci/fit2d.tif'>
  open(fullimagename_raw, "wb").write(decompressed)
/usr/lib/python3/dist-packages/fabio/test/utilstest.py:211: ResourceWarning: unclosed file <_io.BufferedWriter name='/tmp/fabio_testimages_debci/fit2d.edf'>
  open(fullimagename_raw, "wb").write(decompressed)
WARNING:fabio.edfimage:Unknown compression scheme FALSE
./usr/lib/python3/dist-packages/fabio/test/utilstest.py:211: ResourceWarning: unclosed file <_io.BufferedWriter name='/tmp/fabio_testimages_debci/oPPA_5grains_0001.edf'>
  open(fullimagename_raw, "wb").write(decompressed)
./usr/lib/python3/dist-packages/fabio/test/utilstest.py:211: ResourceWarning: unclosed file <_io.BufferedWriter name='/tmp/fabio_testimages_debci/pilatus2M.tif'>
  open(fullimagename_raw, "wb").write(decompressed)
/usr/lib/python3/dist-packages/fabio/test/utilstest.py:211: ResourceWarning: unclosed file <_io.BufferedWriter name='/tmp/fabio_testimages_debci/pilatus2M.edf'>
  open(fullimagename_raw, "wb").write(decompressed)
./usr/lib/python3/dist-packages/fabio/test/utilstest.py:211: ResourceWarning: unclosed file <_io.BufferedWriter name='/tmp/fabio_testimages_debci/XSDataImage.edf'>
  open(fullimagename_raw, "wb").write(decompressed)
/usr/lib/python3/dist-packages/fabio/test/utilstest.py:211: ResourceWarning: unclosed file <_io.BufferedWriter name='/tmp/fabio_testimages_debci/XSDataImage.xml'>
  open(fullimagename_raw, "wb").write(decompressed)
/usr/lib/python3/dist-packages/fabio/test/utilstest.py:211: ResourceWarning: unclosed file <_io.BufferedWriter name='/tmp/fabio_testimages_debci/XSDataImageInv.xml'>
  open(fullimagename_raw, "wb").write(decompressed)
.../usr/lib/python3/dist-packages/fabio/test/utilstest.py:211: ResourceWarning: unclosed file <_io.BufferedWriter name='/tmp/fabio_testimages_debci/mgzn-20hpt.img'>
  open(fullimagename_raw, "wb").write(decompressed)
../usr/lib/python3/dist-packages/fabio/test/utilstest.py:211: ResourceWarning: unclosed file <_io.BufferedWriter name='/tmp/fabio_testimages_debci/image0001.pgm'>
  open(fullimagename_raw, "wb").write(decompressed)
......./usr/lib/python3/dist-packages/fabio/test/utilstest.py:211: ResourceWarning: unclosed file <_io.BufferedWriter name='/tmp/fabio_testimages_debci/lysb_5mg-1.90s_SAXS'>
  open(fullimagename_raw, "wb").write(decompressed)
......./usr/lib/python3/dist-packages/fabio/test/utilstest.py:211: ResourceWarning: unclosed file <_io.BufferedWriter name='/tmp/fabio_testimages_debci/fit2d.f2d'>
  open(fullimagename_raw, "wb").write(decompressed)
/usr/lib/python3/dist-packages/fabio/test/utilstest.py:211: ResourceWarning: unclosed file <_io.BufferedWriter name='/tmp/fabio_testimages_debci/Pilatus1M.f2d'>
  open(fullimagename_raw, "wb").write(decompressed)
/usr/lib/python3/dist-packages/fabio/test/utilstest.py:211: ResourceWarning: unclosed file <_io.BufferedWriter name='/tmp/fabio_testimages_debci/Pilatus1M.cbf'>
  open(fullimagename_raw, "wb").write(decompressed)
/usr/lib/python3/dist-packages/fabio/test/utilstest.py:211: ResourceWarning: unclosed file <_io.BufferedWriter name='/tmp/fabio_testimages_debci/Pilatus1M.msk'>
  open(fullimagename_raw, "wb").write(decompressed)
.../usr/lib/python3/dist-packages/fabio/test/utilstest.py:211: ResourceWarning: unclosed file <_io.BufferedWriter name='/tmp/fabio_testimages_debci/v2.SPE'>
  open(fullimagename_raw, "wb").write(decompressed)
/usr/lib/python3/dist-packages/fabio/test/utilstest.py:211: ResourceWarning: unclosed file <_io.BufferedWriter name='/tmp/fabio_testimages_debci/v2_converted.SPE'>
  open(fullimagename_raw, "wb").write(decompressed)
/usr/lib/python3/dist-packages/fabio/test/utilstest.py:211: ResourceWarning: unclosed file <_io.BufferedWriter name='/tmp/fabio_testimages_debci/v3.spe'>
  open(fullimagename_raw, "wb").write(decompressed)
/usr/lib/python3/dist-packages/fabio/test/utilstest.py:211: ResourceWarning: unclosed file <_io.BufferedWriter name='/tmp/fabio_testimages_debci/v3_custom_roi.spe'>
  open(fullimagename_raw, "wb").write(decompressed)
/usr/lib/python3/dist-packages/fabio/test/utilstest.py:211: ResourceWarning: unclosed file <_io.BufferedWriter name='/tmp/fabio_testimages_debci/v3_2frames.spe'>
  open(fullimagename_raw, "wb").write(decompressed)
....................../usr/lib/python3/dist-packages/fabio/test/utilstest.py:211: ResourceWarning: unclosed file <_io.BufferedWriter name='/tmp/fabio_testimages_debci/rand_uint8.jpg'>
  open(fullimagename_raw, "wb").write(decompressed)
......ssssssssssssssss/usr/lib/python3/dist-packages/fabio/test/utilstest.py:211: ResourceWarning: unclosed file <_io.BufferedWriter name='/tmp/fabio_testimages_debci/mpa_test.mpa'>
  open(fullimagename_raw, "wb").write(decompressed)
./usr/lib/python3/dist-packages/fabio/test/utilstest.py:211: ResourceWarning: unclosed file <_io.BufferedWriter name='/tmp/fabio_testimages_debci/ref_d20x_310mm.dm3'>
  open(fullimagename_raw, "wb").write(decompressed)
...WARNING:fabio.edfimage:Under-short header frame 0: only 32 bytes
.WARNING:fabio.edfimage:Under-short header frame 0: only 32 bytes
......
----------------------------------------------------------------------
Ran 207 tests in 371.727s

OK (skipped=17)
vallsv commented 6 years ago

Thanks a lot. Could it be possible to execute the tests using -v (if you use run_tests). It should also display test names. It can be very useful for debugging.

picca commented 6 years ago

Yes I can ;)

De : Valentin Valls [notifications@github.com] Envoyé : mardi 23 janvier 2018 09:32 À : silx-kit/fabio Cc : PICCA Frederic-Emmanuel; Author Objet : Re: [silx-kit/fabio] [debian-ci] (#192)

Thanks a lot. Could it be possible to execute the tests using -v (if you use run_tests). It should also display test names. It can be very useful for debugging.

— You are receiving this because you authored the thread. Reply to this email directly, view it on GitHubhttps://github.com/silx-kit/fabio/issues/192#issuecomment-359715367, or mute the threadhttps://github.com/notifications/unsubscribe-auth/ACnU6jakF4t9OkqQJ2uogu2da61Po78Qks5tNZkWgaJpZM4RpO4R.

vallsv commented 6 years ago

I will push a patch relative to the "ResourceWarning: unclosed file"