search

ocr-d-modul-2-segmentierung / ocrd-pixelclassifier-segmentation

Wrapper around pixel classifier
Apache License 2.0
9 stars 6 forks source link

TypeError: unsupported operand type(s) for -: 'int' and 'NoneType' #16

Closed jbarth-ubhd closed 3 years ago

jbarth-ubhd commented 3 years ago

Does it require cuda? No... then it must be an other problem.

workflow (without cis-ocropy-clip):

. /usr/local/ocrd_all/venv/bin/activate
export TMPDIR=/dwork/tmp
export LD_LIBRARY_PATH=/usr/local/lib:$LD_LIBRARY_PATH
ocrd-create-mets.xml
( /usr/bin/time ocrd process \
"olena-binarize -I OCR-D-IMG -O OCR-D-N1 -P impl wolf" \
"anybaseocr-crop -I OCR-D-N1 -O OCR-D-N2" \
"olena-binarize -I OCR-D-N2 -O OCR-D-N3 -P impl wolf" \
"cis-ocropy-denoise -I OCR-D-N3 -O OCR-D-N4 -P level-of-operation page" \
"cis-ocropy-deskew -I OCR-D-N4 -O OCR-D-N5 -P level-of-operation page" \
"pc-segmentation -I OCR-D-N5 -O OCR-D-N6" \
"cis-ocropy-deskew -I OCR-D-N6 -O OCR-D-N7 -P level-of-operation region" \
"tesserocr-segment-line -I OCR-D-N7 -O OCR-D-N8" \
"cis-ocropy-resegment -I OCR-D-N8 -O OCR-D-N9" \
"cis-ocropy-dewarp -I OCR-D-N9 -O OCR-D-N10" \
"calamari-recognize -I OCR-D-N10 -O OCR-D-OCR -P checkpoint /usr/local/ocrd_models/calamari/calamari_models-0.3/fraktur_19th_century/*.ckpt.json"

) >cmd.log 2>&1

log | fold -s -w 72

15:31:21.117 INFO ocrd.task_sequence.run_tasks - Start processing task 
'pc-segmentation -I OCR-D-N5 -O OCR-D-N6 -p '{"overwrite_regions": 
true, "xheight": 8, "model": "__DEFAULT__", "gpu_allow_growth": false, 
"resize_height": 300}''
Traceback (most recent call last):
  File 
"/dwork/ocrd-schroot-ubuntu-eoan/usr/local/ocrd_all/venv/bin/ocrd", 
line 8, in <module>
    sys.exit(cli())
  File 
"/dwork/ocrd-schroot-ubuntu-eoan/usr/local/ocrd_all/venv/lib/python3.7/s
ite-packages/click/core.py", line 829, in __call__
    return self.main(*args, **kwargs)
  File 
"/dwork/ocrd-schroot-ubuntu-eoan/usr/local/ocrd_all/venv/lib/python3.7/s
ite-packages/click/core.py", line 782, in main
    rv = self.invoke(ctx)
  File 
"/dwork/ocrd-schroot-ubuntu-eoan/usr/local/ocrd_all/venv/lib/python3.7/s
ite-packages/click/core.py", line 1259, in invoke
    return _process_result(sub_ctx.command.invoke(sub_ctx))
  File 
"/dwork/ocrd-schroot-ubuntu-eoan/usr/local/ocrd_all/venv/lib/python3.7/s
ite-packages/click/core.py", line 1066, in invoke
    return ctx.invoke(self.callback, **ctx.params)
  File 
"/dwork/ocrd-schroot-ubuntu-eoan/usr/local/ocrd_all/venv/lib/python3.7/s
ite-packages/click/core.py", line 610, in invoke
    return callback(*args, **kwargs)
  File 
"/dwork/ocrd-schroot-ubuntu-eoan/usr/local/ocrd_all/venv/lib/python3.7/s
ite-packages/ocrd/cli/process.py", line 26, in process_cli
    run_tasks(mets, log_level, page_id, tasks, overwrite)
  File 
"/dwork/ocrd-schroot-ubuntu-eoan/usr/local/ocrd_all/venv/lib/python3.7/s
ite-packages/ocrd/task_sequence.py", line 149, in run_tasks
    raise Exception("%s exited with non-zero return value %s. 
STDOUT:\n%s\nSTDERR:\n%s" % (task.executable, returncode, out, err))
Exception: ocrd-pc-segmentation exited with non-zero return value 1. 
STDOUT:

STDERR:
15:31:22.825 INFO processor.PixelClassifierSegmentation - INPUT FILE 0 
/ P_00001
2020-10-09 15:31:27.681889: W 
tensorflow/stream_executor/platform/default/dso_loader.cc:59] Could not 
load dynamic library 'libcudart.so.10.1'; dlerror: libcudart.so.10.1: 
cannot open shared object file: No such file or directory; 
LD_LIBRARY_PATH: /usr/local/lib:
2020-10-09 15:31:27.681931: I 
tensorflow/stream_executor/cuda/cudart_stub.cc:29] Ignore above cudart 
dlerror if you do not have a GPU set up on your machine.
2020-10-09 15:31:34.975002: W 
tensorflow/stream_executor/platform/default/dso_loader.cc:59] Could not 
load dynamic library 'libcuda.so.1'; dlerror: libcuda.so.1: cannot open 
shared object file: No such file or directory; LD_LIBRARY_PATH: 
/usr/local/lib:
2020-10-09 15:31:34.975046: W 
tensorflow/stream_executor/cuda/cuda_driver.cc:312] failed call to 
cuInit: UNKNOWN ERROR (303)
2020-10-09 15:31:34.975081: I 
tensorflow/stream_executor/cuda/cuda_diagnostics.cc:156] kernel driver 
does not appear to be running on this host (pers109): 
/proc/driver/nvidia/version does not exist
2020-10-09 15:31:34.975475: I 
tensorflow/core/platform/cpu_feature_guard.cc:142] This TensorFlow 
binary is optimized with oneAPI Deep Neural Network Library (oneDNN)to 
use the following CPU instructions in performance-critical operations:  
AVX2 AVX512F FMA
To enable them in other operations, rebuild TensorFlow with the 
appropriate compiler flags.
2020-10-09 15:31:35.159446: I 
tensorflow/core/platform/profile_utils/cpu_utils.cc:104] CPU Frequency: 
2700000000 Hz
2020-10-09 15:31:35.167069: I 
tensorflow/compiler/xla/service/service.cc:168] XLA service 0x55f5930 
initialized for platform Host (this does not guarantee that XLA will be 
used). Devices:
2020-10-09 15:31:35.167131: I 
tensorflow/compiler/xla/service/service.cc:176]   StreamExecutor device 
(0): Host, Default Version
2020-10-09 15:31:37.416557: W 
tensorflow/core/framework/cpu_allocator_impl.cc:81] Allocation of 
1368064000 exceeds 10% of free system memory.
2020-10-09 15:31:40.551333: W 
tensorflow/core/framework/cpu_allocator_impl.cc:81] Allocation of 
2052096000 exceeds 10% of free system memory.
2020-10-09 15:31:43.272163: W 
tensorflow/core/framework/cpu_allocator_impl.cc:81] Allocation of 
2137600000 exceeds 10% of free system memory.
2020-10-09 15:31:44.544863: W 
tensorflow/core/framework/cpu_allocator_impl.cc:81] Allocation of 
4275200000 exceeds 10% of free system memory.
2020-10-09 15:31:46.975789: W 
tensorflow/core/framework/cpu_allocator_impl.cc:81] Allocation of 
1197056000 exceeds 10% of free system memory.
Traceback (most recent call last):
  File 
"/dwork/ocrd-schroot-ubuntu-eoan/usr/local/ocrd_all/venv/local/sub-venv/
headless-tf2/bin/ocrd-pc-segmentation", line 8, in <module>
    sys.exit(ocrd_pc_segmentation())
  File 
"/dwork/ocrd-schroot-ubuntu-eoan/usr/local/ocrd_all/venv/local/sub-venv/
headless-tf2/lib/python3.7/site-packages/click/core.py", line 829, in 
__call__
    return self.main(*args, **kwargs)
  File 
"/dwork/ocrd-schroot-ubuntu-eoan/usr/local/ocrd_all/venv/local/sub-venv/
headless-tf2/lib/python3.7/site-packages/click/core.py", line 782, in 
main
    rv = self.invoke(ctx)
  File 
"/dwork/ocrd-schroot-ubuntu-eoan/usr/local/ocrd_all/venv/local/sub-venv/
headless-tf2/lib/python3.7/site-packages/click/core.py", line 1066, in 
invoke
    return ctx.invoke(self.callback, **ctx.params)
  File 
"/dwork/ocrd-schroot-ubuntu-eoan/usr/local/ocrd_all/venv/local/sub-venv/
headless-tf2/lib/python3.7/site-packages/click/core.py", line 610, in 
invoke
    return callback(*args, **kwargs)
  File 
"/dwork/ocrd-schroot-ubuntu-eoan/usr/local/ocrd_all/venv/local/sub-venv/
headless-tf2/lib/python3.7/site-packages/ocrd_pc_segmentation/cli.py", 
line 10, in ocrd_pc_segmentation
    return ocrd_cli_wrap_processor(PixelClassifierSegmentation, *args, 
**kwargs)
  File 
"/dwork/ocrd-schroot-ubuntu-eoan/usr/local/ocrd_all/venv/local/sub-venv/
headless-tf2/lib/python3.7/site-packages/ocrd/decorators/__init__.py", 
line 81, in ocrd_cli_wrap_processor
    run_processor(processorClass, ocrd_tool, mets, workspace=workspace, 
**kwargs)
  File 
"/dwork/ocrd-schroot-ubuntu-eoan/usr/local/ocrd_all/venv/local/sub-venv/
headless-tf2/lib/python3.7/site-packages/ocrd/processor/helpers.py", 
line 68, in run_processor
    processor.process()
  File 
"/dwork/ocrd-schroot-ubuntu-eoan/usr/local/ocrd_all/venv/local/sub-venv/
headless-tf2/lib/python3.7/site-packages/ocrd_pc_segmentation/ocrd_segme
ntation.py", line 115, in process
    gpu_allow_growth, resize_height)
  File 
"/dwork/ocrd-schroot-ubuntu-eoan/usr/local/ocrd_all/venv/local/sub-venv/
headless-tf2/lib/python3.7/site-packages/ocrd_pc_segmentation/ocrd_segme
ntation.py", line 152, in _process_page
    masks = predictor.predict_masks(data)
  File 
"/dwork/ocrd-schroot-ubuntu-eoan/usr/local/ocrd_all/venv/local/sub-venv/
headless-tf2/lib/python3.7/site-packages/ocr4all_pixel_classifier/lib/pr
edictor.py", line 74, in predict_masks
    return generate_output_masks(data, pred, self.settings.color_map)
  File 
"/dwork/ocrd-schroot-ubuntu-eoan/usr/local/ocrd_all/venv/local/sub-venv/
headless-tf2/lib/python3.7/site-packages/ocr4all_pixel_classifier/lib/ou
tput.py", line 46, in generate_output_masks
    foreground = np.stack([(1 - data.binary)] * 3, axis=-1)
TypeError: unsupported operand type(s) for -: 'int' and 'NoneType'

Command exited with non-zero status 1
crater2150 commented 3 years ago

Fixed in ocr4all-pixel-classifier>=0.6.5