Eynollah process is crashing and exiting with -di flag

When eynollah is run with -di flag, in some instances it crashes and stops processing.
The command used: eynollah -di ./issue_images/000___2020___sustainability_report___ed8c9421412e74c2ad60da1f702dafa2__174456655 -m ./models/ -o ./page_xml/sustainability_report/2020/ed8c9421412e74c2ad60da1f702dafa2__174456655/ -light -fl -ipe -tab
The images were generated from pdfs using pdf2image python package.
Server specifications are as follows:
Server | GPUs| CPUs| RAM| GPU Memory g3s.xlarge | 1 | 4 | 30.5 | 8
Tesla M60 GPU
I've attached the images of one pdfs, and also attached 10 sample pdfs that are causing the issue. Please note that some of the documents are not in English, would that cause any issue? 0002020sustainability_report_ed8c9421412e74c2ad60da1f702dafa2174456655.zip pdfs
It was recommended earlier to use -ipe flag to avoid another issue occurring: https://github.com/qurator-spk/eynollah/issues/77
The issue does not appear when running with the -i flag. But because we have a lot of documents to process, we need the -di flag.
The stack trace is:
eynollah -di ./issue_images/000___2020___sustainability_report___ed8c9421412e74c2ad60da1f702dafa2__174456655 -m ./models/ -o ./page_xml/sustainability_report/2020/ed8c9421412e74c2ad60da1f702dafa2__174456655/ -light -fl -ipe -tab
[Errno 2] No such file or directory: 'identify': 'identify'
17:23:21.814 INFO eynollah - Resizing and enhancing image...
17:23:21.814 INFO eynollah - Detected 230 DPI
17:23:26.879 INFO eynollah - Found 1 columns ([[9.9999678e-01 3.2104797e-06 9.3880003e-18 2.2546431e-17 3.9680694e-18
  4.1701970e-16]])
17:23:26.893 INFO eynollah - Image was enhanced.
17:23:26.903 INFO eynollah - Enhancing took 5.2s 
17:23:27.190 INFO eynollah - Image dimensions: 224x448
17:23:32.681 INFO eynollah - Image dimensions: 448x672
17:23:38.579 INFO eynollah - Image dimensions: 448x672
17:23:51.908 INFO eynollah - slope_deskew: 0.22727272727272663
17:24:11.386 INFO eynollah - detection of marginals took 0.2s
17:24:14.449 INFO eynollah - Image dimensions: 896x896
17:24:22.544 INFO eynollah - Image dimensions: 896x896
17:24:33.125 INFO eynollah - Job done in 71.4s
17:24:33.125 INFO eynollah.writer - output filename: './page_xml/sustainability_report/2020/ed8c9421412e74c2ad60da1f702dafa2__174456655/page15.xml'
[Errno 2] No such file or directory: 'identify': 'identify'
17:24:33.270 INFO eynollah - Resizing and enhancing image...
17:24:33.270 INFO eynollah - Detected 230 DPI
17:24:33.361 INFO eynollah - Found 2 columns ([[8.2128608e-06 9.9959677e-01 3.6321968e-08 3.7463789e-04 8.4602252e-06
  1.1857667e-05]])
17:24:33.375 INFO eynollah - Image was enhanced.
17:24:33.386 INFO eynollah - Enhancing took 0.2s 
17:24:33.692 INFO eynollah - Image dimensions: 224x448
17:24:35.564 INFO eynollah - Image dimensions: 448x672
17:24:37.337 INFO eynollah - Image dimensions: 448x672
17:24:47.917 INFO eynollah - slope_deskew: 0.22727272727272663
17:25:08.496 INFO eynollah - detection of marginals took 0.2s
17:25:11.471 INFO eynollah - Image dimensions: 896x896
17:25:13.299 INFO eynollah - Image dimensions: 896x896
17:25:22.837 INFO eynollah - Job done in 49.7s
17:25:22.838 INFO eynollah.writer - output filename: './page_xml/sustainability_report/2020/ed8c9421412e74c2ad60da1f702dafa2__174456655/page60.xml'
[Errno 2] No such file or directory: 'identify': 'identify'
17:25:22.961 INFO eynollah - Resizing and enhancing image...
17:25:22.961 INFO eynollah - Detected 230 DPI
17:25:23.047 INFO eynollah - Found 2 columns ([[9.0465095e-04 9.9909532e-01 1.9286886e-11 2.2578611e-11 1.8923075e-12
  1.3957758e-09]])
17:25:23.061 INFO eynollah - Image was enhanced.
17:25:23.067 INFO eynollah - Enhancing took 0.2s 
17:25:23.392 INFO eynollah - Image dimensions: 224x448
17:25:25.271 INFO eynollah - Image dimensions: 448x672
17:25:27.041 INFO eynollah - Image dimensions: 448x672
17:25:37.847 INFO eynollah - slope_deskew: -2.5
17:25:59.285 INFO eynollah - detection of marginals took 0.1s
17:26:02.021 INFO eynollah - Image dimensions: 896x896
17:26:03.874 INFO eynollah - Image dimensions: 896x896
17:26:11.034 INFO eynollah - Job done in 48.2s
17:26:11.034 INFO eynollah.writer - output filename: './page_xml/sustainability_report/2020/ed8c9421412e74c2ad60da1f702dafa2__174456655/page68.xml'
[Errno 2] No such file or directory: 'identify': 'identify'
17:26:11.164 INFO eynollah - Resizing and enhancing image...
17:26:11.164 INFO eynollah - Detected 230 DPI
17:26:11.253 INFO eynollah - Found 1 columns ([[1.0000000e+00 4.8253853e-15 1.0667150e-13 8.4323712e-19 1.3115061e-21
  2.3552048e-24]])
17:26:11.263 INFO eynollah - Image was enhanced.
17:26:11.269 INFO eynollah - Enhancing took 0.2s 
17:26:11.615 INFO eynollah - Image dimensions: 224x448
17:26:12.909 INFO eynollah - Image dimensions: 448x672
17:26:14.146 INFO eynollah - Image dimensions: 448x672
17:26:24.355 INFO eynollah - slope_deskew: -0.22727272727272663
17:26:47.650 INFO eynollah - detection of marginals took 0.2s
17:26:50.667 INFO eynollah - Image dimensions: 896x896
17:26:53.209 INFO eynollah - Image dimensions: 896x896
17:26:59.795 INFO eynollah - Job done in 48.8s
17:26:59.796 INFO eynollah.writer - output filename: './page_xml/sustainability_report/2020/ed8c9421412e74c2ad60da1f702dafa2__174456655/page4.xml'
[Errno 2] No such file or directory: 'identify': 'identify'
17:26:59.917 INFO eynollah - Resizing and enhancing image...
17:26:59.918 INFO eynollah - Detected 230 DPI
17:27:00.008 INFO eynollah - Found 3 columns ([[1.7893100e-04 5.9911486e-08 9.9982101e-01 6.1556178e-09 1.0413114e-13
  3.4249886e-08]])
17:27:00.019 INFO eynollah - Image was enhanced.
17:27:00.025 INFO eynollah - Enhancing took 0.2s 
17:27:00.413 INFO eynollah - Image dimensions: 224x448
17:27:03.388 INFO eynollah - Image dimensions: 448x672
17:27:06.196 INFO eynollah - Image dimensions: 448x672
17:27:17.682 INFO eynollah - slope_deskew: -0.22727272727272663
17:27:41.710 INFO eynollah - detection of marginals took 0.0s
17:27:44.726 INFO eynollah - Image dimensions: 896x896
17:27:46.601 INFO eynollah - Image dimensions: 896x896
17:27:57.192 ERROR eynollah - index 77 is out of bounds for axis 0 with size 77
17:27:57.581 INFO eynollah - Job done in 57.8s
17:27:57.581 INFO eynollah.writer - output filename: './page_xml/sustainability_report/2020/ed8c9421412e74c2ad60da1f702dafa2__174456655/page42.xml'
[Errno 2] No such file or directory: 'identify': 'identify'
17:27:57.705 INFO eynollah - Resizing and enhancing image...
17:27:57.705 INFO eynollah - Detected 230 DPI
17:27:57.793 INFO eynollah - Found 2 columns ([[2.1592376e-01 7.8407621e-01 1.9423045e-10 2.0287512e-09 3.5663394e-09
  5.5609437e-11]])
17:27:57.799 INFO eynollah - Image was enhanced.
17:27:57.805 INFO eynollah - Enhancing took 0.2s 
17:27:58.198 INFO eynollah - Image dimensions: 224x448
17:28:00.243 INFO eynollah - Image dimensions: 448x672
17:28:02.181 INFO eynollah - Image dimensions: 448x672
17:28:12.333 INFO eynollah - slope_deskew: -6.136363636363637
17:28:37.773 INFO eynollah - detection of marginals took 0.2s
17:28:40.800 INFO eynollah - Image dimensions: 896x896
17:28:42.733 INFO eynollah - Image dimensions: 896x896
17:28:50.875 INFO eynollah - Job done in 53.3s
17:28:50.875 INFO eynollah.writer - output filename: './page_xml/sustainability_report/2020/ed8c9421412e74c2ad60da1f702dafa2__174456655/page0.xml'
[Errno 2] No such file or directory: 'identify': 'identify'
17:28:50.998 INFO eynollah - Resizing and enhancing image...
17:28:50.998 INFO eynollah - Detected 230 DPI
17:28:51.086 INFO eynollah - Found 2 columns ([[8.5421326e-04 9.9914575e-01 4.5472558e-12 1.1925855e-09 2.6132213e-13
  2.1704227e-10]])
17:28:51.093 INFO eynollah - Image was enhanced.
17:28:51.098 INFO eynollah - Enhancing took 0.2s 
17:28:51.510 INFO eynollah - Image dimensions: 224x448
17:28:53.584 INFO eynollah - Image dimensions: 448x672
17:28:55.537 INFO eynollah - Image dimensions: 448x672
17:29:06.026 INFO eynollah - slope_deskew: 0.22727272727272663
17:29:32.607 INFO eynollah - detection of marginals took 0.2s
17:29:35.765 INFO eynollah - Image dimensions: 896x896
17:29:37.700 INFO eynollah - Image dimensions: 896x896
17:29:46.908 INFO eynollah - Job done in 56.0s
17:29:46.908 INFO eynollah.writer - output filename: './page_xml/sustainability_report/2020/ed8c9421412e74c2ad60da1f702dafa2__174456655/page14.xml'
[Errno 2] No such file or directory: 'identify': 'identify'
17:29:47.027 INFO eynollah - Resizing and enhancing image...
17:29:47.027 INFO eynollah - Detected 230 DPI
17:29:47.140 INFO eynollah - Found 1 columns ([[9.9490535e-01 5.0945967e-03 1.8765526e-08 5.1456077e-08 4.9560528e-10
  2.8305782e-09]])
17:29:47.150 INFO eynollah - Image was enhanced.
17:29:47.155 INFO eynollah - Enhancing took 0.2s 
17:29:47.592 INFO eynollah - Image dimensions: 224x448
17:29:49.270 INFO eynollah - Image dimensions: 448x672
17:29:50.708 INFO eynollah - Image dimensions: 448x672
17:30:00.833 INFO eynollah - slope_deskew: 0.22727272727272663
17:30:29.102 INFO eynollah - detection of marginals took 0.2s
17:30:32.179 INFO eynollah - Image dimensions: 896x896
17:30:34.940 INFO eynollah - Image dimensions: 896x896
17:30:41.077 INFO eynollah - Job done in 54.2s
17:30:41.077 INFO eynollah.writer - output filename: './page_xml/sustainability_report/2020/ed8c9421412e74c2ad60da1f702dafa2__174456655/page70.xml'
[Errno 2] No such file or directory: 'identify': 'identify'
17:30:41.200 INFO eynollah - Resizing and enhancing image...
17:30:41.201 INFO eynollah - Detected 230 DPI
17:30:41.286 INFO eynollah - Found 2 columns ([[2.0235138e-04 9.9979764e-01 2.1669530e-24 2.6852763e-33 1.0369204e-29
  1.3410287e-24]])
17:30:41.292 INFO eynollah - Image was enhanced.
17:30:41.298 INFO eynollah - Enhancing took 0.2s 
17:30:41.770 INFO eynollah - Image dimensions: 224x448
17:30:43.968 INFO eynollah - Image dimensions: 448x672
17:30:46.034 INFO eynollah - Image dimensions: 448x672
17:30:56.518 INFO eynollah - slope_deskew: 0.22727272727272663
17:31:25.699 INFO eynollah - detection of marginals took 0.1s
17:31:28.954 INFO eynollah - Image dimensions: 896x896
17:31:30.949 INFO eynollah - Image dimensions: 896x896
17:31:41.950 INFO eynollah - Job done in 60.9s
17:31:41.950 INFO eynollah.writer - output filename: './page_xml/sustainability_report/2020/ed8c9421412e74c2ad60da1f702dafa2__174456655/page23.xml'
[Errno 2] No such file or directory: 'identify': 'identify'
17:31:42.077 INFO eynollah - Resizing and enhancing image...
17:31:42.077 INFO eynollah - Detected 230 DPI
17:31:42.167 INFO eynollah - Found 2 columns ([[1.7589232e-02 9.8240948e-01 3.6152553e-08 3.3549600e-07 1.9289803e-10
  9.5576365e-07]])
17:31:42.176 INFO eynollah - Image was enhanced.
17:31:42.182 INFO eynollah - Enhancing took 0.2s 
17:31:42.696 INFO eynollah - Image dimensions: 224x448
17:31:44.942 INFO eynollah - Image dimensions: 448x672
17:31:47.045 INFO eynollah - Image dimensions: 448x672
17:31:57.927 INFO eynollah - slope_deskew: -0.22727272727272663
17:32:28.396 INFO eynollah - detection of marginals took 0.1s
17:32:31.417 INFO eynollah - Image dimensions: 896x896
17:32:33.438 INFO eynollah - Image dimensions: 896x896
17:32:42.399 INFO eynollah - Job done in 60.4s
17:32:42.400 INFO eynollah.writer - output filename: './page_xml/sustainability_report/2020/ed8c9421412e74c2ad60da1f702dafa2__174456655/page30.xml'
[Errno 2] No such file or directory: 'identify': 'identify'
17:32:42.527 INFO eynollah - Resizing and enhancing image...
17:32:42.527 INFO eynollah - Detected 230 DPI
17:32:42.626 INFO eynollah - Found 4 columns ([[1.13236457e-02 4.73081786e-03 2.45059677e-03 9.75846648e-01
  5.64821949e-03 1.18253396e-07]])
17:32:42.645 INFO eynollah - Image was enhanced.
17:32:42.664 INFO eynollah - Enhancing took 0.3s 
17:32:43.195 INFO eynollah - Image dimensions: 224x448
17:32:48.472 INFO eynollah - Image dimensions: 448x672
17:32:52.762 INFO eynollah - Image dimensions: 448x672
17:33:27.814 INFO eynollah - slope_deskew: 0.22727272727272663
17:34:02.510 INFO eynollah - detection of marginals took 0.0s
17:34:13.798 INFO eynollah - Image dimensions: 896x896
17:34:16.284 INFO eynollah - Image dimensions: 896x896
17:34:38.955 ERROR eynollah - index 17 is out of bounds for axis 0 with size 17
17:34:39.297 INFO eynollah - Job done in 116.9s
17:34:39.298 INFO eynollah.writer - output filename: './page_xml/sustainability_report/2020/ed8c9421412e74c2ad60da1f702dafa2__174456655/page72.xml'
[Errno 2] No such file or directory: 'identify': 'identify'
17:34:39.434 INFO eynollah - Resizing and enhancing image...
17:34:39.435 INFO eynollah - Detected 230 DPI
17:34:39.536 INFO eynollah - Found 2 columns ([[5.8579806e-04 9.9939597e-01 4.9447756e-08 1.7291617e-05 6.3068683e-07
  2.2113298e-07]])
17:34:39.543 INFO eynollah - Image was enhanced.
17:34:39.548 INFO eynollah - Enhancing took 0.2s 
17:34:40.090 INFO eynollah - Image dimensions: 224x448
17:34:42.427 INFO eynollah - Image dimensions: 448x672
17:34:44.667 INFO eynollah - Image dimensions: 448x672
17:34:55.640 INFO eynollah - slope_deskew: 0.22727272727272663
17:35:29.373 INFO eynollah - detection of marginals took 0.2s
17:35:32.662 INFO eynollah - Image dimensions: 896x896
17:35:34.696 INFO eynollah - Image dimensions: 896x896
17:35:44.273 INFO eynollah - Job done in 65.0s
17:35:44.273 INFO eynollah.writer - output filename: './page_xml/sustainability_report/2020/ed8c9421412e74c2ad60da1f702dafa2__174456655/page43.xml'
[Errno 2] No such file or directory: 'identify': 'identify'
17:35:44.394 INFO eynollah - Resizing and enhancing image...
17:35:44.395 INFO eynollah - Detected 230 DPI
17:35:44.506 INFO eynollah - Found 1 columns ([[9.9999988e-01 1.2977694e-07 1.8217089e-19 1.1470287e-18 2.0206059e-19
  2.6257076e-16]])
17:35:44.513 INFO eynollah - Image was enhanced.
17:35:44.519 INFO eynollah - Enhancing took 0.2s 
17:35:45.082 INFO eynollah - Image dimensions: 224x448
17:35:46.970 INFO eynollah - Image dimensions: 448x672
17:35:48.669 INFO eynollah - Image dimensions: 448x672
17:35:58.930 INFO eynollah - slope_deskew: 0.22727272727272663
17:36:33.567 INFO eynollah - detection of marginals took 0.2s
17:36:36.979 INFO eynollah - Image dimensions: 896x896
17:36:39.856 INFO eynollah - Image dimensions: 896x896
17:36:47.622 INFO eynollah - Job done in 63.3s
17:36:47.622 INFO eynollah.writer - output filename: './page_xml/sustainability_report/2020/ed8c9421412e74c2ad60da1f702dafa2__174456655/page63.xml'
[Errno 2] No such file or directory: 'identify': 'identify'
17:36:47.746 INFO eynollah - Resizing and enhancing image...
17:36:47.747 INFO eynollah - Detected 230 DPI
17:36:47.849 INFO eynollah - Found 1 columns ([[9.36765969e-01 4.50825573e-05 4.65917517e-04 2.67724935e-02
  1.00483385e-05 3.59404497e-02]])
17:36:47.858 INFO eynollah - Image was enhanced.
17:36:47.864 INFO eynollah - Enhancing took 0.2s 
17:36:48.451 INFO eynollah - Image dimensions: 224x448
17:36:50.220 INFO eynollah - Image dimensions: 448x672
17:36:51.875 INFO eynollah - Image dimensions: 448x672
17:37:03.023 INFO eynollah - slope_deskew: 90.68181818181819
17:37:38.752 INFO eynollah - detection of marginals took 0.2s
17:37:42.009 INFO eynollah - Image dimensions: 896x896
17:37:44.793 INFO eynollah - Image dimensions: 896x896
17:37:52.793 INFO eynollah - Job done in 65.2s
17:37:52.793 INFO eynollah.writer - output filename: './page_xml/sustainability_report/2020/ed8c9421412e74c2ad60da1f702dafa2__174456655/page11.xml'
[Errno 2] No such file or directory: 'identify': 'identify'
17:37:52.923 INFO eynollah - Resizing and enhancing image...
17:37:52.923 INFO eynollah - Detected 230 DPI
17:37:53.032 INFO eynollah - Found 2 columns ([[4.5354588e-12 1.0000000e+00 9.2473356e-21 2.6050010e-20 1.2868872e-18
  2.7973180e-20]])
17:37:53.038 INFO eynollah - Image was enhanced.
17:37:53.043 INFO eynollah - Enhancing took 0.2s 
17:37:53.646 INFO eynollah - Image dimensions: 224x448
17:37:56.177 INFO eynollah - Image dimensions: 448x672
17:37:58.556 INFO eynollah - Image dimensions: 448x672
17:38:09.662 INFO eynollah - slope_deskew: 0.22727272727272663
17:38:47.611 INFO eynollah - detection of marginals took 0.2s
17:38:50.928 INFO eynollah - Image dimensions: 896x896
17:38:53.035 INFO eynollah - Image dimensions: 896x896
17:39:04.130 INFO eynollah - Job done in 71.3s
17:39:04.131 INFO eynollah.writer - output filename: './page_xml/sustainability_report/2020/ed8c9421412e74c2ad60da1f702dafa2__174456655/page3.xml'
[Errno 2] No such file or directory: 'identify': 'identify'
17:39:04.256 INFO eynollah - Resizing and enhancing image...
17:39:04.256 INFO eynollah - Detected 230 DPI
17:39:04.357 INFO eynollah - Found 2 columns ([[9.8076407e-06 9.9999022e-01 6.2655035e-13 2.4978108e-11 6.4944949e-10
  5.6354559e-15]])
17:39:04.364 INFO eynollah - Image was enhanced.
17:39:04.370 INFO eynollah - Enhancing took 0.2s 
17:39:05.034 INFO eynollah - Image dimensions: 224x448
17:39:07.733 INFO eynollah - Image dimensions: 448x672
17:39:10.201 INFO eynollah - Image dimensions: 448x672
17:39:22.690 INFO eynollah - slope_deskew: 33.40909090909091
17:40:02.293 INFO eynollah - detection of marginals took 0.2s
17:40:05.281 INFO eynollah - Image dimensions: 896x896
17:40:07.485 INFO eynollah - Image dimensions: 896x896
17:40:17.665 INFO eynollah - Job done in 73.5s
17:40:17.666 INFO eynollah.writer - output filename: './page_xml/sustainability_report/2020/ed8c9421412e74c2ad60da1f702dafa2__174456655/page62.xml'
[Errno 2] No such file or directory: 'identify': 'identify'
17:40:17.791 INFO eynollah - Resizing and enhancing image...
17:40:17.791 INFO eynollah - Detected 230 DPI
17:40:17.896 INFO eynollah - Found 1 columns ([[1.0000000e+00 1.2721689e-14 1.5432566e-23 2.8695236e-22 5.5751865e-24
  2.9005479e-22]])
17:40:17.903 INFO eynollah - Image was enhanced.
17:40:17.908 INFO eynollah - Enhancing took 0.2s 
17:40:18.571 INFO eynollah - Image dimensions: 224x448
17:40:20.468 INFO eynollah - Image dimensions: 448x672
17:40:22.334 INFO eynollah - Image dimensions: 448x672
17:40:32.670 INFO eynollah - slope_deskew: -0.22727272727272663
17:41:12.817 INFO eynollah - detection of marginals took 0.2s
17:41:16.060 INFO eynollah - Image dimensions: 896x896
17:41:19.008 INFO eynollah - Image dimensions: 896x896
17:41:27.155 INFO eynollah - Job done in 69.5s
17:41:27.156 INFO eynollah.writer - output filename: './page_xml/sustainability_report/2020/ed8c9421412e74c2ad60da1f702dafa2__174456655/page59.xml'
[Errno 2] No such file or directory: 'identify': 'identify'
17:41:27.285 INFO eynollah - Resizing and enhancing image...
17:41:27.285 INFO eynollah - Detected 230 DPI
17:41:27.388 INFO eynollah - Found 1 columns ([[9.1651952e-01 7.7357300e-02 6.1220485e-03 1.4635415e-07 3.6491908e-08
  1.0714779e-06]])
17:41:27.395 INFO eynollah - Image was enhanced.
17:41:27.400 INFO eynollah - Enhancing took 0.2s 
17:41:28.085 INFO eynollah - Image dimensions: 224x448
17:41:30.108 INFO eynollah - Image dimensions: 448x672
17:41:31.964 INFO eynollah - Image dimensions: 448x672
17:41:42.410 INFO eynollah - slope_deskew: 0.22727272727272663
17:42:24.198 INFO eynollah - detection of marginals took 0.2s
17:42:27.480 INFO eynollah - Image dimensions: 896x896
17:42:30.336 INFO eynollah - Image dimensions: 896x896
17:42:38.635 INFO eynollah - Job done in 71.5s
17:42:38.636 INFO eynollah.writer - output filename: './page_xml/sustainability_report/2020/ed8c9421412e74c2ad60da1f702dafa2__174456655/page64.xml'
[Errno 2] No such file or directory: 'identify': 'identify'
17:42:38.761 INFO eynollah - Resizing and enhancing image...
17:42:38.761 INFO eynollah - Detected 230 DPI
17:42:38.870 INFO eynollah - Found 1 columns ([[1.0000000e+00 5.4450954e-08 1.9040921e-14 1.5524335e-14 2.4731620e-17
  1.8405318e-14]])
17:42:38.879 INFO eynollah - Image was enhanced.
17:42:38.884 INFO eynollah - Enhancing took 0.2s 
17:42:39.580 INFO eynollah - Image dimensions: 224x448
17:42:41.602 INFO eynollah - Image dimensions: 448x672
17:42:43.472 INFO eynollah - Image dimensions: 448x672
17:42:53.292 INFO eynollah - slope_deskew: 0.22727272727272663
17:43:35.945 INFO eynollah - detection of marginals took 0.2s
17:43:39.289 INFO eynollah - Image dimensions: 896x896
17:43:42.284 INFO eynollah - Image dimensions: 896x896
17:43:51.050 INFO eynollah - Job done in 72.4s
17:43:51.051 INFO eynollah.writer - output filename: './page_xml/sustainability_report/2020/ed8c9421412e74c2ad60da1f702dafa2__174456655/page7.xml'
[Errno 2] No such file or directory: 'identify': 'identify'
17:43:51.181 INFO eynollah - Resizing and enhancing image...
17:43:51.181 INFO eynollah - Detected 230 DPI
17:43:51.288 INFO eynollah - Found 2 columns ([[6.7446349e-06 9.9999321e-01 1.5826074e-21 1.1936957e-19 1.7129364e-22
  9.4692787e-20]])
17:43:51.296 INFO eynollah - Image was enhanced.
17:43:51.301 INFO eynollah - Enhancing took 0.2s 
17:43:52.031 INFO eynollah - Image dimensions: 224x448
17:43:54.823 INFO eynollah - Image dimensions: 448x672
17:43:57.462 INFO eynollah - Image dimensions: 448x672
17:44:08.676 INFO eynollah - slope_deskew: 0.22727272727272663
17:44:52.064 INFO eynollah - detection of marginals took 0.1s
17:44:55.271 INFO eynollah - Image dimensions: 896x896
17:44:57.471 INFO eynollah - Image dimensions: 896x896
17:45:09.898 INFO eynollah - Job done in 78.8s
17:45:09.898 INFO eynollah.writer - output filename: './page_xml/sustainability_report/2020/ed8c9421412e74c2ad60da1f702dafa2__174456655/page31.xml'
[Errno 2] No such file or directory: 'identify': 'identify'
17:45:10.029 INFO eynollah - Resizing and enhancing image...
17:45:10.030 INFO eynollah - Detected 230 DPI
17:45:10.161 INFO eynollah - Found 2 columns ([[1.2462350e-03 9.9875379e-01 1.0535631e-15 1.9107204e-15 9.0120409e-14
  4.8048621e-11]])
17:45:10.169 INFO eynollah - Image was enhanced.
17:45:10.174 INFO eynollah - Enhancing took 0.3s 
17:45:10.946 INFO eynollah - Image dimensions: 224x448
17:45:14.039 INFO eynollah - Image dimensions: 448x672
17:45:16.685 INFO eynollah - Image dimensions: 448x672
17:45:27.492 INFO eynollah - slope_deskew: 0.22727272727272663
17:46:12.853 INFO eynollah - detection of marginals took 0.2s
17:46:16.312 INFO eynollah - Image dimensions: 896x896
17:46:18.566 INFO eynollah - Image dimensions: 896x896
17:46:29.058 INFO eynollah - Job done in 79.2s
17:46:29.059 INFO eynollah.writer - output filename: './page_xml/sustainability_report/2020/ed8c9421412e74c2ad60da1f702dafa2__174456655/page12.xml'
[Errno 2] No such file or directory: 'identify': 'identify'
17:46:29.192 INFO eynollah - Resizing and enhancing image...
17:46:29.193 INFO eynollah - Detected 230 DPI
17:46:29.306 INFO eynollah - Found 1 columns ([[9.9098992e-01 8.4519759e-04 5.3344184e-04 7.6302164e-03 1.1421319e-06
  1.5900962e-07]])
17:46:29.314 INFO eynollah - Image was enhanced.
17:46:29.323 INFO eynollah - Enhancing took 0.3s 
17:46:30.088 INFO eynollah - Image dimensions: 224x448
17:46:32.235 INFO eynollah - Image dimensions: 448x672
17:46:34.268 INFO eynollah - Image dimensions: 448x672
17:46:44.769 INFO eynollah - slope_deskew: 0.22727272727272663
17:47:31.873 INFO eynollah - detection of marginals took 0.2s
17:47:35.470 INFO eynollah - Image dimensions: 896x896
17:47:38.544 INFO eynollah - Image dimensions: 896x896
17:47:46.865 INFO eynollah - Job done in 77.8s
17:47:46.865 INFO eynollah.writer - output filename: './page_xml/sustainability_report/2020/ed8c9421412e74c2ad60da1f702dafa2__174456655/page74.xml'
[Errno 2] No such file or directory: 'identify': 'identify'
17:47:46.996 INFO eynollah - Resizing and enhancing image...
17:47:46.997 INFO eynollah - Detected 230 DPI
17:47:47.112 INFO eynollah - Found 1 columns ([[5.2864259e-01 4.7135681e-01 2.6477535e-08 4.4270399e-07 1.0998244e-08
  1.2951223e-07]])
17:47:47.119 INFO eynollah - Image was enhanced.
17:47:47.124 INFO eynollah - Enhancing took 0.3s 
17:47:47.905 INFO eynollah - Image dimensions: 224x448
17:47:50.026 INFO eynollah - Image dimensions: 448x672
17:47:52.103 INFO eynollah - Image dimensions: 448x672
17:48:02.679 INFO eynollah - slope_deskew: -0.22727272727272663
17:48:50.552 INFO eynollah - detection of marginals took 0.2s
17:48:53.982 INFO eynollah - Image dimensions: 896x896
17:48:56.983 INFO eynollah - Image dimensions: 896x896
17:49:05.721 INFO eynollah - Job done in 78.9s
17:49:05.722 INFO eynollah.writer - output filename: './page_xml/sustainability_report/2020/ed8c9421412e74c2ad60da1f702dafa2__174456655/page47.xml'
[Errno 2] No such file or directory: 'identify': 'identify'
17:49:05.853 INFO eynollah - Resizing and enhancing image...
17:49:05.853 INFO eynollah - Detected 230 DPI
17:49:05.988 INFO eynollah - Found 2 columns ([[7.6000012e-02 9.2395031e-01 7.0659871e-07 4.8722104e-05 2.4176957e-08
  1.4622682e-07]])
17:49:05.997 INFO eynollah - Image was enhanced.
17:49:06.003 INFO eynollah - Enhancing took 0.3s 
17:49:06.835 INFO eynollah - Image dimensions: 224x448
17:49:10.045 INFO eynollah - Image dimensions: 448x672
17:49:12.873 INFO eynollah - Image dimensions: 448x672
17:49:24.162 INFO eynollah - slope_deskew: 0.22727272727272663
17:50:14.382 INFO eynollah - detection of marginals took 0.2s
17:50:17.908 INFO eynollah - Image dimensions: 896x896
17:50:20.219 INFO eynollah - Image dimensions: 896x896
17:50:31.639 INFO eynollah - Job done in 85.9s
17:50:31.639 INFO eynollah.writer - output filename: './page_xml/sustainability_report/2020/ed8c9421412e74c2ad60da1f702dafa2__174456655/page8.xml'
[Errno 2] No such file or directory: 'identify': 'identify'
17:50:31.783 INFO eynollah - Resizing and enhancing image...
17:50:31.783 INFO eynollah - Detected 230 DPI
17:50:31.898 INFO eynollah - Found 2 columns ([[8.7143868e-05 9.9986637e-01 8.0918295e-07 4.5673863e-05 7.9836700e-11
  5.7888422e-10]])
17:50:31.904 INFO eynollah - Image was enhanced.
17:50:31.909 INFO eynollah - Enhancing took 0.3s 
17:50:32.769 INFO eynollah - Image dimensions: 224x448
17:50:35.880 INFO eynollah - Image dimensions: 448x672
17:50:38.726 INFO eynollah - Image dimensions: 448x672
17:50:50.079 INFO eynollah - slope_deskew: -0.22727272727272663
17:51:41.755 INFO eynollah - detection of marginals took 0.2s
17:51:45.288 INFO eynollah - Image dimensions: 896x896
17:51:47.743 INFO eynollah - Image dimensions: 896x896
17:51:59.028 INFO eynollah - Job done in 87.4s
17:51:59.028 INFO eynollah.writer - output filename: './page_xml/sustainability_report/2020/ed8c9421412e74c2ad60da1f702dafa2__174456655/page56.xml'
[Errno 2] No such file or directory: 'identify': 'identify'
17:51:59.168 INFO eynollah - Resizing and enhancing image...
17:51:59.168 INFO eynollah - Detected 230 DPI
17:51:59.289 INFO eynollah - Found 4 columns ([[5.68567120e-05 1.11779338e-03 4.58855592e-10 9.98825252e-01
  1.03730954e-07 2.76266010e-09]])
17:51:59.313 INFO eynollah - Image was enhanced.
17:51:59.334 INFO eynollah - Enhancing took 0.3s 
17:52:00.209 INFO eynollah - Image dimensions: 224x448
17:52:06.558 INFO eynollah - Image dimensions: 448x672
17:52:11.737 INFO eynollah - Image dimensions: 448x672
17:52:42.828 INFO eynollah - slope_deskew: -0.22727272727272663
17:53:37.718 INFO eynollah - detection of marginals took 0.0s
17:53:46.263 INFO eynollah - Image dimensions: 896x896
17:53:49.078 INFO eynollah - Image dimensions: 896x896
17:54:13.775 ERROR eynollah - index 8 is out of bounds for axis 0 with size 8
17:54:14.216 INFO eynollah - Job done in 135.2s
17:54:14.216 INFO eynollah.writer - output filename: './page_xml/sustainability_report/2020/ed8c9421412e74c2ad60da1f702dafa2__174456655/page66.xml'
[Errno 2] No such file or directory: 'identify': 'identify'
17:54:14.361 INFO eynollah - Resizing and enhancing image...
17:54:14.361 INFO eynollah - Detected 230 DPI
17:54:14.481 INFO eynollah - Found 1 columns ([[1.0000000e+00 7.9131202e-10 4.3179337e-21 7.0015629e-21 8.6972561e-19
  4.6513189e-16]])
17:54:14.491 INFO eynollah - Image was enhanced.
17:54:14.497 INFO eynollah - Enhancing took 0.3s 
17:54:15.382 INFO eynollah - Image dimensions: 224x448
17:54:17.776 INFO eynollah - Image dimensions: 448x672
17:54:20.066 INFO eynollah - Image dimensions: 448x672
17:54:30.048 INFO eynollah - slope_deskew: 0.22727272727272663
17:55:23.608 INFO eynollah - detection of marginals took 0.2s
17:55:27.143 INFO eynollah - Image dimensions: 896x896
17:55:30.352 INFO eynollah - Image dimensions: 896x896
17:55:40.252 INFO eynollah - Job done in 86.0s
17:55:40.253 INFO eynollah.writer - output filename: './page_xml/sustainability_report/2020/ed8c9421412e74c2ad60da1f702dafa2__174456655/page32.xml'
[Errno 2] No such file or directory: 'identify': 'identify'
17:55:40.386 INFO eynollah - Resizing and enhancing image...
17:55:40.386 INFO eynollah - Detected 230 DPI
17:55:40.508 INFO eynollah - Found 1 columns ([[9.98961449e-01 1.03860244e-03 7.20132883e-13 3.84316907e-14
  1.03801373e-17 1.37641685e-14]])
17:55:40.518 INFO eynollah - Image was enhanced.
17:55:40.523 INFO eynollah - Enhancing took 0.3s 
17:55:41.416 INFO eynollah - Image dimensions: 224x448
17:55:43.894 INFO eynollah - Image dimensions: 448x672
17:55:46.185 INFO eynollah - Image dimensions: 448x672
17:55:56.727 INFO eynollah - slope_deskew: 0.22727272727272663
17:56:57.395 INFO eynollah - detection of marginals took 0.2s
17:57:00.892 INFO eynollah - Image dimensions: 896x896
17:57:04.053 INFO eynollah - Image dimensions: 896x896
17:57:11.800 INFO eynollah - Job done in 91.5s
17:57:11.801 INFO eynollah.writer - output filename: './page_xml/sustainability_report/2020/ed8c9421412e74c2ad60da1f702dafa2__174456655/page71.xml'
[Errno 2] No such file or directory: 'identify': 'identify'
17:57:11.939 INFO eynollah - Resizing and enhancing image...
17:57:11.939 INFO eynollah - Detected 230 DPI
17:57:12.064 INFO eynollah - Found 2 columns ([[4.1942412e-14 1.0000000e+00 1.9817858e-22 8.2292565e-24 3.4146444e-22
  1.0321113e-19]])
17:57:12.074 INFO eynollah - Image was enhanced.
17:57:12.079 INFO eynollah - Enhancing took 0.3s 
17:57:13.037 INFO eynollah - Image dimensions: 224x448
17:57:16.328 INFO eynollah - Image dimensions: 448x672
17:57:19.378 INFO eynollah - Image dimensions: 448x672
17:57:30.469 INFO eynollah - slope_deskew: -0.22727272727272663
17:58:26.865 INFO eynollah - detection of marginals took 0.2s
17:58:30.563 INFO eynollah - Image dimensions: 896x896
17:58:33.101 INFO eynollah - Image dimensions: 896x896
17:58:45.344 INFO eynollah - Job done in 93.5s
17:58:45.345 INFO eynollah.writer - output filename: './page_xml/sustainability_report/2020/ed8c9421412e74c2ad60da1f702dafa2__174456655/page17.xml'
[Errno 2] No such file or directory: 'identify': 'identify'
17:58:45.482 INFO eynollah - Resizing and enhancing image...
17:58:45.482 INFO eynollah - Detected 230 DPI
17:58:45.608 INFO eynollah - Found 2 columns ([[3.4554201e-01 6.4518327e-01 7.2022890e-09 2.8826059e-06 3.8390746e-07
  9.2713786e-03]])
17:58:45.615 INFO eynollah - Image was enhanced.
17:58:45.620 INFO eynollah - Enhancing took 0.3s 
17:58:46.591 INFO eynollah - Image dimensions: 224x448
17:58:49.997 INFO eynollah - Image dimensions: 448x672
17:58:53.049 INFO eynollah - Image dimensions: 448x672
17:59:04.171 INFO eynollah - slope_deskew: -8.40909090909091
18:00:02.593 INFO eynollah - detection of marginals took 0.2s
18:00:06.444 INFO eynollah - Image dimensions: 896x896
18:00:09.130 INFO eynollah - Image dimensions: 896x896
18:00:21.897 INFO eynollah - Job done in 96.5s
18:00:21.897 INFO eynollah.writer - output filename: './page_xml/sustainability_report/2020/ed8c9421412e74c2ad60da1f702dafa2__174456655/page25.xml'
[Errno 2] No such file or directory: 'identify': 'identify'
18:00:22.040 INFO eynollah - Resizing and enhancing image...
18:00:22.040 INFO eynollah - Detected 230 DPI
18:00:22.173 INFO eynollah - Found 2 columns ([[6.3049205e-02 9.3692261e-01 2.6634392e-08 3.3268186e-09 1.6232895e-09
  2.8214910e-05]])
18:00:22.183 INFO eynollah - Image was enhanced.
18:00:22.189 INFO eynollah - Enhancing took 0.3s 
18:00:23.201 INFO eynollah - Image dimensions: 224x448
18:00:26.646 INFO eynollah - Image dimensions: 448x672
18:00:29.787 INFO eynollah - Image dimensions: 448x672
18:00:41.327 INFO eynollah - slope_deskew: 0.22727272727272663
18:01:41.421 INFO eynollah - detection of marginals took 0.2s
18:01:45.340 INFO eynollah - Image dimensions: 896x896
18:01:47.978 INFO eynollah - Image dimensions: 896x896
18:02:01.805 INFO eynollah - Job done in 99.9s
18:02:01.806 INFO eynollah.writer - output filename: './page_xml/sustainability_report/2020/ed8c9421412e74c2ad60da1f702dafa2__174456655/page55.xml'
[Errno 2] No such file or directory: 'identify': 'identify'
18:02:01.961 INFO eynollah - Resizing and enhancing image...
18:02:01.962 INFO eynollah - Detected 230 DPI
18:02:02.100 INFO eynollah - Found 1 columns ([[9.9999738e-01 2.5688335e-06 7.4584470e-15 3.8716059e-15 4.9351511e-15
  3.1203092e-13]])
18:02:02.111 INFO eynollah - Image was enhanced.
18:02:02.117 INFO eynollah - Enhancing took 0.3s 
18:02:03.200 INFO eynollah - Image dimensions: 224x448
18:02:05.928 INFO eynollah - Image dimensions: 448x672
18:02:08.525 INFO eynollah - Image dimensions: 448x672
18:02:19.475 INFO eynollah - slope_deskew: 0.22727272727272663
18:03:21.299 INFO eynollah - detection of marginals took 0.2s
18:03:24.944 INFO eynollah - Image dimensions: 896x896
18:03:28.280 INFO eynollah - Image dimensions: 896x896
18:03:38.619 INFO eynollah - Job done in 96.8s
18:03:38.619 INFO eynollah.writer - output filename: './page_xml/sustainability_report/2020/ed8c9421412e74c2ad60da1f702dafa2__174456655/page54.xml'
[Errno 2] No such file or directory: 'identify': 'identify'
18:03:38.767 INFO eynollah - Resizing and enhancing image...
18:03:38.767 INFO eynollah - Detected 230 DPI
18:03:38.906 INFO eynollah - Found 2 columns ([[8.510065e-06 9.999610e-01 5.524491e-08 3.035140e-05 8.794814e-09
  6.137044e-08]])
18:03:38.912 INFO eynollah - Image was enhanced.
18:03:38.918 INFO eynollah - Enhancing took 0.3s 
18:03:39.996 INFO eynollah - Image dimensions: 224x448
18:03:43.600 INFO eynollah - Image dimensions: 448x672
18:03:46.819 INFO eynollah - Image dimensions: 448x672
18:03:58.473 INFO eynollah - slope_deskew: 0.22727272727272663
18:05:00.928 INFO eynollah - detection of marginals took 0.2s
18:05:04.798 INFO eynollah - Image dimensions: 896x896
18:05:07.446 INFO eynollah - Image dimensions: 896x896
18:05:21.463 INFO eynollah - Job done in 102.8s
18:05:21.463 INFO eynollah.writer - output filename: './page_xml/sustainability_report/2020/ed8c9421412e74c2ad60da1f702dafa2__174456655/page58.xml'
[Errno 2] No such file or directory: 'identify': 'identify'
18:05:21.615 INFO eynollah - Resizing and enhancing image...
18:05:21.615 INFO eynollah - Detected 230 DPI
18:05:21.748 INFO eynollah - Found 2 columns ([[2.4525495e-03 9.9754745e-01 1.5853483e-13 1.5544596e-13 2.5738819e-14
  2.6027101e-12]])
18:05:21.762 INFO eynollah - Image was enhanced.
18:05:21.767 INFO eynollah - Enhancing took 0.3s 
18:05:22.813 INFO eynollah - Image dimensions: 224x448
18:05:26.399 INFO eynollah - Image dimensions: 448x672
18:05:29.728 INFO eynollah - Image dimensions: 448x672
18:05:41.498 INFO eynollah - slope_deskew: -0.22727272727272663
18:06:44.690 INFO eynollah - detection of marginals took 0.2s
18:06:48.522 INFO eynollah - Image dimensions: 896x896
18:06:51.199 INFO eynollah - Image dimensions: 896x896
18:07:04.526 INFO eynollah - Job done in 103.1s
18:07:04.527 INFO eynollah.writer - output filename: './page_xml/sustainability_report/2020/ed8c9421412e74c2ad60da1f702dafa2__174456655/page51.xml'
[Errno 2] No such file or directory: 'identify': 'identify'
18:07:04.678 INFO eynollah - Resizing and enhancing image...
18:07:04.678 INFO eynollah - Detected 230 DPI
18:07:04.818 INFO eynollah - Found 2 columns ([[6.9712265e-04 9.9930286e-01 3.5636527e-13 2.0413872e-11 1.5612523e-12
  1.5327095e-11]])
18:07:04.824 INFO eynollah - Image was enhanced.
18:07:04.830 INFO eynollah - Enhancing took 0.3s 
18:07:05.931 INFO eynollah - Image dimensions: 224x448
18:07:09.646 INFO eynollah - Image dimensions: 448x672
18:07:12.964 INFO eynollah - Image dimensions: 448x672
18:07:24.695 INFO eynollah - slope_deskew: 0.22727272727272663
18:08:29.768 INFO eynollah - detection of marginals took 0.2s
18:08:33.513 INFO eynollah - Image dimensions: 896x896
18:08:36.225 INFO eynollah - Image dimensions: 896x896
18:08:50.915 INFO eynollah - Job done in 106.4s
18:08:50.915 INFO eynollah.writer - output filename: './page_xml/sustainability_report/2020/ed8c9421412e74c2ad60da1f702dafa2__174456655/page37.xml'
[Errno 2] No such file or directory: 'identify': 'identify'
18:08:51.067 INFO eynollah - Resizing and enhancing image...
18:08:51.068 INFO eynollah - Detected 230 DPI
18:08:51.214 INFO eynollah - Found 2 columns ([[3.9930819e-03 9.9600691e-01 6.7124854e-15 5.5872969e-19 7.7624076e-18
  3.6332231e-14]])
18:08:51.225 INFO eynollah - Image was enhanced.
18:08:51.231 INFO eynollah - Enhancing took 0.3s 
18:08:52.329 INFO eynollah - Image dimensions: 224x448
18:08:56.042 INFO eynollah - Image dimensions: 448x672
18:08:59.439 INFO eynollah - Image dimensions: 448x672
18:09:11.275 INFO eynollah - slope_deskew: -0.22727272727272663
18:10:18.229 INFO eynollah - detection of marginals took 0.2s
18:10:22.078 INFO eynollah - Image dimensions: 896x896
Traceback (most recent call last):
  File "/home/ubuntu/layout_detection/venv/bin/eynollah", line 33, in <module>
    sys.exit(load_entry_point('eynollah', 'console_scripts', 'eynollah')())
  File "/home/ubuntu/layout_detection/venv/lib/python3.7/site-packages/click/core.py", line 1128, in __call__
    return self.main(*args, **kwargs)
  File "/home/ubuntu/layout_detection/venv/lib/python3.7/site-packages/click/core.py", line 1053, in main
    rv = self.invoke(ctx)
  File "/home/ubuntu/layout_detection/venv/lib/python3.7/site-packages/click/core.py", line 1395, in invoke
    return ctx.invoke(self.callback, **ctx.params)
  File "/home/ubuntu/layout_detection/venv/lib/python3.7/site-packages/click/core.py", line 754, in invoke
    return __callback(*args, **kwargs)
  File "/home/ubuntu/layout_detection/eynollah/qurator/eynollah/cli.py", line 181, in main
    eynollah.run()
  File "/home/ubuntu/layout_detection/eynollah/qurator/eynollah/eynollah.py", line 2929, in run
    polygons_of_images, img_revised_tab, text_regions_p_1_n, textline_mask_tot_d, regions_without_separators_d, regions_fully, regions_without_separators, polygons_of_marginals, contours_tables = self.run_boxes_full_layout(image_page, textline_mask_tot, text_regions_p, slope_deskew, num_col_classifier, img_only_regions, table_prediction, erosion_hurts)
  File "/home/ubuntu/layout_detection/eynollah/qurator/eynollah/eynollah.py", line 2798, in run_boxes_full_layout
    regions_fully, regions_fully_only_drop = self.extract_text_regions(image_page, True, cols=num_col_classifier)
  File "/home/ubuntu/layout_detection/eynollah/qurator/eynollah/eynollah.py", line 1017, in extract_text_regions
    prediction_regions2 = self.do_prediction(patches, img2, model_region, marginal_of_patch_percent)
  File "/home/ubuntu/layout_detection/eynollah/qurator/eynollah/eynollah.py", line 674, in do_prediction
    label_p_pred = model.predict(img_patch.reshape(1, img_patch.shape[0], img_patch.shape[1], img_patch.shape[2]))
  File "/home/ubuntu/layout_detection/venv/lib/python3.7/site-packages/keras/engine/training.py", line 1462, in predict
    callbacks=callbacks)
  File "/home/ubuntu/layout_detection/venv/lib/python3.7/site-packages/keras/engine/training_arrays.py", line 324, in predict_loop
    batch_outs = f(ins_batch)
  File "/home/ubuntu/layout_detection/venv/lib/python3.7/site-packages/tensorflow_core/python/keras/backend.py", line 3476, in __call__
    run_metadata=self.run_metadata)
  File "/home/ubuntu/layout_detection/venv/lib/python3.7/site-packages/tensorflow_core/python/client/session.py", line 1472, in __call__
    run_metadata_ptr)
tensorflow.python.framework.errors_impl.ResourceExhaustedError: 2 root error(s) found.
  (0) Resource exhausted: OOM when allocating tensor with shape[1,896,896,67] and type float on /job:localhost/replica:0/task:0/device:GPU:0 by allocator GPU_0_bfc
     [[{{node concatenate_5_5/concat}}]]
Hint: If you want to see a list of allocated tensors when OOM happens, add report_tensor_allocations_upon_oom to RunOptions for current allocation info.

     [[activation_56_5/truediv/_17093]]
Hint: If you want to see a list of allocated tensors when OOM happens, add report_tensor_allocations_upon_oom to RunOptions for current allocation info.

  (1) Resource exhausted: OOM when allocating tensor with shape[1,896,896,67] and type float on /job:localhost/replica:0/task:0/device:GPU:0 by allocator GPU_0_bfc
     [[{{node concatenate_5_5/concat}}]]
Hint: If you want to see a list of allocated tensors when OOM happens, add report_tensor_allocations_upon_oom to RunOptions for current allocation info.

0 successful operations.
0 derived errors ignored.
qurator-spk / eynollah

Eynollah process is crashing and exiting with -di flag #80
