Gusb3ll / Tsuki

Manga uncensoring scripts using DeepCreamPy & HentAI combined with custom scripts
MIT License
89 stars 9 forks source link

hent-AI bar_detect, DeepCreamPydecensor and memory error *SOLVED* #9

Open Heli0saurus opened 1 year ago

Heli0saurus commented 1 year ago

Howdy, while trying to run the script, I get this traceback for hent-AI detection and eventually a memory error with DCP.

Running CUDA 11.5 and Python 3.9.7 as suggested and the latest cuDNN. (Here's the problem! 8.7 does not work, for those having this issue, use the specific version of CUDA, Python, and cuDNN detailed in README.md! Figured this out after a test I wanted to try before posting this.)

Traceback (most recent call last): File "D:\Decensoring\Tsuki1.2\Modules\HentAI\main.py", line 76, in bar_detect() File "D:\Decensoring\Tsuki1.2\Modules\HentAI\main.py", line 72, in bar_detect hentAI_detection(dcp_dir=d_entry, in_path=o_entry, is_mosaic=False, is_video=False, force_jpg=True, dilation=int(dil_entry)) File "D:\Decensoring\Tsuki1.2\Modules\HentAI\main.py", line 63, in hentAI_detection detect_instance.run_on_folder(input_folder=in_path, output_folder=dcp_dir + '/', is_video=False, is_mosaic=is_mosaic, dilation=dilation) File "D:\Decensoring\Tsuki1.2\Modules\HentAI\detector.py", line 573, in run_on_folder self.detect_and_cover(img_path, img_name, output_folder, is_mosaic=is_mosaic, dilation=dilation) #sending force_jpg for debugging File "D:\Decensoring\Tsuki1.2\Modules\HentAI\detector.py", line 519, in detect_and_cover cov, mask = self.apply_cover(image, new_masks, dilation) File "D:\Decensoring\Tsuki1.2\Modules\HentAI\detector.py", line 120, in apply_cover green = np.zeros([image.shape[0], image.shape[1], image.shape[2]], dtype=np.uint8) numpy.core._exceptions.MemoryError: Unable to allocate 74.7 MiB for an array with shape (6072, 4300, 3) and data type uint8 A duplicate file name exists, or the file cannot be found. D:\Decensoring\Tsuki1.2\Modules\HentAI\input*, Are you sure (Y/N)? y ←[90m[10:38:55AM] ←[36m----- DeepCreamPy modified by Gusbell -----←[0m D:\Decensoring\Tsuki1.2\Modules\env\lib\site-packages\tensorflow\python\keras\engine\base_layer_v1.py:1694: UserWarning: layer.apply is deprecated and will be removed in a future version. Please use layer.__call__ method instead. warnings.warn('layer.apply is deprecated and ' Traceback (most recent call last): File "D:\Decensoring\Tsuki1.2\Modules\DeepCreamPy\decensor.py", line 156, in decensor = Decensor() File "D:\Decensoring\Tsuki1.2\Modules\DeepCreamPy\decensor.py", line 22, in init self.load_model() File "D:\Decensoring\Tsuki1.2\Modules\DeepCreamPy\decensor.py", line 31, in load_model self.model = InpaintNN(bar_model_name="./models/bar/Train_775000.meta", bar_checkpoint_name="./models/bar/", mosaic_model_name="./models/mosaic/Train_290000.meta", mosaic_checkpoint_name="./models/mosaic/", is_mosaic=self.is_mosaic) File "D:\Decensoring\Tsuki1.2\Modules\DeepCreamPy\model.py", line 22, in init self.build_model() File "D:\Decensoring\Tsuki1.2\Modules\DeepCreamPy\model.py", line 89, in build_model Restore.restore(self.sess, tf.train.latest_checkpoint(self.bar_checkpoint_name)) File "D:\Decensoring\Tsuki1.2\Modules\env\lib\site-packages\tensorflow\python\training\saver.py", line 1400, in restore sess.run(self.saver_def.restore_op_name, File "D:\Decensoring\Tsuki1.2\Modules\env\lib\site-packages\tensorflow\python\client\session.py", line 967, in run result = self._run(None, fetches, feed_dict, options_ptr, File "D:\Decensoring\Tsuki1.2\Modules\env\lib\site-packages\tensorflow\python\client\session.py", line 1190, in _run results = self._do_run(handle, final_targets, final_fetches, File "D:\Decensoring\Tsuki1.2\Modules\env\lib\site-packages\tensorflow\python\client\session.py", line 1370, in _do_run return self._do_call(_run_fn, feeds, fetches, targets, options, File "D:\Decensoring\Tsuki1.2\Modules\env\lib\site-packages\tensorflow\python\client\session.py", line 1377, in _do_call return fn(args) File "D:\Decensoring\Tsuki1.2\Modules\env\lib\site-packages\tensorflow\python\client\session.py", line 1359, in _run_fn self._extend_graph() File "D:\Decensoring\Tsuki1.2\Modules\env\lib\site-packages\tensorflow\python\client\session.py", line 1400, in _extend_graph tf_session.ExtendSession(self._session) MemoryError: bad allocation A duplicate file name exists, or the file cannot be found. D:\Decensoring\Tsuki1.2\modules\DeepCreamPy\decensor_input\, Are you sure (Y/N)? y

DECENSORING COMPETED, ENJOY!