ThanhBarTN commented 4 years ago

Hi, @GantMan @jessetrana @txyugood @TechnikEmpire @sickerin I'm a college student and I'm studying your project. I want to train my own model with only 2 classes, I placed 2 folders of images (which represent for 2 classes images) in project's image directory but training scripts fail to separate train/test/validation folder from my 2 images folders. How can I fix this?? Thank you.

TechnikEmpire commented 4 years ago

Are you using the tensorflow 1.x scripts or tensorflow 2.x?

ThanhBarTN commented 4 years ago

Are you using the tensorflow 1.x scripts or tensorflow 2.x?

I'm using tensorflow 2.x

TechnikEmpire commented 4 years ago

Are you manually creating train and validation directories? Cause you shouldn't be.

You just do:

Images/class_a/*.jpg Images/class_b/*.jpg Etc.

The script automatically discovers all images in the class dies and splits them into train/value sets.

ThanhBarTN commented 4 years ago

I do exactly as you describe, here is my picture

TechnikEmpire commented 4 years ago

Hmm. Can you provide some error message/the training script output?

ThanhBarTN commented 4 years ago

this is the message when I run train_initialization.py

TechnikEmpire commented 4 years ago

You're running the tensorflow 1.x scripts, which I dont believe support what you're doing. I didn't write them. I wrote the v2 scripts (well, imported from tfhub and heavily modified).

ThanhBarTN commented 4 years ago

You're running the tensorflow 1.x scripts, which I dont believe support what you're doing. I didn't write them. I wrote the v2 scripts (well, imported from tfhub and heavily modified).

So if I run v2 scripts everything will be fine ?

TechnikEmpire commented 4 years ago

It should be. You have to use tensorflow hub modules and supply one. Example usage is shown in the training scripts

ThanhBarTN commented 4 years ago

@GantMan Can you help me with this issue from v1 scripts, please ?

ThanhBarTN commented 4 years ago

It should be. You have to use tensorflow hub modules and supply one. Example usage is shown in the training scripts

Can you send me v2 scripts please, 'cause I can't find it in repo, the lastest version is 1.2.0

TechnikEmpire commented 4 years ago

@ThanhBarTN

https://github.com/GantMan/nsfw_model/blob/master/training/train_all_models.cmd

ThanhBarTN commented 4 years ago

@ThanhBarTN

https://github.com/GantMan/nsfw_model/blob/master/training/train_all_models.cmd

Thank you so much

ThanhBarTN commented 4 years ago

@ThanhBarTN

https://github.com/GantMan/nsfw_model/blob/master/training/train_all_models.cmd

Hi @TechnikEmpire , During training I got this error. What is happening here, can you help me

D:\WORKING\Human_detection\Deep_learning-ver\nsfw_porn_detection\nsfw_model-1.1.0\nsfw_model-1.1.0>python ./training/make_nsfw_model.py --image_dir ./images --image_size 224 --saved_model_dir ./trained_models\inception_v3_224 --labels_output_file ./trained_models\inception_v3_224\class_labels.txt --tfhub_module https://tfhub.dev/google/imagenet/inception_v3/classification/4 --tflite_output_file ./trained_models\inception_v3_224\saved_model.tflite --train_epochs 5 --batch_size 16 --do_fine_tuning --learning_rate 0.001 --dropout_rate 0.0 --momentum 0.9 2020-07-09 16:57:18.281214: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library cudart64_101.dll 2020-07-09 16:57:20.214903: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library nvcuda.dll 2020-07-09 16:57:20.233523: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:01:00.0 name: GeForce GTX 1060 computeCapability: 6.1 coreClock: 1.6705GHz coreCount: 10 deviceMemorySize: 6.00GiB deviceMemoryBandwidth: 178.99GiB/s 2020-07-09 16:57:20.234402: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library cudart64_101.dll 2020-07-09 16:57:20.242986: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library cublas64_10.dll 2020-07-09 16:57:20.248537: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library cufft64_10.dll 2020-07-09 16:57:20.252402: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library curand64_10.dll 2020-07-09 16:57:20.260060: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library cusolver64_10.dll 2020-07-09 16:57:20.265988: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library cusparse64_10.dll 2020-07-09 16:57:20.279981: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library cudnn64_7.dll 2020-07-09 16:57:20.281667: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 Configured device I0709 16:57:20.285259 868 resolver.py:79] Using C:\Users\AI2\AppData\Local\Temp\tfhub_modules to cache modules. 2020-07-09 16:57:20.487066: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 2020-07-09 16:57:20.497810: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x1dcad69f220 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2020-07-09 16:57:20.501339: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2020-07-09 16:57:20.502333: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:01:00.0 name: GeForce GTX 1060 computeCapability: 6.1 coreClock: 1.6705GHz coreCount: 10 deviceMemorySize: 6.00GiB deviceMemoryBandwidth: 178.99GiB/s 2020-07-09 16:57:20.511243: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library cudart64_101.dll 2020-07-09 16:57:20.519179: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library cublas64_10.dll 2020-07-09 16:57:20.527671: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library cufft64_10.dll 2020-07-09 16:57:20.528036: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library curand64_10.dll 2020-07-09 16:57:20.528415: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library cusolver64_10.dll 2020-07-09 16:57:20.528771: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library cusparse64_10.dll 2020-07-09 16:57:20.529177: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library cudnn64_7.dll 2020-07-09 16:57:20.529645: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2020-07-09 16:57:21.038787: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2020-07-09 16:57:21.039172: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2020-07-09 16:57:21.039499: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2020-07-09 16:57:21.039890: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 4831 MB memory) -> physical GPU (device: 0, name: GeForce GTX 1060, pci bus id: 0000:01:00.0, compute capability: 6.1) 2020-07-09 16:57:21.043002: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x1dcca6bab50 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2020-07-09 16:57:21.047640: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): GeForce GTX 1060, Compute Capability 6.1 Using module https://tfhub.dev/google/imagenet/inception_v3/classification/4 with image size (224, 224) Found 25092 images belonging to 2 classes. Found 100373 images belonging to 2 classes. Found 2 classes: neutral, porn Model: "sequential"

Layer (type) Output Shape Param #

keras_layer (KerasLayer) (None, 1001) 23853833

dropout (Dropout) (None, 1001) 0

dense (Dense) (None, 2) 2004

prediction (Activation) (None, 2) 0

Total params: 23,855,837 Trainable params: 23,821,405 Non-trainable params: 34,432

None Epoch 1/5 2020-07-09 16:57:34.183042: W tensorflow/core/common_runtime/shape_refiner.cc:88] Function instantiation has undefined input shape at index: 728 in the outer inference context. 2020-07-09 16:57:34.183503: W tensorflow/core/common_runtime/shape_refiner.cc:88] Function instantiation has undefined input shape at index: 697 in the outer inference context. 2020-07-09 16:57:34.184083: W tensorflow/core/common_runtime/shape_refiner.cc:88] Function instantiation has undefined input shape at index: 683 in the outer inference context. 2020-07-09 16:57:34.184463: W tensorflow/core/common_runtime/shape_refiner.cc:88] Function instantiation has undefined input shape at index: 827 in the outer inference context. 2020-07-09 16:57:34.189984: W tensorflow/core/common_runtime/shape_refiner.cc:88] Function instantiation has undefined input shape at index: 718 in the outer inference context. 2020-07-09 16:57:34.190654: W tensorflow/core/common_runtime/shape_refiner.cc:88] Function instantiation has undefined input shape at index: 580 in the outer inference context. 2020-07-09 16:57:34.191191: W tensorflow/core/common_runtime/shape_refiner.cc:88] Function instantiation has undefined input shape at index: 532 in the outer inference context. 2020-07-09 16:57:34.191591: W tensorflow/core/common_runtime/shape_refiner.cc:88] Function instantiation has undefined input shape at index: 711 in the outer inference context. 2020-07-09 16:57:34.191985: W tensorflow/core/common_runtime/shape_refiner.cc:88] Function instantiation has undefined input shape at index: 663 in the outer inference context. 2020-07-09 16:57:34.193864: W tensorflow/core/common_runtime/shape_refiner.cc:88] Function instantiation has undefined input shape at index: 624 in the outer inference context. 2020-07-09 16:57:34.194196: W tensorflow/core/common_runtime/shape_refiner.cc:88] Function instantiation has undefined input shape at index: 523 in the outer inference context. 2020-07-09 16:57:34.194432: W tensorflow/core/common_runtime/shape_refiner.cc:88] Function instantiation has undefined input shape at index: 506 in the outer inference context. 2020-07-09 16:57:34.203634: W tensorflow/core/common_runtime/shape_refiner.cc:88] Function instantiation has undefined input shape at index: 545 in the outer inference context. 2020-07-09 16:57:34.212039: W tensorflow/core/common_runtime/shape_refiner.cc:88] Function instantiation has undefined input shape at index: 467 in the outer inference context. 2020-07-09 16:57:34.212622: W tensorflow/core/common_runtime/shape_refiner.cc:88] Function instantiation has undefined input shape at index: 453 in the outer inference context. 2020-07-09 16:57:34.213166: W tensorflow/core/common_runtime/shape_refiner.cc:88] Function instantiation has undefined input shape at index: 421 in the outer inference context. 2020-07-09 16:57:34.213571: W tensorflow/core/common_runtime/shape_refiner.cc:88] Function instantiation has undefined input shape at index: 755 in the outer inference context. 2020-07-09 16:57:34.213943: W tensorflow/core/common_runtime/shape_refiner.cc:88] Function instantiation has undefined input shape at index: 748 in the outer inference context. 2020-07-09 16:57:34.215115: W tensorflow/core/common_runtime/shape_refiner.cc:88] Function instantiation has undefined input shape at index: 741 in the outer inference context. 2020-07-09 16:57:34.215430: W tensorflow/core/common_runtime/shape_refiner.cc:88] Function instantiation has undefined input shape at index: 513 in the outer inference context. 2020-07-09 16:57:34.215704: W tensorflow/core/common_runtime/shape_refiner.cc:88] Function instantiation has undefined input shape at index: 488 in the outer inference context. 2020-07-09 16:57:34.216038: W tensorflow/core/common_runtime/shape_refiner.cc:88] Function instantiation has undefined input shape at index: 460 in the outer inference context. 2020-07-09 16:57:34.216485: W tensorflow/core/common_runtime/shape_refiner.cc:88] Function instantiation has undefined input shape at index: 414 in the outer inference context. 2020-07-09 16:57:34.216802: W tensorflow/core/common_runtime/shape_refiner.cc:88] Function instantiation has undefined input shape at index: 559 in the outer inference context. 2020-07-09 16:57:34.217067: W tensorflow/core/common_runtime/shape_refiner.cc:88] Function instantiation has undefined input shape at index: 552 in the outer inference context. 2020-07-09 16:57:34.217355: W tensorflow/core/common_runtime/shape_refiner.cc:88] Function instantiation has undefined input shape at index: 495 in the outer inference context. 2020-07-09 16:57:34.218765: W tensorflow/core/common_runtime/shape_refiner.cc:88] Function instantiation has undefined input shape at index: 474 in the outer inference context. 2020-07-09 16:57:34.219206: W tensorflow/core/common_runtime/shape_refiner.cc:88] Function instantiation has undefined input shape at index: 131 in the outer inference context. 2020-07-09 16:57:34.219527: W tensorflow/core/common_runtime/shape_refiner.cc:88] Function instantiation has undefined input shape at index: 654 in the outer inference context. 2020-07-09 16:57:34.229019: W tensorflow/core/common_runtime/shape_refiner.cc:88] Function instantiation has undefined input shape at index: 566 in the outer inference context. 2020-07-09 16:57:34.229652: W tensorflow/core/common_runtime/shape_refiner.cc:88] Function instantiation has undefined input shape at index: 152 in the outer inference context. 2020-07-09 16:57:34.230206: W tensorflow/core/common_runtime/shape_refiner.cc:88] Function instantiation has undefined input shape at index: 145 in the outer inference context. 2020-07-09 16:57:34.230648: W tensorflow/core/common_runtime/shape_refiner.cc:88] Function instantiation has undefined input shape at index: 102 in the outer inference context. 2020-07-09 16:57:34.231087: W tensorflow/core/common_runtime/shape_refiner.cc:88] Function instantiation has undefined input shape at index: 637 in the outer inference context. 2020-07-09 16:57:34.231559: W tensorflow/core/common_runtime/shape_refiner.cc:88] Function instantiation has undefined input shape at index: 615 in the outer inference context. 2020-07-09 16:57:34.231852: W tensorflow/core/common_runtime/shape_refiner.cc:88] Function instantiation has undefined input shape at index: 598 in the outer inference context. 2020-07-09 16:57:34.232146: W tensorflow/core/common_runtime/shape_refiner.cc:88] Function instantiation has undefined input shape at index: 138 in the outer inference context. 2020-07-09 16:57:34.232443: W tensorflow/core/common_runtime/shape_refiner.cc:88] Function instantiation has undefined input shape at index: 95 in the outer inference context. 2020-07-09 16:57:34.232843: W tensorflow/core/common_runtime/shape_refiner.cc:88] Function instantiation has undefined input shape at index: 159 in the outer inference context. 2020-07-09 16:57:34.233118: W tensorflow/core/common_runtime/shape_refiner.cc:88] Function instantiation has undefined input shape at index: 189 in the outer inference context. 2020-07-09 16:57:34.233330: W tensorflow/core/common_runtime/shape_refiner.cc:88] Function instantiation has undefined input shape at index: 182 in the outer inference context. 2020-07-09 16:57:34.233510: W tensorflow/core/common_runtime/shape_refiner.cc:88] Function instantiation has undefined input shape at index: 166 in the outer inference context. 2020-07-09 16:57:34.233744: W tensorflow/core/common_runtime/shape_refiner.cc:88] Function instantiation has undefined input shape at index: 276 in the outer inference context. 2020-07-09 16:57:34.234133: W tensorflow/core/common_runtime/shape_refiner.cc:88] Function instantiation has undefined input shape at index: 283 in the outer inference context. 2020-07-09 16:57:34.234308: W tensorflow/core/common_runtime/shape_refiner.cc:88] Function instantiation has undefined input shape at index: 269 in the outer inference context. 2020-07-09 16:57:34.234535: W tensorflow/core/common_runtime/shape_refiner.cc:88] Function instantiation has undefined input shape at index: 65 in the outer inference context. 2020-07-09 16:57:34.234842: W tensorflow/core/common_runtime/shape_refiner.cc:88] Function instantiation has undefined input shape at index: 396 in the outer inference context. 2020-07-09 16:57:34.235146: W tensorflow/core/common_runtime/shape_refiner.cc:88] Function instantiation has undefined input shape at index: 290 in the outer inference context. 2020-07-09 16:57:34.235513: W tensorflow/core/common_runtime/shape_refiner.cc:88] Function instantiation has undefined input shape at index: 230 in the outer inference context. 2020-07-09 16:57:34.247641: W tensorflow/core/common_runtime/shape_refiner.cc:88] Function instantiation has undefined input shape at index: 72 in the outer inference context. 2020-07-09 16:57:34.248130: W tensorflow/core/common_runtime/shape_refiner.cc:88] Function instantiation has undefined input shape at index: 237 in the outer inference context. 2020-07-09 16:57:34.248468: W tensorflow/core/common_runtime/shape_refiner.cc:88] Function instantiation has undefined input shape at index: 212 in the outer inference context. 2020-07-09 16:57:34.248930: W tensorflow/core/common_runtime/shape_refiner.cc:88] Function instantiation has undefined input shape at index: 311 in the outer inference context. 2020-07-09 16:57:34.249296: W tensorflow/core/common_runtime/shape_refiner.cc:88] Function instantiation has undefined input shape at index: 219 in the outer inference context. 2020-07-09 16:57:34.249539: W tensorflow/core/common_runtime/shape_refiner.cc:88] Function instantiation has undefined input shape at index: 304 in the outer inference context. 2020-07-09 16:57:34.249973: W tensorflow/core/common_runtime/shape_refiner.cc:88] Function instantiation has undefined input shape at index: 79 in the outer inference context. 2020-07-09 16:57:34.250353: W tensorflow/core/common_runtime/shape_refiner.cc:88] Function instantiation has undefined input shape at index: 256 in the outer inference context. 2020-07-09 16:57:34.250586: W tensorflow/core/common_runtime/shape_refiner.cc:88] Function instantiation has undefined input shape at index: 247 in the outer inference context. 2020-07-09 16:57:34.250865: W tensorflow/core/common_runtime/shape_refiner.cc:88] Function instantiation has undefined input shape at index: 112 in the outer inference context. 2020-07-09 16:57:34.251113: W tensorflow/core/common_runtime/shape_refiner.cc:88] Function instantiation has undefined input shape at index: 199 in the outer inference context. 2020-07-09 16:57:34.251426: W tensorflow/core/common_runtime/shape_refiner.cc:88] Function instantiation has undefined input shape at index: 440 in the outer inference context. 2020-07-09 16:57:34.251889: W tensorflow/core/common_runtime/shape_refiner.cc:88] Function instantiation has undefined input shape at index: 403 in the outer inference context. 2020-07-09 16:57:34.252237: W tensorflow/core/common_runtime/shape_refiner.cc:88] Function instantiation has undefined input shape at index: 762 in the outer inference context. 2020-07-09 16:57:34.252482: W tensorflow/core/common_runtime/shape_refiner.cc:88] Function instantiation has undefined input shape at index: 793 in the outer inference context. 2020-07-09 16:57:34.262509: W tensorflow/core/common_runtime/shape_refiner.cc:88] Function instantiation has undefined input shape at index: 690 in the outer inference context. 2020-07-09 16:57:34.262824: W tensorflow/core/common_runtime/shape_refiner.cc:88] Function instantiation has undefined input shape at index: 676 in the outer inference context. 2020-07-09 16:57:34.263186: W tensorflow/core/common_runtime/shape_refiner.cc:88] Function instantiation has undefined input shape at index: 644 in the outer inference context. 2020-07-09 16:57:34.263497: W tensorflow/core/common_runtime/shape_refiner.cc:88] Function instantiation has undefined input shape at index: 605 in the outer inference context. 2020-07-09 16:57:34.263833: W tensorflow/core/common_runtime/shape_refiner.cc:88] Function instantiation has undefined input shape at index: 431 in the outer inference context. 2020-07-09 16:57:34.264138: W tensorflow/core/common_runtime/shape_refiner.cc:88] Function instantiation has undefined input shape at index: 58 in the outer inference context. 2020-07-09 16:57:34.264471: W tensorflow/core/common_runtime/shape_refiner.cc:88] Function instantiation has undefined input shape at index: 51 in the outer inference context. 2020-07-09 16:57:34.264765: W tensorflow/core/common_runtime/shape_refiner.cc:88] Function instantiation has undefined input shape at index: 44 in the outer inference context. 2020-07-09 16:57:34.265256: W tensorflow/core/common_runtime/shape_refiner.cc:88] Function instantiation has undefined input shape at index: 348 in the outer inference context. 2020-07-09 16:57:34.265498: W tensorflow/core/common_runtime/shape_refiner.cc:88] Function instantiation has undefined input shape at index: 339 in the outer inference context. 2020-07-09 16:57:34.265678: W tensorflow/core/common_runtime/shape_refiner.cc:88] Function instantiation has undefined input shape at index: 368 in the outer inference context. 2020-07-09 16:57:34.265852: W tensorflow/core/common_runtime/shape_refiner.cc:88] Function instantiation has undefined input shape at index: 361 in the outer inference context. 2020-07-09 16:57:34.266046: W tensorflow/core/common_runtime/shape_refiner.cc:88] Function instantiation has undefined input shape at index: 375 in the outer inference context. 2020-07-09 16:57:34.266373: W tensorflow/core/common_runtime/shape_refiner.cc:88] Function instantiation has undefined input shape at index: 382 in the outer inference context. 2020-07-09 16:57:34.266558: W tensorflow/core/common_runtime/shape_refiner.cc:88] Function instantiation has undefined input shape at index: 329 in the outer inference context. 2020-07-09 16:57:34.266733: W tensorflow/core/common_runtime/shape_refiner.cc:88] Function instantiation has undefined input shape at index: 322 in the outer inference context. 2020-07-09 16:57:34.266954: W tensorflow/core/common_runtime/shape_refiner.cc:88] Function instantiation has undefined input shape at index: 841 in the outer inference context. 2020-07-09 16:57:34.267148: W tensorflow/core/common_runtime/shape_refiner.cc:88] Function instantiation has undefined input shape at index: 858 in the outer inference context. 2020-07-09 16:57:34.267348: W tensorflow/core/common_runtime/shape_refiner.cc:88] Function instantiation has undefined input shape at index: 848 in the outer inference context. 2020-07-09 16:57:34.267983: W tensorflow/core/common_runtime/shape_refiner.cc:88] Function instantiation has undefined input shape at index: 900 in the outer inference context. 2020-07-09 16:57:34.268432: W tensorflow/core/common_runtime/shape_refiner.cc:88] Function instantiation has undefined input shape at index: 892 in the outer inference context. 2020-07-09 16:57:34.268613: W tensorflow/core/common_runtime/shape_refiner.cc:88] Function instantiation has undefined input shape at index: 884 in the outer inference context. 2020-07-09 16:57:34.269010: W tensorflow/core/common_runtime/shape_refiner.cc:88] Function instantiation has undefined input shape at index: 875 in the outer inference context. 2020-07-09 16:57:34.269232: W tensorflow/core/common_runtime/shape_refiner.cc:88] Function instantiation has undefined input shape at index: 587 in the outer inference context. 2020-07-09 16:57:34.269477: W tensorflow/core/common_runtime/shape_refiner.cc:88] Function instantiation has undefined input shape at index: 820 in the outer inference context. 2020-07-09 16:57:34.278606: W tensorflow/core/common_runtime/shape_refiner.cc:88] Function instantiation has undefined input shape at index: 813 in the outer inference context. 2020-07-09 16:57:34.278896: W tensorflow/core/common_runtime/shape_refiner.cc:88] Function instantiation has undefined input shape at index: 776 in the outer inference context. 2020-07-09 16:57:34.279228: W tensorflow/core/common_runtime/shape_refiner.cc:88] Function instantiation has undefined input shape at index: 867 in the outer inference context. 2020-07-09 16:57:34.279514: W tensorflow/core/common_runtime/shape_refiner.cc:88] Function instantiation has undefined input shape at index: 806 in the outer inference context. 2020-07-09 16:57:34.279947: W tensorflow/core/common_runtime/shape_refiner.cc:88] Function instantiation has undefined input shape at index: 783 in the outer inference context. 2020-07-09 16:57:35.096620: W tensorflow/core/common_runtime/shape_refiner.cc:88] Function instantiation has undefined input shape at index: 900 in the outer inference context. 2020-07-09 16:57:35.097116: W tensorflow/core/common_runtime/shape_refiner.cc:88] Function instantiation has undefined input shape at index: 827 in the outer inference context. 2020-07-09 16:57:35.097792: W tensorflow/core/common_runtime/shape_refiner.cc:88] Function instantiation has undefined input shape at index: 892 in the outer inference context. 2020-07-09 16:57:35.098173: W tensorflow/core/common_runtime/shape_refiner.cc:88] Function instantiation has undefined input shape at index: 884 in the outer inference context. 2020-07-09 16:57:35.107416: W tensorflow/core/common_runtime/shape_refiner.cc:88] Function instantiation has undefined input shape at index: 867 in the outer inference context. 2020-07-09 16:57:35.108062: W tensorflow/core/common_runtime/shape_refiner.cc:88] Function instantiation has undefined input shape at index: 875 in the outer inference context. 2020-07-09 16:57:35.108598: W tensorflow/core/common_runtime/shape_refiner.cc:88] Function instantiation has undefined input shape at index: 858 in the outer inference context. 2020-07-09 16:57:35.109066: W tensorflow/core/common_runtime/shape_refiner.cc:88] Function instantiation has undefined input shape at index: 841 in the outer inference context. 2020-07-09 16:57:35.109445: W tensorflow/core/common_runtime/shape_refiner.cc:88] Function instantiation has undefined input shape at index: 580 in the outer inference context. 2020-07-09 16:57:35.110041: W tensorflow/core/common_runtime/shape_refiner.cc:88] Function instantiation has undefined input shape at index: 820 in the outer inference context. 2020-07-09 16:57:35.110315: W tensorflow/core/common_runtime/shape_refiner.cc:88] Function instantiation has undefined input shape at index: 776 in the outer inference context. 2020-07-09 16:57:35.110619: W tensorflow/core/common_runtime/shape_refiner.cc:88] Function instantiation has undefined input shape at index: 848 in the outer inference context. 2020-07-09 16:57:35.110934: W tensorflow/core/common_runtime/shape_refiner.cc:88] Function instantiation has undefined input shape at index: 783 in the outer inference context. 2020-07-09 16:57:35.111318: W tensorflow/core/common_runtime/shape_refiner.cc:88] Function instantiation has undefined input shape at index: 587 in the outer inference context. 2020-07-09 16:57:35.120732: W tensorflow/core/common_runtime/shape_refiner.cc:88] Function instantiation has undefined input shape at index: 566 in the outer inference context. 2020-07-09 16:57:35.121303: W tensorflow/core/common_runtime/shape_refiner.cc:88] Function instantiation has undefined input shape at index: 559 in the outer inference context. 2020-07-09 16:57:35.121753: W tensorflow/core/common_runtime/shape_refiner.cc:88] Function instantiation has undefined input shape at index: 460 in the outer inference context. 2020-07-09 16:57:35.122221: W tensorflow/core/common_runtime/shape_refiner.cc:88] Function instantiation has undefined input shape at index: 348 in the outer inference context. 2020-07-09 16:57:35.122654: W tensorflow/core/common_runtime/shape_refiner.cc:88] Function instantiation has undefined input shape at index: 467 in the outer inference context. 2020-07-09 16:57:35.123281: W tensorflow/core/common_runtime/shape_refiner.cc:88] Function instantiation has undefined input shape at index: 474 in the outer inference context. 2020-07-09 16:57:35.123697: W tensorflow/core/common_runtime/shape_refiner.cc:88] Function instantiation has undefined input shape at index: 304 in the outer inference context. 2020-07-09 16:57:35.124004: W tensorflow/core/common_runtime/shape_refiner.cc:88] Function instantiation has undefined input shape at index: 495 in the outer inference context. 2020-07-09 16:57:35.124268: W tensorflow/core/common_runtime/shape_refiner.cc:88] Function instantiation has undefined input shape at index: 488 in the outer inference context. 2020-07-09 16:57:35.124534: W tensorflow/core/common_runtime/shape_refiner.cc:88] Function instantiation has undefined input shape at index: 440 in the outer inference context. 2020-07-09 16:57:35.124937: W tensorflow/core/common_runtime/shape_refiner.cc:88] Function instantiation has undefined input shape at index: 403 in the outer inference context. 2020-07-09 16:57:35.125188: W tensorflow/core/common_runtime/shape_refiner.cc:88] Function instantiation has undefined input shape at index: 396 in the outer inference context. 2020-07-09 16:57:35.125592: W tensorflow/core/common_runtime/shape_refiner.cc:88] Function instantiation has undefined input shape at index: 361 in the outer inference context. 2020-07-09 16:57:35.125836: W tensorflow/core/common_runtime/shape_refiner.cc:88] Function instantiation has undefined input shape at index: 339 in the outer inference context. 2020-07-09 16:57:35.126227: W tensorflow/core/common_runtime/shape_refiner.cc:88] Function instantiation has undefined input shape at index: 431 in the outer inference context. 2020-07-09 16:57:35.126514: W tensorflow/core/common_runtime/shape_refiner.cc:88] Function instantiation has undefined input shape at index: 329 in the outer inference context. 2020-07-09 16:57:35.126767: W tensorflow/core/common_runtime/shape_refiner.cc:88] Function instantiation has undefined input shape at index: 311 in the outer inference context. 2020-07-09 16:57:35.127067: W tensorflow/core/common_runtime/shape_refiner.cc:88] Function instantiation has undefined input shape at index: 368 in the outer inference context. 2020-07-09 16:57:35.127513: W tensorflow/core/common_runtime/shape_refiner.cc:88] Function instantiation has undefined input shape at index: 199 in the outer inference context. 2020-07-09 16:57:35.136755: W tensorflow/core/common_runtime/shape_refiner.cc:88] Function instantiation has undefined input shape at index: 532 in the outer inference context. 2020-07-09 16:57:35.137290: W tensorflow/core/common_runtime/shape_refiner.cc:88] Function instantiation has undefined input shape at index: 65 in the outer inference context. 2020-07-09 16:57:35.137962: W tensorflow/core/common_runtime/shape_refiner.cc:88] Function instantiation has undefined input shape at index: 256 in the outer inference context. 2020-07-09 16:57:35.138320: W tensorflow/core/common_runtime/shape_refiner.cc:88] Function instantiation has undefined input shape at index: 322 in the outer inference context. 2020-07-09 16:57:35.138884: W tensorflow/core/common_runtime/shape_refiner.cc:88] Function instantiation has undefined input shape at index: 247 in the outer inference context. 2020-07-09 16:57:35.139223: W tensorflow/core/common_runtime/shape_refiner.cc:88] Function instantiation has undefined input shape at index: 453 in the outer inference context. 2020-07-09 16:57:35.139732: W tensorflow/core/common_runtime/shape_refiner.cc:88] Function instantiation has undefined input shape at index: 421 in the outer inference context. 2020-07-09 16:57:35.140020: W tensorflow/core/common_runtime/shape_refiner.cc:88] Function instantiation has undefined input shape at index: 414 in the outer inference context. 2020-07-09 16:57:35.140398: W tensorflow/core/common_runtime/shape_refiner.cc:88] Function instantiation has undefined input shape at index: 276 in the outer inference context. 2020-07-09 16:57:35.140909: W tensorflow/core/common_runtime/shape_refiner.cc:88] Function instantiation has undefined input shape at index: 269 in the outer inference context. 2020-07-09 16:57:35.141224: W tensorflow/core/common_runtime/shape_refiner.cc:88] Function instantiation has undefined input shape at index: 382 in the outer inference context. 2020-07-09 16:57:35.141479: W tensorflow/core/common_runtime/shape_refiner.cc:88] Function instantiation has undefined input shape at index: 375 in the outer inference context. 2020-07-09 16:57:35.141737: W tensorflow/core/common_runtime/shape_refiner.cc:88] Function instantiation has undefined input shape at index: 283 in the outer inference context. 2020-07-09 16:57:35.142042: W tensorflow/core/common_runtime/shape_refiner.cc:88] Function instantiation has undefined input shape at index: 813 in the outer inference context. 2020-07-09 16:57:35.142260: W tensorflow/core/common_runtime/shape_refiner.cc:88] Function instantiation has undefined input shape at index: 230 in the outer inference context. 2020-07-09 16:57:35.142506: W tensorflow/core/common_runtime/shape_refiner.cc:88] Function instantiation has undefined input shape at index: 290 in the outer inference context. 2020-07-09 16:57:35.142817: W tensorflow/core/common_runtime/shape_refiner.cc:88] Function instantiation has undefined input shape at index: 718 in the outer inference context. 2020-07-09 16:57:35.143213: W tensorflow/core/common_runtime/shape_refiner.cc:88] Function instantiation has undefined input shape at index: 711 in the outer inference context. 2020-07-09 16:57:35.143801: W tensorflow/core/common_runtime/shape_refiner.cc:88] Function instantiation has undefined input shape at index: 624 in the outer inference context. 2020-07-09 16:57:35.144070: W tensorflow/core/common_runtime/shape_refiner.cc:88] Function instantiation has undefined input shape at index: 748 in the outer inference context. 2020-07-09 16:57:35.144490: W tensorflow/core/common_runtime/shape_refiner.cc:88] Function instantiation has undefined input shape at index: 741 in the outer inference context. 2020-07-09 16:57:35.154721: W tensorflow/core/common_runtime/shape_refiner.cc:88] Function instantiation has undefined input shape at index: 663 in the outer inference context. 2020-07-09 16:57:35.155201: W tensorflow/core/common_runtime/shape_refiner.cc:88] Function instantiation has undefined input shape at index: 762 in the outer inference context. 2020-07-09 16:57:35.155658: W tensorflow/core/common_runtime/shape_refiner.cc:88] Function instantiation has undefined input shape at index: 755 in the outer inference context. 2020-07-09 16:57:35.156400: W tensorflow/core/common_runtime/shape_refiner.cc:88] Function instantiation has undefined input shape at index: 615 in the outer inference context. 2020-07-09 16:57:35.156896: W tensorflow/core/common_runtime/shape_refiner.cc:88] Function instantiation has undefined input shape at index: 654 in the outer inference context. 2020-07-09 16:57:35.157513: W tensorflow/core/common_runtime/shape_refiner.cc:88] Function instantiation has undefined input shape at index: 676 in the outer inference context. 2020-07-09 16:57:35.157884: W tensorflow/core/common_runtime/shape_refiner.cc:88] Function instantiation has undefined input shape at index: 690 in the outer inference context. 2020-07-09 16:57:35.158181: W tensorflow/core/common_runtime/shape_refiner.cc:88] Function instantiation has undefined input shape at index: 683 in the outer inference context. 2020-07-09 16:57:35.158497: W tensorflow/core/common_runtime/shape_refiner.cc:88] Function instantiation has undefined input shape at index: 728 in the outer inference context. 2020-07-09 16:57:35.158757: W tensorflow/core/common_runtime/shape_refiner.cc:88] Function instantiation has undefined input shape at index: 793 in the outer inference context. 2020-07-09 16:57:35.159034: W tensorflow/core/common_runtime/shape_refiner.cc:88] Function instantiation has undefined input shape at index: 637 in the outer inference context. 2020-07-09 16:57:35.159338: W tensorflow/core/common_runtime/shape_refiner.cc:88] Function instantiation has undefined input shape at index: 806 in the outer inference context. 2020-07-09 16:57:35.159598: W tensorflow/core/common_runtime/shape_refiner.cc:88] Function instantiation has undefined input shape at index: 697 in the outer inference context. 2020-07-09 16:57:35.160073: W tensorflow/core/common_runtime/shape_refiner.cc:88] Function instantiation has undefined input shape at index: 598 in the outer inference context. 2020-07-09 16:57:35.160353: W tensorflow/core/common_runtime/shape_refiner.cc:88] Function instantiation has undefined input shape at index: 545 in the outer inference context. 2020-07-09 16:57:35.169975: W tensorflow/core/common_runtime/shape_refiner.cc:88] Function instantiation has undefined input shape at index: 523 in the outer inference context. 2020-07-09 16:57:35.170908: W tensorflow/core/common_runtime/shape_refiner.cc:88] Function instantiation has undefined input shape at index: 644 in the outer inference context. 2020-07-09 16:57:35.171307: W tensorflow/core/common_runtime/shape_refiner.cc:88] Function instantiation has undefined input shape at index: 605 in the outer inference context. 2020-07-09 16:57:35.171965: W tensorflow/core/common_runtime/shape_refiner.cc:88] Function instantiation has undefined input shape at index: 552 in the outer inference context. 2020-07-09 16:57:35.172299: W tensorflow/core/common_runtime/shape_refiner.cc:88] Function instantiation has undefined input shape at index: 513 in the outer inference context. 2020-07-09 16:57:35.172722: W tensorflow/core/common_runtime/shape_refiner.cc:88] Function instantiation has undefined input shape at index: 506 in the outer inference context. 2020-07-09 16:57:35.173135: W tensorflow/core/common_runtime/shape_refiner.cc:88] Function instantiation has undefined input shape at index: 237 in the outer inference context. 2020-07-09 16:57:35.173559: W tensorflow/core/common_runtime/shape_refiner.cc:88] Function instantiation has undefined input shape at index: 95 in the outer inference context. 2020-07-09 16:57:35.173851: W tensorflow/core/common_runtime/shape_refiner.cc:88] Function instantiation has undefined input shape at index: 189 in the outer inference context. 2020-07-09 16:57:35.174146: W tensorflow/core/common_runtime/shape_refiner.cc:88] Function instantiation has undefined input shape at index: 182 in the outer inference context. 2020-07-09 16:57:35.174423: W tensorflow/core/common_runtime/shape_refiner.cc:88] Function instantiation has undefined input shape at index: 219 in the outer inference context. 2020-07-09 16:57:35.174833: W tensorflow/core/common_runtime/shape_refiner.cc:88] Function instantiation has undefined input shape at index: 212 in the outer inference context. 2020-07-09 16:57:35.175144: W tensorflow/core/common_runtime/shape_refiner.cc:88] Function instantiation has undefined input shape at index: 152 in the outer inference context. 2020-07-09 16:57:35.175358: W tensorflow/core/common_runtime/shape_refiner.cc:88] Function instantiation has undefined input shape at index: 138 in the outer inference context. 2020-07-09 16:57:35.175567: W tensorflow/core/common_runtime/shape_refiner.cc:88] Function instantiation has undefined input shape at index: 131 in the outer inference context. 2020-07-09 16:57:35.175791: W tensorflow/core/common_runtime/shape_refiner.cc:88] Function instantiation has undefined input shape at index: 145 in the outer inference context. 2020-07-09 16:57:35.176178: W tensorflow/core/common_runtime/shape_refiner.cc:88] Function instantiation has undefined input shape at index: 112 in the outer inference context. 2020-07-09 16:57:35.176416: W tensorflow/core/common_runtime/shape_refiner.cc:88] Function instantiation has undefined input shape at index: 166 in the outer inference context. 2020-07-09 16:57:35.176613: W tensorflow/core/common_runtime/shape_refiner.cc:88] Function instantiation has undefined input shape at index: 159 in the outer inference context. 2020-07-09 16:57:35.176882: W tensorflow/core/common_runtime/shape_refiner.cc:88] Function instantiation has undefined input shape at index: 102 in the outer inference context. 2020-07-09 16:57:35.177110: W tensorflow/core/common_runtime/shape_refiner.cc:88] Function instantiation has undefined input shape at index: 79 in the outer inference context. 2020-07-09 16:57:35.177532: W tensorflow/core/common_runtime/shape_refiner.cc:88] Function instantiation has undefined input shape at index: 72 in the outer inference context. 2020-07-09 16:57:35.186813: W tensorflow/core/common_runtime/shape_refiner.cc:88] Function instantiation has undefined input shape at index: 58 in the outer inference context. 2020-07-09 16:57:35.187349: W tensorflow/core/common_runtime/shape_refiner.cc:88] Function instantiation has undefined input shape at index: 44 in the outer inference context. 2020-07-09 16:57:35.187730: W tensorflow/core/common_runtime/shape_refiner.cc:88] Function instantiation has undefined input shape at index: 51 in the outer inference context. 2020-07-09 16:57:38.456244: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library cublas64_10.dll 2020-07-09 16:57:39.465590: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library cudnn64_7.dll 2020-07-09 16:57:40.095290: W tensorflow/stream_executor/gpu/redzone_allocator.cc:314] Internal: Invoking GPU asm compilation is supported on Cuda non-Windows platforms only Relying on driver to perform ptx compilation. Modify $PATH to customize ptxas location. This message will be only logged once. 2020-07-09 16:57:40.983306: W tensorflow/core/common_runtime/bfc_allocator.cc:311] Garbage collection: deallocate free memory regions (i.e., allocations) so that we can re-allocate a larger region to avoid OOM due to memory fragmentation. If you see this message frequently, you are running near the threshold of the available device memory and re-allocation may incur great performance overhead. You may try smaller batch sizes to observe the performance impact. Set TF_ENABLE_GPU_GARBAGE_COLLECTION=false if you'd like to disable this feature. 514/6273 [=>............................] - ETA: 1:42:55 - loss: 0.6602 - accuracy: 0.8975C:\Users\AI2\AppData\Local\Programs\Python\Python37\lib\site-packages\PIL\Image.py:2835: DecompressionBombWarning: Image size (117018720 pixels) exceeds limit of 89478485 pixels, could be decompression bomb DOS attack. DecompressionBombWarning, 1380/6273 [=====>........................] - ETA: 1:27:58 - loss: 0.6198 - accuracy: 0.9212C:\Users\AI2\AppData\Local\Programs\Python\Python37\lib\site-packages\PIL\Image.py:2835: DecompressionBombWarning: Image size (98130452 pixels) exceeds limit of 89478485 pixels, could be decompression bomb DOS attack. DecompressionBombWarning, 1410/6273 [=====>........................] - ETA: 1:27:26 - loss: 0.6191 - accuracy: 0.9216C:\Users\AI2\AppData\Local\Programs\Python\Python37\lib\site-packages\PIL\Image.py:2835: DecompressionBombWarning: Image size (143085600 pixels) exceeds limit of 89478485 pixels, could be decompression bomb DOS attack. DecompressionBombWarning, 1925/6273 [========>.....................] - ETA: 1:18:20 - loss: 0.6065 - accuracy: 0.92892020-07-09 17:32:24.965632: W tensorflow/core/framework/op_kernel.cc:1741] Unknown: UnidentifiedImageError: cannot identify image file <_io.BytesIO object at 0x000001DD0B030048> Traceback (most recent call last):

File "C:\Users\AI2\AppData\Local\Programs\Python\Python37\lib\site-packages\tensorflow\python\ops\script_ops.py", line 243, in call ret = func(*args)

File "C:\Users\AI2\AppData\Local\Programs\Python\Python37\lib\site-packages\tensorflow\python\autograph\impl\api.py", line 309, in wrapper return func(*args, **kwargs)

File "C:\Users\AI2\AppData\Local\Programs\Python\Python37\lib\site-packages\tensorflow\python\data\ops\dataset_ops.py", line 785, in generator_py_func values = next(generator_state.get_iterator(iterator_id))

File "C:\Users\AI2\AppData\Local\Programs\Python\Python37\lib\site-packages\tensorflow\python\keras\engine\data_adapter.py", line 801, in wrapped_generator for data in generator_fn():

File "C:\Users\AI2\AppData\Local\Programs\Python\Python37\lib\site-packages\tensorflow\python\keras\engine\data_adapter.py", line 932, in generator_fn yield x[i]

File "C:\Users\AI2\AppData\Local\Programs\Python\Python37\lib\site-packages\keras_preprocessing\image\iterator.py", line 65, in getitem return self._get_batches_of_transformed_samples(index_array)

File "C:\Users\AI2\AppData\Local\Programs\Python\Python37\lib\site-packages\keras_preprocessing\image\iterator.py", line 230, in _get_batches_of_transformed_samples interpolation=self.interpolation)

File "C:\Users\AI2\AppData\Local\Programs\Python\Python37\lib\site-packages\keras_preprocessing\image\utils.py", line 114, in load_img img = pil_image.open(io.BytesIO(f.read()))

File "C:\Users\AI2\AppData\Local\Programs\Python\Python37\lib\site-packages\PIL\Image.py", line 2931, in open "cannot identify image file %r" % (filename if filename else fp)

PIL.UnidentifiedImageError: cannot identify image file <_io.BytesIO object at 0x000001DD0B030048>

1926/6273 [========>.....................] - ETA: 1:18:19 - loss: 0.6066 - accuracy: 0.9288Traceback (most recent call last): File "./training/make_nsfw_model.py", line 273, in run_main() File "./training/make_nsfw_model.py", line 269, in run_main app.run(main) File "C:\Users\AI2\AppData\Local\Programs\Python\Python37\lib\site-packages\absl\app.py", line 299, in run _run_main(main, args) File "C:\Users\AI2\AppData\Local\Programs\Python\Python37\lib\site-packages\absl\app.py", line 250, in _run_main sys.exit(main(argv)) File "./training/make_nsfw_model.py", line 197, in main FLAGS.tfhub_module, image_dir, hparams, FLAGS.image_size, FLAGS.saved_model_dir) File "D:\WORKING\Human_detection\Deep_learning-ver\nsfw_porn_detection\nsfw_model-1.1.0\nsfw_model-1.1.0\training\make_nsfw_model_lib.py", line 430, in make_image_classifier valid_data_and_size) File "D:\WORKING\Human_detection\Deep_learning-ver\nsfw_porn_detection\nsfw_model-1.1.0\nsfw_model-1.1.0\training\make_nsfw_model_lib.py", line 268, in train_model validation_steps=validation_steps) File "C:\Users\AI2\AppData\Local\Programs\Python\Python37\lib\site-packages\tensorflow\python\keras\engine\training.py", line 66, in _method_wrapper return method(self, *args, kwargs) File "C:\Users\AI2\AppData\Local\Programs\Python\Python37\lib\site-packages\tensorflow\python\keras\engine\training.py", line 848, in fit tmp_logs = train_function(iterator) File "C:\Users\AI2\AppData\Local\Programs\Python\Python37\lib\site-packages\tensorflow\python\eager\def_function.py", line 580, in call result = self._call(*args, *kwds) File "C:\Users\AI2\AppData\Local\Programs\Python\Python37\lib\site-packages\tensorflow\python\eager\def_function.py", line 611, in _call return self._stateless_fn(args, kwds) # pylint: disable=not-callable File "C:\Users\AI2\AppData\Local\Programs\Python\Python37\lib\site-packages\tensorflow\python\eager\function.py", line 2420, in call return graph_function._filtered_call(args, kwargs) # pylint: disable=protected-access File "C:\Users\AI2\AppData\Local\Programs\Python\Python37\lib\site-packages\tensorflow\python\eager\function.py", line 1665, in _filtered_call self.captured_inputs) File "C:\Users\AI2\AppData\Local\Programs\Python\Python37\lib\site-packages\tensorflow\python\eager\function.py", line 1746, in _call_flat ctx, args, cancellation_manager=cancellation_manager)) File "C:\Users\AI2\AppData\Local\Programs\Python\Python37\lib\site-packages\tensorflow\python\eager\function.py", line 598, in call ctx=ctx) File "C:\Users\AI2\AppData\Local\Programs\Python\Python37\lib\site-packages\tensorflow\python\eager\execute.py", line 60, in quick_execute inputs, attrs, num_outputs) tensorflow.python.framework.errors_impl.UnknownError: 2 root error(s) found. (0) Unknown: UnidentifiedImageError: cannot identify image file <_io.BytesIO object at 0x000001DD0B030048> Traceback (most recent call last):