The utilization: CPU 100, GPU 20

[gblue1223]

I've searched and did what they said about GPU usage, but it seems still have a problem.

I installed CUDA 10.0(cuda_10.0.130_411.31_win10) and MiniConda seems installed CUDNN 7.6.0(MiniConda3\pkgs\cudnn-7.6.0-cuda10.0_0)

After the installation, I've extracted images, and tried the train but the utilization rate is not what I expected. The app use CPU 100% and use GPU about 20%.

What should I tweak?

Expected behavior

100% usage of GPU. Less then 100% of CPU.

Actual behavior

CPU 100%, GPU 20%.

Steps to reproduce

Start the train.

Other relevant information

• Command lined used (if not specified in steps to reproduce): faceswap.py ... It is GUI version
• Operating system and version: Windows, macOS, Linux Windows 10
• Python version: 2.7, 3.5, 3.6.4, ... Python 3.6.8 :: Anaconda, Inc.
• Faceswap version: commit hash or version number x64 v0.99.1
• Faceswap method: CPU/GPU GPU
• Other related issues:

  162, #79, #73

• Addtional info: Logs

  Loading...
  07/13/2019 18:07:13 INFO     Log level set to: TRACE
  Using TensorFlow backend.
  07/13/2019 18:07:15 INFO     Model A Directory: C:\Users\greenblue\Documents\Work\faceswap\faces\A
  07/13/2019 18:07:15 INFO     Model B Directory: C:\Users\greenblue\Documents\Work\faceswap\faces\B
  07/13/2019 18:07:15 INFO     Training data directory: C:\Users\greenblue\Documents\Work\faceswap\models\A_B-GPU
  07/13/2019 18:07:15 INFO     ===================================================
  07/13/2019 18:07:15 INFO       Starting
  07/13/2019 18:07:15 INFO       Press 'Terminate' to save and quit
  07/13/2019 18:07:15 INFO     ===================================================
  07/13/2019 18:07:16 INFO     Loading data, this may take a while...
  07/13/2019 18:07:16 INFO     Loading Model from Original plugin...
  07/13/2019 18:07:17 VERBOSE  Loading config: 'C:\Users\greenblue\faceswap\config\train.ini'
  07/13/2019 18:07:17 VERBOSE  Loading config: 'C:\Users\greenblue\faceswap\config\train.ini'
  2019-07-13 18:07:18.035254: I tensorflow/core/platform/cpu_feature_guard.cc:141] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX AVX2
  07/13/2019 18:07:17 INFO     Using configuration saved in state file
  07/13/2019 18:07:17 WARNING  From C:\Users\greenblue\MiniConda3\envs\faceswap\lib\site-packages\tensorflow\python\framework\op_def_library.py:263: colocate_with (from tensorflow.python.framework.ops) is deprecated and will be removed in a future version.\nInstructions for updating:\nColocations handled automatically by placer.
  2019-07-13 18:07:18.368881: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1433] Found device 0 with properties:
  name: GeForce RTX 2080 Ti major: 7 minor: 5 memoryClockRate(GHz): 1.545
  pciBusID: 0000:10:00.0
  totalMemory: 11.00GiB freeMemory: 8.99GiB
  2019-07-13 18:07:18.369194: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1512] Adding visible gpu devices: 0
  2019-07-13 18:07:18.994272: I tensorflow/core/common_runtime/gpu/gpu_device.cc:984] Device interconnect StreamExecutor with strength 1 edge matrix:
  2019-07-13 18:07:18.994450: I tensorflow/core/common_runtime/gpu/gpu_device.cc:990]      0
  2019-07-13 18:07:18.994516: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1003] 0:   N
  2019-07-13 18:07:18.994730: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1115] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 8661 MB memory) -> physical GPU (device: 0, name: GeForce RTX 2080 Ti, pci bus id: 0000:10:00.0, compute capability: 7.5)
  2019-07-13 18:07:20.224746: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1512] Adding visible gpu devices: 0
  2019-07-13 18:07:20.224963: I tensorflow/core/common_runtime/gpu/gpu_device.cc:984] Device interconnect StreamExecutor with strength 1 edge matrix:
  2019-07-13 18:07:20.225070: I tensorflow/core/common_runtime/gpu/gpu_device.cc:990]      0
  2019-07-13 18:07:20.225137: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1003] 0:   N
  2019-07-13 18:07:20.225271: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1115] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 8661 MB memory) -> physical GPU (device: 0, name: GeForce RTX 2080 Ti, pci bus id: 0000:10:00.0, compute capability: 7.5)
  C:\Users\greenblue\MiniConda3\envs\faceswap\lib\site-packages\keras\engine\saving.py:292: UserWarning: No training configuration found in save file: the model was *not* compiled. Compile it manually.
  warnings.warn('No training configuration found in save file: '
  07/13/2019 18:07:21 INFO     Loaded model from disk: 'C:\Users\greenblue\Documents\Work\faceswap\models\A_B-GPU'
  07/13/2019 18:07:21 VERBOSE  [Original A Summary]:
  07/13/2019 18:07:21 VERBOSE  _________________________________________________________________
  07/13/2019 18:07:21 VERBOSE  Layer (type)                 Output Shape              Param #
  07/13/2019 18:07:21 VERBOSE  =================================================================
  07/13/2019 18:07:21 VERBOSE  face (InputLayer)            (None, 64, 64, 3)         0
  07/13/2019 18:07:21 VERBOSE  _________________________________________________________________
  07/13/2019 18:07:21 VERBOSE  encoder (Model)              (None, 8, 8, 512)         69662976
  07/13/2019 18:07:21 VERBOSE  _________________________________________________________________
  07/13/2019 18:07:21 VERBOSE  decoder (Model)              (None, 64, 64, 3)         6199747
  07/13/2019 18:07:21 VERBOSE  =================================================================
  07/13/2019 18:07:21 VERBOSE  Total params: 75,862,723
  07/13/2019 18:07:21 VERBOSE  Trainable params: 75,862,723
  07/13/2019 18:07:21 VERBOSE  Non-trainable params: 0
  07/13/2019 18:07:21 VERBOSE  _________________________________________________________________
  07/13/2019 18:07:21 VERBOSE  Decoder_A:
  07/13/2019 18:07:21 VERBOSE  _________________________________________________________________
  07/13/2019 18:07:21 VERBOSE  Layer (type)                 Output Shape              Param #
  07/13/2019 18:07:21 VERBOSE  =================================================================
  07/13/2019 18:07:21 VERBOSE  input_1 (InputLayer)         (None, 8, 8, 512)         0
  07/13/2019 18:07:21 VERBOSE  _________________________________________________________________
  07/13/2019 18:07:21 VERBOSE  conv2d_1 (Conv2D)            (None, 8, 8, 1024)        4719616
  07/13/2019 18:07:21 VERBOSE  _________________________________________________________________
  07/13/2019 18:07:21 VERBOSE  leaky_re_lu_1 (LeakyReLU)    (None, 8, 8, 1024)        0
  07/13/2019 18:07:21 VERBOSE  _________________________________________________________________
  07/13/2019 18:07:21 VERBOSE  pixel_shuffler_1 (PixelShuff (None, 16, 16, 256)       0
  07/13/2019 18:07:21 VERBOSE  _________________________________________________________________
  07/13/2019 18:07:21 VERBOSE  conv2d_2 (Conv2D)            (None, 16, 16, 512)       1180160
  07/13/2019 18:07:21 VERBOSE  _________________________________________________________________
  07/13/2019 18:07:21 VERBOSE  leaky_re_lu_2 (LeakyReLU)    (None, 16, 16, 512)       0
  07/13/2019 18:07:21 VERBOSE  _________________________________________________________________
  07/13/2019 18:07:21 VERBOSE  pixel_shuffler_2 (PixelShuff (None, 32, 32, 128)       0
  07/13/2019 18:07:21 VERBOSE  _________________________________________________________________
  07/13/2019 18:07:21 VERBOSE  conv2d_3 (Conv2D)            (None, 32, 32, 256)       295168
  07/13/2019 18:07:21 VERBOSE  _________________________________________________________________
  07/13/2019 18:07:21 VERBOSE  leaky_re_lu_3 (LeakyReLU)    (None, 32, 32, 256)       0
  07/13/2019 18:07:21 VERBOSE  _________________________________________________________________
  07/13/2019 18:07:21 VERBOSE  pixel_shuffler_3 (PixelShuff (None, 64, 64, 64)        0
  07/13/2019 18:07:21 VERBOSE  _________________________________________________________________
  07/13/2019 18:07:21 VERBOSE  conv2d_4 (Conv2D)            (None, 64, 64, 3)         4803
  07/13/2019 18:07:21 VERBOSE  =================================================================
  07/13/2019 18:07:21 VERBOSE  Total params: 6,199,747
  07/13/2019 18:07:21 VERBOSE  Trainable params: 6,199,747
  07/13/2019 18:07:21 VERBOSE  Non-trainable params: 0
  07/13/2019 18:07:21 VERBOSE  _________________________________________________________________
  07/13/2019 18:07:21 VERBOSE  Encoder:
  07/13/2019 18:07:21 VERBOSE  _________________________________________________________________
  07/13/2019 18:07:21 VERBOSE  Layer (type)                 Output Shape              Param #
  07/13/2019 18:07:21 VERBOSE  =================================================================
  07/13/2019 18:07:21 VERBOSE  input_3 (InputLayer)         (None, 64, 64, 3)         0
  07/13/2019 18:07:21 VERBOSE  _________________________________________________________________
  07/13/2019 18:07:21 VERBOSE  conv2d_9 (Conv2D)            (None, 32, 32, 128)       9728
  07/13/2019 18:07:21 VERBOSE  _________________________________________________________________
  07/13/2019 18:07:21 VERBOSE  leaky_re_lu_7 (LeakyReLU)    (None, 32, 32, 128)       0
  07/13/2019 18:07:21 VERBOSE  _________________________________________________________________
  07/13/2019 18:07:21 VERBOSE  conv2d_10 (Conv2D)           (None, 16, 16, 256)       819456
  07/13/2019 18:07:21 VERBOSE  _________________________________________________________________
  07/13/2019 18:07:21 VERBOSE  leaky_re_lu_8 (LeakyReLU)    (None, 16, 16, 256)       0
  07/13/2019 18:07:21 VERBOSE  _________________________________________________________________
  07/13/2019 18:07:21 VERBOSE  conv2d_11 (Conv2D)           (None, 8, 8, 512)         3277312
  07/13/2019 18:07:21 VERBOSE  _________________________________________________________________
  07/13/2019 18:07:21 VERBOSE  leaky_re_lu_9 (LeakyReLU)    (None, 8, 8, 512)         0
  07/13/2019 18:07:21 VERBOSE  _________________________________________________________________
  07/13/2019 18:07:21 VERBOSE  conv2d_12 (Conv2D)           (None, 4, 4, 1024)        13108224
  07/13/2019 18:07:21 VERBOSE  _________________________________________________________________
  07/13/2019 18:07:21 VERBOSE  leaky_re_lu_10 (LeakyReLU)   (None, 4, 4, 1024)        0
  07/13/2019 18:07:21 VERBOSE  _________________________________________________________________
  07/13/2019 18:07:21 VERBOSE  flatten_1 (Flatten)          (None, 16384)             0
  07/13/2019 18:07:21 VERBOSE  _________________________________________________________________
  07/13/2019 18:07:21 VERBOSE  dense_1 (Dense)              (None, 1024)              16778240
  07/13/2019 18:07:21 VERBOSE  _________________________________________________________________
  07/13/2019 18:07:21 VERBOSE  dense_2 (Dense)              (None, 16384)             16793600
  07/13/2019 18:07:21 VERBOSE  _________________________________________________________________
  07/13/2019 18:07:21 VERBOSE  reshape_1 (Reshape)          (None, 4, 4, 1024)        0
  07/13/2019 18:07:21 VERBOSE  _________________________________________________________________
  07/13/2019 18:07:21 VERBOSE  conv2d_13 (Conv2D)           (None, 4, 4, 2048)        18876416
  07/13/2019 18:07:21 VERBOSE  _________________________________________________________________
  07/13/2019 18:07:21 VERBOSE  leaky_re_lu_11 (LeakyReLU)   (None, 4, 4, 2048)        0
  07/13/2019 18:07:21 VERBOSE  _________________________________________________________________
  07/13/2019 18:07:21 VERBOSE  pixel_shuffler_7 (PixelShuff (None, 8, 8, 512)         0
  07/13/2019 18:07:21 VERBOSE  =================================================================
  07/13/2019 18:07:21 VERBOSE  Total params: 69,662,976
  07/13/2019 18:07:21 VERBOSE  Trainable params: 69,662,976
  07/13/2019 18:07:21 VERBOSE  Non-trainable params: 0
  07/13/2019 18:07:21 VERBOSE  _________________________________________________________________
  07/13/2019 18:07:21 VERBOSE  [Original B Summary]:
  07/13/2019 18:07:21 VERBOSE  _________________________________________________________________
  07/13/2019 18:07:21 VERBOSE  Layer (type)                 Output Shape              Param #
  07/13/2019 18:07:21 VERBOSE  =================================================================
  07/13/2019 18:07:21 VERBOSE  face (InputLayer)            (None, 64, 64, 3)         0
  07/13/2019 18:07:21 VERBOSE  _________________________________________________________________
  07/13/2019 18:07:21 VERBOSE  encoder (Model)              (None, 8, 8, 512)         69662976
  07/13/2019 18:07:21 VERBOSE  _________________________________________________________________
  07/13/2019 18:07:21 VERBOSE  decoder (Model)              (None, 64, 64, 3)         6199747
  07/13/2019 18:07:21 VERBOSE  =================================================================
  07/13/2019 18:07:21 VERBOSE  Total params: 75,862,723
  07/13/2019 18:07:21 VERBOSE  Trainable params: 75,862,723
  07/13/2019 18:07:21 VERBOSE  Non-trainable params: 0
  07/13/2019 18:07:21 VERBOSE  _________________________________________________________________
  07/13/2019 18:07:21 VERBOSE  Decoder_B:
  07/13/2019 18:07:21 VERBOSE  _________________________________________________________________
  07/13/2019 18:07:21 VERBOSE  Layer (type)                 Output Shape              Param #
  07/13/2019 18:07:21 VERBOSE  =================================================================
  07/13/2019 18:07:21 VERBOSE  input_2 (InputLayer)         (None, 8, 8, 512)         0
  07/13/2019 18:07:21 VERBOSE  _________________________________________________________________
  07/13/2019 18:07:21 VERBOSE  conv2d_5 (Conv2D)            (None, 8, 8, 1024)        4719616
  07/13/2019 18:07:21 VERBOSE  _________________________________________________________________
  07/13/2019 18:07:21 VERBOSE  leaky_re_lu_4 (LeakyReLU)    (None, 8, 8, 1024)        0
  07/13/2019 18:07:21 VERBOSE  _________________________________________________________________
  07/13/2019 18:07:21 VERBOSE  pixel_shuffler_4 (PixelShuff (None, 16, 16, 256)       0
  07/13/2019 18:07:21 VERBOSE  _________________________________________________________________
  07/13/2019 18:07:21 VERBOSE  conv2d_6 (Conv2D)            (None, 16, 16, 512)       1180160
  07/13/2019 18:07:21 VERBOSE  _________________________________________________________________
  07/13/2019 18:07:21 VERBOSE  leaky_re_lu_5 (LeakyReLU)    (None, 16, 16, 512)       0
  07/13/2019 18:07:21 VERBOSE  _________________________________________________________________
  07/13/2019 18:07:21 VERBOSE  pixel_shuffler_5 (PixelShuff (None, 32, 32, 128)       0
  07/13/2019 18:07:21 VERBOSE  _________________________________________________________________
  07/13/2019 18:07:21 VERBOSE  conv2d_7 (Conv2D)            (None, 32, 32, 256)       295168
  07/13/2019 18:07:21 VERBOSE  _________________________________________________________________
  07/13/2019 18:07:21 VERBOSE  leaky_re_lu_6 (LeakyReLU)    (None, 32, 32, 256)       0
  07/13/2019 18:07:21 VERBOSE  _________________________________________________________________
  07/13/2019 18:07:21 VERBOSE  pixel_shuffler_6 (PixelShuff (None, 64, 64, 64)        0
  07/13/2019 18:07:21 VERBOSE  _________________________________________________________________
  07/13/2019 18:07:21 VERBOSE  conv2d_8 (Conv2D)            (None, 64, 64, 3)         4803
  07/13/2019 18:07:21 VERBOSE  =================================================================
  07/13/2019 18:07:21 VERBOSE  Total params: 6,199,747
  07/13/2019 18:07:21 VERBOSE  Trainable params: 6,199,747
  07/13/2019 18:07:21 VERBOSE  Non-trainable params: 0
  07/13/2019 18:07:21 VERBOSE  _________________________________________________________________
  07/13/2019 18:07:21 VERBOSE  Encoder:
  07/13/2019 18:07:21 VERBOSE  _________________________________________________________________
  07/13/2019 18:07:21 VERBOSE  Layer (type)                 Output Shape              Param #
  07/13/2019 18:07:21 VERBOSE  =================================================================
  07/13/2019 18:07:21 VERBOSE  input_3 (InputLayer)         (None, 64, 64, 3)         0
  07/13/2019 18:07:21 VERBOSE  _________________________________________________________________
  07/13/2019 18:07:21 VERBOSE  conv2d_9 (Conv2D)            (None, 32, 32, 128)       9728
  07/13/2019 18:07:21 VERBOSE  _________________________________________________________________
  07/13/2019 18:07:21 VERBOSE  leaky_re_lu_7 (LeakyReLU)    (None, 32, 32, 128)       0
  07/13/2019 18:07:21 VERBOSE  _________________________________________________________________
  07/13/2019 18:07:21 VERBOSE  conv2d_10 (Conv2D)           (None, 16, 16, 256)       819456
  07/13/2019 18:07:21 VERBOSE  _________________________________________________________________
  07/13/2019 18:07:21 VERBOSE  leaky_re_lu_8 (LeakyReLU)    (None, 16, 16, 256)       0
  07/13/2019 18:07:21 VERBOSE  _________________________________________________________________
  07/13/2019 18:07:21 VERBOSE  conv2d_11 (Conv2D)           (None, 8, 8, 512)         3277312
  07/13/2019 18:07:21 VERBOSE  _________________________________________________________________
  07/13/2019 18:07:21 VERBOSE  leaky_re_lu_9 (LeakyReLU)    (None, 8, 8, 512)         0
  07/13/2019 18:07:21 VERBOSE  _________________________________________________________________
  07/13/2019 18:07:21 VERBOSE  conv2d_12 (Conv2D)           (None, 4, 4, 1024)        13108224
  07/13/2019 18:07:21 VERBOSE  _________________________________________________________________
  07/13/2019 18:07:21 VERBOSE  leaky_re_lu_10 (LeakyReLU)   (None, 4, 4, 1024)        0
  07/13/2019 18:07:21 VERBOSE  _________________________________________________________________
  07/13/2019 18:07:21 VERBOSE  flatten_1 (Flatten)          (None, 16384)             0
  07/13/2019 18:07:21 VERBOSE  _________________________________________________________________
  07/13/2019 18:07:21 VERBOSE  dense_1 (Dense)              (None, 1024)              16778240
  07/13/2019 18:07:21 VERBOSE  _________________________________________________________________
  07/13/2019 18:07:21 VERBOSE  dense_2 (Dense)              (None, 16384)             16793600
  07/13/2019 18:07:21 VERBOSE  _________________________________________________________________
  07/13/2019 18:07:21 VERBOSE  reshape_1 (Reshape)          (None, 4, 4, 1024)        0
  07/13/2019 18:07:21 VERBOSE  _________________________________________________________________
  07/13/2019 18:07:21 VERBOSE  conv2d_13 (Conv2D)           (None, 4, 4, 2048)        18876416
  07/13/2019 18:07:21 VERBOSE  _________________________________________________________________
  07/13/2019 18:07:21 VERBOSE  leaky_re_lu_11 (LeakyReLU)   (None, 4, 4, 2048)        0
  07/13/2019 18:07:21 VERBOSE  _________________________________________________________________
  07/13/2019 18:07:21 VERBOSE  pixel_shuffler_7 (PixelShuff (None, 8, 8, 512)         0
  07/13/2019 18:07:21 VERBOSE  =================================================================
  07/13/2019 18:07:21 VERBOSE  Total params: 69,662,976
  07/13/2019 18:07:21 VERBOSE  Trainable params: 69,662,976
  07/13/2019 18:07:21 VERBOSE  Non-trainable params: 0
  07/13/2019 18:07:21 VERBOSE  _________________________________________________________________
  07/13/2019 18:07:21 VERBOSE  Using DSSIM Loss
  07/13/2019 18:07:21 INFO     Loading Trainer from Original plugin...
  07/13/2019 18:07:21 VERBOSE  Loading config: 'C:\Users\greenblue\faceswap\config\train.ini'
  2019-07-13 18:07:22.944550: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1512] Adding visible gpu devices: 0
  2019-07-13 18:07:22.944807: I tensorflow/core/common_runtime/gpu/gpu_device.cc:984] Device interconnect StreamExecutor with strength 1 edge matrix:
  2019-07-13 18:07:22.944964: I tensorflow/core/common_runtime/gpu/gpu_device.cc:990]      0
  2019-07-13 18:07:22.945074: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1003] 0:   N
  2019-07-13 18:07:22.945322: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1115] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 8661 MB memory) -> physical GPU (device: 0, name: GeForce RTX 2080 Ti, pci bus id: 0000:10:00.0, compute capability: 7.5)
  07/13/2019 18:07:25 INFO     Enabled TensorBoard Logging
  07/13/2019 18:07:26 WARNING  From C:\Users\greenblue\MiniConda3\envs\faceswap\lib\site-packages\tensorflow\python\ops\math_ops.py:3066: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version.\nInstructions for updating:\nUse tf.cast instead.
  2019-07-13 18:07:32.421483: I tensorflow/stream_executor/dso_loader.cc:152] successfully opened CUDA library cublas64_100.dll locally
  07/13/2019 18:07:45 INFO     [Saved models] - Average since last save: loss_A: 0.18977, loss_B: 0.10228

  System Info

  
  ============ System Information ============
  encoding:            cp949
  git_branch:          master
  git_commits:         76783dd Update links to faceswap.dev/forum
  gpu_cuda:            10.0
  gpu_cudnn:           No global version found. Check Conda packages for Conda cuDNN
  gpu_devices:         GPU_0: GeForce RTX 2080 Ti
  gpu_devices_active:  GPU_0
  gpu_driver:          411.31
  gpu_vram:            GPU_0: 11264MB
  os_machine:          AMD64
  os_platform:         Windows-10-10.0.18362-SP0
  os_release:          10
  py_command:          C:\Users\greenblue\faceswap/faceswap.py gui
  py_conda_version:    conda 4.7.5
  py_implementation:   CPython
  py_version:          3.6.8
  py_virtual_env:      True
  sys_cores:           8
  sys_processor:       AMD64 Family 23 Model 17 Stepping 0, AuthenticAMD
  sys_ram:             Total: 65464MB, Available: 53604MB, Used: 11859MB, Free: 53604MB

=============== Pip Packages =============== absl-py==0.7.1 astor==0.7.1 certifi==2019.6.16 cloudpickle==1.2.1 cycler==0.10.0 cytoolz==0.9.0.1 dask==2.1.0 decorator==4.4.0 fastcluster==1.1.25 ffmpy==0.2.2 gast==0.2.2 grpcio==1.16.1 h5py==2.9.0 imageio==2.5.0 imageio-ffmpeg==0.3.0 joblib==0.13.2 Keras==2.2.4 Keras-Applications==1.0.8 Keras-Preprocessing==1.1.0 kiwisolver==1.1.0 Markdown==3.1.1 matplotlib==2.2.2 mkl-fft==1.0.12 mkl-random==1.0.2 mkl-service==2.0.2 mock==3.0.5 networkx==2.3 numpy==1.16.2 nvidia-ml-py3==7.352.0 olefile==0.46 pathlib==1.0.1 Pillow==6.0.0 protobuf==3.8.0 psutil==5.6.3 pyparsing==2.4.0 pyreadline==2.1 python-dateutil==2.8.0 pytz==2019.1 PyWavelets==1.0.3 pywin32==223 PyYAML==5.1.1 scikit-image==0.15.0 scikit-learn==0.21.2 scipy==1.2.1 six==1.12.0 tensorboard==1.13.1 tensorflow==1.13.1 tensorflow-estimator==1.13.0 termcolor==1.1.0 toolz==0.9.0 toposort==1.5 tornado==6.0.3 tqdm==4.32.1 Werkzeug==0.15.4 wincertstore==0.2

============== Conda Packages ==============

packages in environment at C:\Users\greenblue\MiniConda3\envs\faceswap:

#

Name Version Build Channel

_tflow_select 2.1.0 gpu
absl-py 0.7.1 py36_0
astor 0.7.1 py36_0
blas 1.0 mkl
ca-certificates 2019.5.15 0
certifi 2019.6.16 py36_0
cloudpickle 1.2.1 py_0
cudatoolkit 10.0.130 0
cudnn 7.6.0 cuda10.0_0
cycler 0.10.0 py36h009560c_0
cytoolz 0.9.0.1 py36hfa6e2cd_1
dask-core 2.1.0 py_0
decorator 4.4.0 py36_1
fastcluster 1.1.25 py36h830ac7b_1000 conda-forge ffmpeg 4.1.3 h6538335_0 conda-forge ffmpy 0.2.2 pypi_0 pypi freetype 2.9.1 ha9979f8_1
gast 0.2.2 py36_0
grpcio 1.16.1 py36h351948d_1
h5py 2.9.0 py36h5e291fa_0
hdf5 1.10.4 h7ebc959_0
icc_rt 2019.0.0 h0cc432a_1
icu 58.2 ha66f8fd_1
imageio 2.5.0 py36_0
imageio-ffmpeg 0.3.0 py_0 conda-forge intel-openmp 2019.4 245
joblib 0.13.2 py36_0
jpeg 9c hfa6e2cd_1001 conda-forge keras 2.2.4 0
keras-applications 1.0.8 py_0
keras-base 2.2.4 py36_0
keras-preprocessing 1.1.0 py_1
kiwisolver 1.1.0 py36ha925a31_0
libblas 3.8.0 8_mkl conda-forge libcblas 3.8.0 8_mkl conda-forge liblapack 3.8.0 8_mkl conda-forge liblapacke 3.8.0 8_mkl conda-forge libmklml 2019.0.3 0
libpng 1.6.37 h7602738_0 conda-forge libprotobuf 3.8.0 h7bd577a_0
libtiff 4.0.10 h6512ee2_1003 conda-forge libwebp 1.0.2 hfa6e2cd_2 conda-forge lz4-c 1.8.3 he025d50_1001 conda-forge markdown 3.1.1 py36_0
matplotlib 2.2.2 py36had4c4a9_2
mkl 2019.4 245
mkl-service 2.0.2 py36he774522_0
mkl_fft 1.0.12 py36h14836fe_0
mkl_random 1.0.2 py36h343c172_0
mock 3.0.5 py36_0
networkx 2.3 py_0
numpy 1.16.2 py36h19fb1c0_0
numpy-base 1.16.2 py36hc3f5095_0
nvidia-ml-py3 7.352.0 pypi_0 pypi olefile 0.46 py36_0
opencv 4.1.0 py36hb4945ee_5 conda-forge openssl 1.1.1c he774522_1
pathlib 1.0.1 py36_1
pillow 6.0.0 py36hdc69c19_0
pip 19.1.1 py36_0
protobuf 3.8.0 py36h33f27b4_0
psutil 5.6.3 py36he774522_0
pyparsing 2.4.0 py_0
pyqt 5.9.2 py36h6538335_2
pyreadline 2.1 py36_1
python 3.6.8 h9f7ef89_7
python-dateutil 2.8.0 py36_0
pytz 2019.1 py_0
pywavelets 1.0.3 py36h8c2d366_1
pywin32 223 py36hfa6e2cd_1
pyyaml 5.1.1 py36he774522_0
qt 5.9.7 hc6833c9_1 conda-forge scikit-image 0.15.0 py36ha925a31_0
scikit-learn 0.21.2 py36h6288b17_0
scipy 1.2.1 py36h29ff71c_0
setuptools 41.0.1 py36_0
sip 4.19.8 py36h6538335_0
six 1.12.0 py36_0
sqlite 3.28.0 he774522_0
tensorboard 1.13.1 py36h33f27b4_0
tensorflow 1.13.1 gpu_py36h9006a92_0
tensorflow-base 1.13.1 gpu_py36h871c8ca_0
tensorflow-estimator 1.13.0 py_0
tensorflow-gpu 1.13.1 h0d30ee6_0
termcolor 1.1.0 py36_1
tk 8.6.8 hfa6e2cd_0
toolz 0.9.0 py36_0
toposort 1.5 py_3 conda-forge tornado 6.0.3 py36he774522_0
tqdm 4.32.1 py_0
vc 14.1 h0510ff6_4
vs2015_runtime 14.15.26706 h3a45250_4
werkzeug 0.15.4 py_0
wheel 0.33.4 py36_0
wincertstore 0.2 py36h7fe50ca_0
xz 5.2.4 h2fa13f4_1001 conda-forge yaml 0.1.7 hc54c509_2
zlib 1.2.11 h2fa13f4_1004 conda-forge zstd 1.4.0 hd8a0e53_0 conda-forge

[gblue1223]

I've changed cuDNN library to 7.5.1.10 and the GPU utilization rate has increased to 70%. But CPU utilization rate is still 100%.

EDIT: I terminated the training for a while and resumed it few minutes ago. Guess what.. GPU utilization rate almost idle. CPU 100%. What's wrong???

[torzdf]

Windows does not report GPU usage properly for Machine Learning. It is tuned to graphics performance. Use Nvidia SMI.

[gblue1223]

Wow, sounds wear me out. Damn Windows... Thanks @torzdf !!!