search

marriott-library / sheeko-vagrant

8 stars 2 forks source link

Captions are strange #3

Open AaratiAkkapeddi opened 2 years ago

AaratiAkkapeddi commented 2 years ago

Hi, I am running a test with one of the demo images (sheeko_demo_1.jpg) and get the following captions:

 Captions for image sheeko_demo_1.jpg:
  0) <S> on . table (p=0.043432)
  1) <S> on (p=0.040940)
  2) ripening (p=0.026671)

Do you think there might be something wrong with my installation of regex or nltk? Or perhaps my word_counts.txt file? Would you be able to provide the word_counts file you used for the demo?

AaratiAkkapeddi commented 2 years ago

Here is the logs that were in the command line:

vagrant@ubuntu-bionic:/vagrant/inference/caption$ python caption_inference_test.py
WARNING:tensorflow:
The TensorFlow contrib module will not be included in TensorFlow 2.0.
For more information, please see:
  * https://github.com/tensorflow/community/blob/master/rfcs/20180907-contrib-sunset.md
  * https://github.com/tensorflow/addons
  * https://github.com/tensorflow/io (for I/O related ops)
If you depend on functionality not listed there, please file an issue.

WARNING:tensorflow:From ../../library/run_inference_demo.py:43: The name tf.logging.set_verbosity is deprecated. Please use tf.compat.v1.logging.set_verbosity instead.

WARNING:tensorflow:From ../../library/run_inference_demo.py:43: The name tf.logging.INFO is deprecated. Please use tf.compat.v1.logging.INFO instead.

WARNING:tensorflow:From ../../library/run_inference_demo.py:86: The name tf.app.run is deprecated. Please use tf.compat.v1.app.run instead.

WARNING:tensorflow:From /vagrant/library/inference_utils/inference_wrapper_base.py:114: The name tf.logging.info is deprecated. Please use tf.compat.v1.logging.info instead.

W0807 02:57:00.186578 140176923359040 module_wrapper.py:139] From /vagrant/library/inference_utils/inference_wrapper_base.py:114: The name tf.logging.info is deprecated. Please use tf.compat.v1.logging.info instead.

INFO:tensorflow:Building model.
I0807 02:57:00.186875 140176923359040 inference_wrapper_base.py:114] Building model.
WARNING:tensorflow:From /vagrant/library/show_and_tell_model.py:55: __init__ (from tensorflow.python.ops.io_ops) is deprecated and will be removed in a future version.
Instructions for updating:
Queue-based input pipelines have been replaced by `tf.data`. Use `tf.data.TFRecordDataset`.
W0807 02:57:00.187107 140176923359040 deprecation.py:323] From /vagrant/library/show_and_tell_model.py:55: __init__ (from tensorflow.python.ops.io_ops) is deprecated and will be removed in a future version.
Instructions for updating:
Queue-based input pipelines have been replaced by `tf.data`. Use `tf.data.TFRecordDataset`.
WARNING:tensorflow:From /vagrant/library/show_and_tell_model.py:132: The name tf.placeholder is deprecated. Please use tf.compat.v1.placeholder instead.

W0807 02:57:00.188065 140176923359040 module_wrapper.py:139] From /vagrant/library/show_and_tell_model.py:132: The name tf.placeholder is deprecated. Please use tf.compat.v1.placeholder instead.

WARNING:tensorflow:From /vagrant/library/ops/image_processing.py:95: The name tf.summary.image is deprecated. Please use tf.compat.v1.summary.image instead.

W0807 02:57:00.191513 140176923359040 module_wrapper.py:139] From /vagrant/library/ops/image_processing.py:95: The name tf.summary.image is deprecated. Please use tf.compat.v1.summary.image instead.

WARNING:tensorflow:From /vagrant/library/ops/image_processing.py:111: The name tf.image.resize_images is deprecated. Please use tf.image.resize instead.

W0807 02:57:00.194179 140176923359040 module_wrapper.py:139] From /vagrant/library/ops/image_processing.py:111: The name tf.image.resize_images is deprecated. Please use tf.image.resize instead.

WARNING:tensorflow:From /vagrant/library/ops/image_processing.py:120: The name tf.image.resize_image_with_crop_or_pad is deprecated. Please use tf.image.resize_with_crop_or_pad instead.

W0807 02:57:00.197316 140176923359040 module_wrapper.py:139] From /vagrant/library/ops/image_processing.py:120: The name tf.image.resize_image_with_crop_or_pad is deprecated. Please use tf.image.resize_with_crop_or_pad instead.

WARNING:tensorflow:From /vagrant/library/ops/image_embedding.py:87: The name tf.variable_scope is deprecated. Please use tf.compat.v1.variable_scope instead.

W0807 02:57:00.209486 140176923359040 module_wrapper.py:139] From /vagrant/library/ops/image_embedding.py:87: The name tf.variable_scope is deprecated. Please use tf.compat.v1.variable_scope instead.

WARNING:tensorflow:From /usr/local/lib/python2.7/dist-packages/tensorflow_core/contrib/layers/python/layers/layers.py:1057: apply (from tensorflow.python.keras.engine.base_layer) is deprecated and will be removed in a future version.
Instructions for updating:
Please use `layer.__call__` method instead.
W0807 02:57:00.210927 140176923359040 deprecation.py:323] From /usr/local/lib/python2.7/dist-packages/tensorflow_core/contrib/layers/python/layers/layers.py:1057: apply (from tensorflow.python.keras.engine.base_layer) is deprecated and will be removed in a future version.
Instructions for updating:
Please use `layer.__call__` method instead.
WARNING:tensorflow:From /usr/local/lib/python2.7/dist-packages/tensorflow_core/contrib/layers/python/layers/layers.py:1634: flatten (from tensorflow.python.layers.core) is deprecated and will be removed in a future version.
Instructions for updating:
Use keras.layers.flatten instead.
W0807 02:57:01.725938 140176923359040 deprecation.py:323] From /usr/local/lib/python2.7/dist-packages/tensorflow_core/contrib/layers/python/layers/layers.py:1634: flatten (from tensorflow.python.layers.core) is deprecated and will be removed in a future version.
Instructions for updating:
Use keras.layers.flatten instead.
WARNING:tensorflow:From /usr/local/lib/python2.7/dist-packages/tensorflow_core/contrib/layers/python/layers/summaries.py:95: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version.
Instructions for updating:
Use `tf.cast` instead.
W0807 02:57:01.729772 140176923359040 deprecation.py:323] From /usr/local/lib/python2.7/dist-packages/tensorflow_core/contrib/layers/python/layers/summaries.py:95: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version.
Instructions for updating:
Use `tf.cast` instead.
WARNING:tensorflow:From /vagrant/library/show_and_tell_model.py:194: The name tf.get_collection is deprecated. Please use tf.compat.v1.get_collection instead.

W0807 02:57:01.749860 140176923359040 module_wrapper.py:139] From /vagrant/library/show_and_tell_model.py:194: The name tf.get_collection is deprecated. Please use tf.compat.v1.get_collection instead.

WARNING:tensorflow:From /vagrant/library/show_and_tell_model.py:195: The name tf.GraphKeys is deprecated. Please use tf.compat.v1.GraphKeys instead.

W0807 02:57:01.750077 140176923359040 module_wrapper.py:139] From /vagrant/library/show_and_tell_model.py:195: The name tf.GraphKeys is deprecated. Please use tf.compat.v1.GraphKeys instead.

WARNING:tensorflow:From /vagrant/library/show_and_tell_model.py:222: The name tf.get_variable is deprecated. Please use tf.compat.v1.get_variable instead.

W0807 02:57:01.757591 140176923359040 module_wrapper.py:139] From /vagrant/library/show_and_tell_model.py:222: The name tf.get_variable is deprecated. Please use tf.compat.v1.get_variable instead.

WARNING:tensorflow:From /vagrant/library/show_and_tell_model.py:248: __init__ (from tensorflow.python.ops.rnn_cell_impl) is deprecated and will be removed in a future version.
Instructions for updating:
This class is equivalent as tf.keras.layers.LSTMCell, and will be replaced by that in Tensorflow 2.0.
W0807 02:57:01.763829 140176923359040 deprecation.py:323] From /vagrant/library/show_and_tell_model.py:248: __init__ (from tensorflow.python.ops.rnn_cell_impl) is deprecated and will be removed in a future version.
Instructions for updating:
This class is equivalent as tf.keras.layers.LSTMCell, and will be replaced by that in Tensorflow 2.0.
WARNING:tensorflow:From /usr/local/lib/python2.7/dist-packages/tensorflow_core/python/ops/rnn_cell_impl.py:735: add_variable (from tensorflow.python.keras.engine.base_layer) is deprecated and will be removed in a future version.
Instructions for updating:
Please use `layer.add_weight` method instead.
W0807 02:57:01.770709 140176923359040 deprecation.py:323] From /usr/local/lib/python2.7/dist-packages/tensorflow_core/python/ops/rnn_cell_impl.py:735: add_variable (from tensorflow.python.keras.engine.base_layer) is deprecated and will be removed in a future version.
Instructions for updating:
Please use `layer.add_weight` method instead.
WARNING:tensorflow:From /usr/local/lib/python2.7/dist-packages/tensorflow_core/python/ops/rnn_cell_impl.py:739: calling __init__ (from tensorflow.python.ops.init_ops) with dtype is deprecated and will be removed in a future version.
Instructions for updating:
Call initializer instance with the dtype argument instead of passing it to the constructor
W0807 02:57:01.776062 140176923359040 deprecation.py:506] From /usr/local/lib/python2.7/dist-packages/tensorflow_core/python/ops/rnn_cell_impl.py:739: calling __init__ (from tensorflow.python.ops.init_ops) with dtype is deprecated and will be removed in a future version.
Instructions for updating:
Call initializer instance with the dtype argument instead of passing it to the constructor
WARNING:tensorflow:From /vagrant/library/inference_utils/inference_wrapper_base.py:116: The name tf.train.Saver is deprecated. Please use tf.compat.v1.train.Saver instead.

W0807 02:57:01.809784 140176923359040 module_wrapper.py:139] From /vagrant/library/inference_utils/inference_wrapper_base.py:116: The name tf.train.Saver is deprecated. Please use tf.compat.v1.train.Saver instead.

WARNING:tensorflow:From /vagrant/library/inference_utils/inference_wrapper_base.py:89: The name tf.gfile.IsDirectory is deprecated. Please use tf.io.gfile.isdir instead.

W0807 02:57:02.011343 140176923359040 module_wrapper.py:139] From /vagrant/library/inference_utils/inference_wrapper_base.py:89: The name tf.gfile.IsDirectory is deprecated. Please use tf.io.gfile.isdir instead.

WARNING:tensorflow:From /vagrant/library/inference_utils/vocabulary.py:43: The name tf.gfile.Exists is deprecated. Please use tf.io.gfile.exists instead.

W0807 02:57:02.018503 140176923359040 module_wrapper.py:139] From /vagrant/library/inference_utils/vocabulary.py:43: The name tf.gfile.Exists is deprecated. Please use tf.io.gfile.exists instead.

INFO:tensorflow:Initializing vocabulary from file: ../../models/word_counts_mscoco.txt
I0807 02:57:02.018791 140176923359040 vocabulary.py:45] Initializing vocabulary from file: ../../models/word_counts_mscoco.txt
WARNING:tensorflow:From /vagrant/library/inference_utils/vocabulary.py:47: The name tf.gfile.GFile is deprecated. Please use tf.io.gfile.GFile instead.

W0807 02:57:02.019323 140176923359040 module_wrapper.py:139] From /vagrant/library/inference_utils/vocabulary.py:47: The name tf.gfile.GFile is deprecated. Please use tf.io.gfile.GFile instead.

INFO:tensorflow:Created vocabulary with 11732 words
I0807 02:57:02.101455 140176923359040 vocabulary.py:56] Created vocabulary with 11732 words
WARNING:tensorflow:From ../../library/run_inference_demo.py:60: The name tf.gfile.Glob is deprecated. Please use tf.io.gfile.glob instead.

W0807 02:57:02.101831 140176923359040 module_wrapper.py:139] From ../../library/run_inference_demo.py:60: The name tf.gfile.Glob is deprecated. Please use tf.io.gfile.glob instead.

INFO:tensorflow:Running caption generation on 1 files matching ../../sheeko_demo_4.jpg
I0807 02:57:02.109616 140176923359040 run_inference_demo.py:62] Running caption generation on 1 files matching ../../sheeko_demo_4.jpg
WARNING:tensorflow:From ../../library/run_inference_demo.py:64: The name tf.Session is deprecated. Please use tf.compat.v1.Session instead.

W0807 02:57:02.109915 140176923359040 module_wrapper.py:139] From ../../library/run_inference_demo.py:64: The name tf.Session is deprecated. Please use tf.compat.v1.Session instead.

2022-08-07 02:57:02.110871: I tensorflow/core/platform/cpu_feature_guard.cc:142] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2
2022-08-07 02:57:02.115584: I tensorflow/core/platform/profile_utils/cpu_utils.cc:94] CPU Frequency: 2207995000 Hz
2022-08-07 02:57:02.116171: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x55d2d1da4930 initialized for platform Host (this does not guarantee that XLA will be used). Devices:
2022-08-07 02:57:02.116202: I tensorflow/compiler/xla/service/service.cc:176]   StreamExecutor device (0): Host, Default Version
INFO:tensorflow:Loading model from checkpoint: ../../models/ptm-im2txt-incv3-mlib-cleaned-3m/train/model.ckpt-3000000
I0807 02:57:02.116569 140176923359040 inference_wrapper_base.py:95] Loading model from checkpoint: ../../models/ptm-im2txt-incv3-mlib-cleaned-3m/train/model.ckpt-3000000
INFO:tensorflow:Restoring parameters from ../../models/ptm-im2txt-incv3-mlib-cleaned-3m/train/model.ckpt-3000000
I0807 02:57:02.121407 140176923359040 saver.py:1284] Restoring parameters from ../../models/ptm-im2txt-incv3-mlib-cleaned-3m/train/model.ckpt-3000000
INFO:tensorflow:Successfully loaded checkpoint: model.ckpt-3000000
I0807 02:57:02.914499 140176923359040 inference_wrapper_base.py:98] Successfully loaded checkpoint: model.ckpt-3000000
Captions for image sheeko_demo_4.jpg:
  0)  (p=0.200012)
  1) the in (p=0.113586)
  2) the . (p=0.032757)
Caption Generating Demo Completed!
Press any key to quit