lancopku / DPGAN

Diversity-Promoting Generative Adversarial Network for Generating Informative and Diversified Text (EMNLP2018)
146 stars 38 forks source link

Failed to load checkpoint #1

Open Yaoming95 opened 6 years ago

Yaoming95 commented 6 years ago

Hi! When I run python main.py with default settings, the console prints:

(/home/ymzhu/anaconda2/envs/tf3) ymzhu@yuncao-All-Series:~/Desktop/code/DPGAN-master$ python main.py 
INFO:tensorflow:Starting running in train mode...
max_size of vocab was specified as 50000; we now have 50000 words. Stopping reading.
Finished constructing vocabulary of 50000 total words. Last word added: westbrook
Start pre-training......
INFO:tensorflow:Building generator graph...
INFO:tensorflow:Tensor("seq2seq/embedding/concat:0", shape=(64, ?, 512), dtype=float32, device=/device:GPU:0)
INFO:tensorflow:Time to build graph: 22 seconds
2018-02-26 10:48:03.203934: W tensorflow/core/platform/cpu_feature_guard.cc:45] The TensorFlow library wasn't compiled to use SSE4.1 instructions, but these are available on your machine and could speed up CPU computations.
2018-02-26 10:48:03.203959: W tensorflow/core/platform/cpu_feature_guard.cc:45] The TensorFlow library wasn't compiled to use SSE4.2 instructions, but these are available on your machine and could speed up CPU computations.
2018-02-26 10:48:03.203965: W tensorflow/core/platform/cpu_feature_guard.cc:45] The TensorFlow library wasn't compiled to use AVX instructions, but these are available on your machine and could speed up CPU computations.
2018-02-26 10:48:03.203970: W tensorflow/core/platform/cpu_feature_guard.cc:45] The TensorFlow library wasn't compiled to use AVX2 instructions, but these are available on your machine and could speed up CPU computations.
2018-02-26 10:48:03.203976: W tensorflow/core/platform/cpu_feature_guard.cc:45] The TensorFlow library wasn't compiled to use FMA instructions, but these are available on your machine and could speed up CPU computations.
INFO:tensorflow:Failed to load checkpoint from myexperiment/train-generator. Sleeping for 10 secs...
INFO:tensorflow:Failed to load checkpoint from myexperiment/myexperiment/train-generator. Sleeping for 10 secs...
INFO:tensorflow:Failed to load checkpoint from myexperiment/myexperiment/myexperiment/train-generator. Sleeping for 10 secs...
INFO:tensorflow:Failed to load checkpoint from myexperiment/myexperiment/myexperiment/myexperiment/train-generator. Sleeping for 10 secs...
INFO:tensorflow:Failed to load checkpoint from myexperiment/myexperiment/myexperiment/myexperiment/myexperiment/train-generator. Sleeping for 10 secs...
INFO:tensorflow:Failed to load checkpoint from myexperiment/myexperiment/myexperiment/myexperiment/myexperiment/myexperiment/train-generator. Sleeping for 10 secs...
INFO:tensorflow:Failed to load checkpoint from myexperiment/myexperiment/myexperiment/myexperiment/myexperiment/myexperiment/myexperiment/train-generator. Sleeping for 10 secs...
INFO:tensorflow:Failed to load checkpoint from myexperiment/myexperiment/myexperiment/myexperiment/myexperiment/myexperiment/myexperiment/myexperiment/train-generator. Sleeping for 10 secs...
INFO:tensorflow:Failed to load checkpoint from myexperiment/myexperiment/myexperiment/myexperiment/myexperiment/myexperiment/myexperiment/myexperiment/myexperiment/train-generator. Sleeping for 10 secs...

Seems it won't stop. How could I solve it? Thank you!

loretoparisi commented 6 years ago

I have the same issue with a concatenation of string like that

INFO:tensorflow:Failed to load checkpoint from myexperiment/myexperiment/myexperiment/myexperiment/myexperiment/myexperiment/myexperiment/myexperiment/myexperiment/myexperiment/myexperiment/myexperiment/myexperiment/myexperiment/myexperiment/myexperiment/myexperiment/myexperiment/myexperiment/myexperiment/myexperiment/myexperiment/myexperiment/myexperiment/myexperiment/myexperiment/myexperiment/myexperiment/myexperiment/myexperiment/myexperiment/myexperiment/myexperiment/myexperiment/myexperiment/myexperiment/myexperiment/myexperiment/myexperiment/myexperiment/myexperiment/myexperiment/myexperiment/myexperiment/myexperiment/myexperiment/myexperiment/myexperiment/myexperiment/myexperiment/myexperiment/myexperiment/myexperiment/myexperiment/myexperiment/myexperiment/myexperiment/myexperiment/myexperiment/myexperiment/myexperiment/myexperiment/myexperiment/myexperiment/myexperiment/myexperiment/myexperiment/myexperiment/myexperiment/myexperiment/myexperiment/myexperiment/myexperiment/myexperiment/myexperiment/myexperiment/myexperiment/myexperiment/myexperiment/myexperiment/myexperiment/myexperiment/myexperiment/myexperiment/myexperiment/myexperiment/myexperiment/myexperiment/myexperiment/myexperiment/myexperiment/train-generator. Sleeping for 10 secs...

I have changed in main.py:

tf.app.flags.DEFINE_string('log_root', './', 'Root directory for all logging.')

and added

if __name__ == '__main__':
    nltk.download('punkt')
    tf.app.run()
jingjingxupku commented 6 years ago

Thanks for your feedback! Problem was fixed. Please update the code and run it again.

akhileshkumargangwar commented 6 years ago

Hi, I also got same problem.Did this code work properly.When I executed it is showing many problems. Is there any updated code?

INFO:tensorflow:Building graph... WARNING:tensorflow:<tensorflow.python.ops.rnn_cell_impl.LSTMCell object at 0x7f5684060048>: Using a concatenated state is slower and will soon be deprecated. Use state_is_tuple=True. INFO:tensorflow:Time to build graph: 2 seconds 2018-08-21 09:32:51.744436: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1045] Creating TensorFlow device (/gpu:0) -> (device: 0, name: Quadro P5000, pci bus id: 0000:02:00.0) INFO:tensorflow:Failed to load checkpoint from ./myexperiment/train-discriminator. Sleeping for 10 secs... INFO:tensorflow:Failed to load checkpoint from ./myexperiment/./myexperiment/train-discriminator. Sleeping for 10 secs... INFO:tensorflow:Failed to load checkpoint from ./myexperiment/./myexperiment/./myexperiment/train-discriminator. Sleeping for 10 secs... INFO:tensorflow:Failed to load checkpoint from ./myexperiment/./myexperiment/./myexperiment/./myexperiment/train-discriminator. Sleeping for 10 secs...

jingjingxupku commented 6 years ago

I do not meet this problem at the latest version. Please download the latest version.