search

pbhatia243 / Neural_Conversation_Models

Tensorflow based Neural Conversation Models
Apache License 2.0
191 stars 73 forks source link

how long the training takes with .... #6

Closed SeekPoint closed 7 years ago

SeekPoint commented 7 years ago

python neural_conversation_model.py --train_dir ubuntu/ --en_vocab_size 60000 --size 512 --data_path ubuntu/train.tsv --dev_data ubuntu/valid.tsv --vocab_path ubuntu/60k_vocan.en --attention

right now, it takes 3 days with a GTX1080 8G

Running epochs global step 372800 learning rate 0.1905 step-time 0.91 perplexity 1.00 eval: bucket 0 perplexity 15943204.21 eval: bucket 1 perplexity 12256693.99 eval: bucket 2 perplexity 4716758.96 eval: bucket 3 perplexity 46789217.08 Running epochs global step 373200 learning rate 0.1905 step-time 1.04 perplexity 1.00

SeekPoint commented 7 years ago

right now, with 3 days gtx 1080, it reaches: global step 336000 learning rate 0.2086 step-time 0.37 perplexity 1.00 eval: bucket 0 perplexity 12841500.01 eval: bucket 1 perplexity 13475859.35 eval: bucket 2 perplexity 33048668.01 eval: bucket 3 perplexity 5675569.78

How can I elegantly exit or How long it takes to done normally?

pbhatia243 commented 7 years ago

2 - 3 days on GPU