sohrabsaran
commented
6 years ago Open sohrabsaran opened 6 years ago
sohrabsaran
commented
6 years ago 
afrozenator
commented
6 years ago t2t-trainer should be in the bin/ folder, you may need to navigate there or give the full path.
Let me know.
On Sat, Sep 8, 2018, 10:41 PM Sohrab Saran notifications@github.com wrote:
pip install tensor2tensor && t2t-trainer \
--generate_data --data_dir=/t2t_data --output_dir=/t2t_train/mnist --problem=image_mnist --model=shake_shake --hparams_set=shake_shake_quick --train_steps=1000 --eval_steps=100
Collecting tensor2tensor Downloading https://files.pythonhosted.org/packages/0f/ea/10716cd32714ac047adf81012c7265b2b132f9f56721be0736699baa025c/tensor2tensor-1.9.0-py2.py3-none-any.whl (1.0MB) 100% |████████████████████████████████| 1.0MB 756kB/s Collecting six (from tensor2tensor) Downloading https://files.pythonhosted.org/packages/67/4b/141a581104b1f6397bfa78ac9d43d8ad29a7ca43ea90a2d863fe3056e86a/six-1.11.0-py2.py3-none-any.whl Collecting numpy (from tensor2tensor) Downloading https://files.pythonhosted.org/packages/c9/16/1134977cc35d2f72dbe80efa75a8e989ac21289f8e7e2c9005444cd17cd5/numpy-1.15.1-cp27-cp27mu-manylinux1_x86_64.whl (13.8MB) 100% |████████████████████████████████| 13.8MB 78kB/s Collecting requests (from tensor2tensor) Downloading https://files.pythonhosted.org/packages/65/47/7e02164a2a3db50ed6d8a6ab1d6d60b69c4c3fdf57a284257925dfc12bda/requests-2.19.1-py2.py3-none-any.whl (91kB) 100% |████████████████████████████████| 92kB 2.7MB/s Collecting flask (from tensor2tensor) Downloading https://files.pythonhosted.org/packages/7f/e7/08578774ed4536d3242b14dacb4696386634607af824ea997202cd0edb4b/Flask-1.0.2-py2.py3-none-any.whl (91kB) 100% |████████████████████████████████| 92kB 2.9MB/s Collecting gunicorn (from tensor2tensor) Downloading https://files.pythonhosted.org/packages/8c/da/b8dd8deb741bff556db53902d4706774c8e1e67265f69528c14c003644e6/gunicorn-19.9.0-py2.py3-none-any.whl (112kB) 100% |████████████████████████████████| 122kB 1.0MB/s Collecting oauth2client (from tensor2tensor) Downloading https://files.pythonhosted.org/packages/95/a9/4f25a14d23f0786b64875b91784607c2277eff25d48f915e39ff0cff505a/oauth2client-4.1.3-py2.py3-none-any.whl (98kB) 100% |████████████████████████████████| 102kB 1.4MB/s Collecting google-api-python-client (from tensor2tensor) Downloading https://files.pythonhosted.org/packages/4e/92/e4746e646585c8c359781c19984fe8b6b8794a6cfe382cd481329d5252ac/google-api-python-client-1.7.4.tar.gz (141kB) 100% |████████████████████████████████| 143kB 833kB/s Collecting tqdm (from tensor2tensor) Downloading https://files.pythonhosted.org/packages/c7/e0/52b2faaef4fd87f86eb8a8f1afa2cd6eb11146822033e29c04ac48ada32c/tqdm-4.25.0-py2.py3-none-any.whl (43kB) 100% |████████████████████████████████| 51kB 1.1MB/s Collecting bz2file (from tensor2tensor) Downloading https://files.pythonhosted.org/packages/61/39/122222b5e85cd41c391b68a99ee296584b2a2d1d233e7ee32b4532384f2d/bz2file-0.98.tar.gz Collecting gevent (from tensor2tensor) Downloading https://files.pythonhosted.org/packages/d7/73/0c6e0feed7ff81b2d14ebc4205cb15264fe00235cf68051a5273bcfc2553/gevent-1.3.6-cp27-cp27mu-manylinux1_x86_64.whl (4.2MB) 100% |████████████████████████████████| 4.2MB 166kB/s Collecting sympy (from tensor2tensor) Downloading https://files.pythonhosted.org/packages/b0/47/54f3a752f3b88b9487f38e5e6b7bb96e0b60286b50fd818999f1ffead0cc/sympy-1.2.tar.gz (5.4MB) 100% |████████████████████████████████| 5.4MB 126kB/s Collecting gym (from tensor2tensor) Downloading https://files.pythonhosted.org/packages/9b/50/ed4a03d2be47ffd043be2ee514f329ce45d98a30fe2d1b9c61dea5a9d861/gym-0.10.5.tar.gz (1.5MB) 100% |████████████████████████████████| 1.5MB 570kB/s Collecting h5py (from tensor2tensor) Downloading https://files.pythonhosted.org/packages/33/0c/1c5dfa85e05052aa5f50969d87c67a2128dc39a6f8ce459a503717e56bd0/h5py-2.8.0-cp27-cp27mu-manylinux1_x86_64.whl (2.7MB) 100% |████████████████████████████████| 2.7MB 331kB/s Collecting scipy (from tensor2tensor) Downloading https://files.pythonhosted.org/packages/2a/f3/de9c1bd16311982711209edaa8c6caa962db30ebb6a8cc6f1dcd2d3ef616/scipy-1.1.0-cp27-cp27mu-manylinux1_x86_64.whl (30.8MB) 100% |████████████████████████████████| 30.8MB 34kB/s Collecting future (from tensor2tensor) Downloading https://files.pythonhosted.org/packages/00/2b/8d082ddfed935f3608cc61140df6dcbf0edea1bc3ab52fb6c29ae3e81e85/future-0.16.0.tar.gz (824kB) 100% |████████████████████████████████| 829kB 755kB/s Collecting idna<2.8,>=2.5 (from requests->tensor2tensor) Downloading https://files.pythonhosted.org/packages/4b/2a/0276479a4b3caeb8a8c1af2f8e4355746a97fab05a372e4a2c6a6b876165/idna-2.7-py2.py3-none-any.whl (58kB) 100% |████████████████████████████████| 61kB 2.0MB/s Collecting certifi>=2017.4.17 (from requests->tensor2tensor) Downloading https://files.pythonhosted.org/packages/df/f7/04fee6ac349e915b82171f8e23cee63644d83663b34c539f7a09aed18f9e/certifi-2018.8.24-py2.py3-none-any.whl (147kB) 100% |████████████████████████████████| 153kB 2.1MB/s Collecting chardet<3.1.0,>=3.0.2 (from requests->tensor2tensor) Downloading https://files.pythonhosted.org/packages/bc/a9/01ffebfb562e4274b6487b4bb1ddec7ca55ec7510b22e4c51f14098443b8/chardet-3.0.4-py2.py3-none-any.whl (133kB) 100% |████████████████████████████████| 143kB 1.6MB/s Collecting urllib3<1.24,>=1.21.1 (from requests->tensor2tensor) Downloading https://files.pythonhosted.org/packages/bd/c9/6fdd990019071a4a32a5e7cb78a1d92c53851ef4f56f62a3486e6a7d8ffb/urllib3-1.23-py2.py3-none-any.whl (133kB) 100% |████████████████████████████████| 143kB 2.3MB/s Collecting Werkzeug>=0.14 (from flask->tensor2tensor) Downloading https://files.pythonhosted.org/packages/20/c4/12e3e56473e52375aa29c4764e70d1b8f3efa6682bef8d0aae04fe335243/Werkzeug-0.14.1-py2.py3-none-any.whl (322kB) 100% |████████████████████████████████| 327kB 1.3MB/s Collecting click>=5.1 (from flask->tensor2tensor) Downloading https://files.pythonhosted.org/packages/34/c1/8806f99713ddb993c5366c362b2f908f18269f8d792aff1abfd700775a77/click-6.7-py2.py3-none-any.whl (71kB) 100% |████████████████████████████████| 71kB 2.1MB/s Collecting Jinja2>=2.10 (from flask->tensor2tensor) Downloading https://files.pythonhosted.org/packages/7f/ff/ae64bacdfc95f27a016a7bed8e8686763ba4d277a78ca76f32659220a731/Jinja2-2.10-py2.py3-none-any.whl (126kB) 100% |████████████████████████████████| 133kB 768kB/s Collecting itsdangerous>=0.24 (from flask->tensor2tensor) Downloading https://files.pythonhosted.org/packages/dc/b4/a60bcdba945c00f6d608d8975131ab3f25b22f2bcfe1dab221165194b2d4/itsdangerous-0.24.tar.gz (46kB) 100% |████████████████████████████████| 51kB 2.2MB/s Collecting httplib2>=0.9.1 (from oauth2client->tensor2tensor) Downloading https://files.pythonhosted.org/packages/fd/ce/aa4a385e3e9fd351737fd2b07edaa56e7a730448465aceda6b35086a0d9b/httplib2-0.11.3.tar.gz (215kB) 100% |████████████████████████████████| 225kB 2.1MB/s Collecting rsa>=3.1.4 (from oauth2client->tensor2tensor) Downloading https://files.pythonhosted.org/packages/e1/ae/baedc9cb175552e95f3395c43055a6a5e125ae4d48a1d7a924baca83e92e/rsa-3.4.2-py2.py3-none-any.whl (46kB) 100% |████████████████████████████████| 51kB 1.9MB/s Collecting pyasn1>=0.1.7 (from oauth2client->tensor2tensor) Downloading https://files.pythonhosted.org/packages/d1/a1/7790cc85db38daa874f6a2e6308131b9953feb1367f2ae2d1123bb93a9f5/pyasn1-0.4.4-py2.py3-none-any.whl (72kB) 100% |████████████████████████████████| 81kB 2.8MB/s Collecting pyasn1-modules>=0.0.5 (from oauth2client->tensor2tensor) Downloading https://files.pythonhosted.org/packages/19/02/fa63f7ba30a0d7b925ca29d034510fc1ffde53264b71b4155022ddf3ab5d/pyasn1_modules-0.2.2-py2.py3-none-any.whl (62kB) 100% |████████████████████████████████| 71kB 1.2MB/s Collecting google-auth-httplib2>=0.0.3 (from google-api-python-client->tensor2tensor) Downloading https://files.pythonhosted.org/packages/33/49/c814d6d438b823441552198f096fcd0377fd6c88714dbed34f1d3c8c4389/google_auth_httplib2-0.0.3-py2.py3-none-any.whl Collecting google-auth>=1.4.1 (from google-api-python-client->tensor2tensor) Downloading https://files.pythonhosted.org/packages/58/cb/96dbb4e50e7a9d856e89cc9c8e36ab1055f9774f7d85f37e2156c1d79d9f/google_auth-1.5.1-py2.py3-none-any.whl (65kB) 100% |████████████████████████████████| 71kB 3.5MB/s Collecting uritemplate<4dev,>=3.0.0 (from google-api-python-client->tensor2tensor) Downloading https://files.pythonhosted.org/packages/f6/25/66a49231b44409d7f07cfcf2506a8b070ce3c99fc47cc256bea833f24791/uritemplate-3.0.0-py2-none-any.whl Collecting greenlet>=0.4.14; platform_python_implementation == "CPython" (from gevent->tensor2tensor) Downloading https://files.pythonhosted.org/packages/8b/6e/f2d25875713ad0885c8d3c69269697406652e6f64e1a6bd8264f7a609327/greenlet-0.4.15-cp27-cp27mu-manylinux1_x86_64.whl Collecting mpmath>=0.19 (from sympy->tensor2tensor) Downloading https://files.pythonhosted.org/packages/7a/05/b3d1472885d8dc0606936ea5da0ccb1b4785682e78ab15e34ada24aea8d5/mpmath-1.0.0.tar.gz (511kB) 100% |████████████████████████████████| 512kB 1.2MB/s Collecting pyglet>=1.2.0 (from gym->tensor2tensor) Downloading https://files.pythonhosted.org/packages/1c/fc/dad5eaaab68f0c21e2f906a94ddb98175662cc5a654eee404d59554ce0fa/pyglet-1.3.2-py2.py3-none-any.whl (1.0MB) 100% |████████████████████████████████| 1.0MB 607kB/s Collecting MarkupSafe>=0.23 (from Jinja2>=2.10->flask->tensor2tensor) Downloading https://files.pythonhosted.org/packages/4d/de/32d741db316d8fdb7680822dd37001ef7a448255de9699ab4bfcbdf4172b/MarkupSafe-1.0.tar.gz Collecting cachetools>=2.0.0 (from google-auth>=1.4.1->google-api-python-client->tensor2tensor) Downloading https://files.pythonhosted.org/packages/0a/58/cbee863250b31d80f47401d04f34038db6766f95dea1cc909ea099c7e571/cachetools-2.1.0-py2.py3-none-any.whl Building wheels for collected packages: google-api-python-client, bz2file, sympy, gym, future, itsdangerous, httplib2, mpmath, MarkupSafe Running setup.py bdist_wheel for google-api-python-client ... done Stored in directory: /home/sohrab/.cache/pip/wheels/f1/55/aa/9e8fbe2d6a43e92b3c14307194e7ff53d1ef7907613edbd661 Running setup.py bdist_wheel for bz2file ... done Stored in directory: /home/sohrab/.cache/pip/wheels/81/75/d6/e1317bf09bf1af5a30befc2a007869fa6e1f516b8f7c591cb9 Running setup.py bdist_wheel for sympy ... done Stored in directory: /home/sohrab/.cache/pip/wheels/b4/af/81/7fad05f53f1e451e8ddb4b15aa3908dc98112a9459911ebb66 Running setup.py bdist_wheel for gym ... done Stored in directory: /home/sohrab/.cache/pip/wheels/cb/14/71/f4ab006b1e6ff75c2b54985c2f98d0644fffe9c1dddc670925 Running setup.py bdist_wheel for future ... done Stored in directory: /home/sohrab/.cache/pip/wheels/bf/c9/a3/c538d90ef17cf7823fa51fc701a7a7a910a80f6a405bf15b1a Running setup.py bdist_wheel for itsdangerous ... done Stored in directory: /home/sohrab/.cache/pip/wheels/2c/4a/61/5599631c1554768c6290b08c02c72d7317910374ca602ff1e5 Running setup.py bdist_wheel for httplib2 ... done Stored in directory: /home/sohrab/.cache/pip/wheels/1b/9c/9e/1f6fdb21dbb1fe6a99101d697f12cb8c1fa96c1587df69adba Running setup.py bdist_wheel for mpmath ... done Stored in directory: /home/sohrab/.cache/pip/wheels/33/15/0f/9ca5f2ad88a5456803098daa189f382408a81556aa209e97ff Running setup.py bdist_wheel for MarkupSafe ... done Stored in directory: /home/sohrab/.cache/pip/wheels/33/56/20/ebe49a5c612fffe1c5a632146b16596f9e64676768661e4e46 Successfully built google-api-python-client bz2file sympy gym future itsdangerous httplib2 mpmath MarkupSafe Installing collected packages: six, numpy, idna, certifi, chardet, urllib3, requests, Werkzeug, click, MarkupSafe, Jinja2, itsdangerous, flask, gunicorn, httplib2, pyasn1, rsa, pyasn1-modules, oauth2client, cachetools, google-auth, google-auth-httplib2, uritemplate, google-api-python-client, tqdm, bz2file, greenlet, gevent, mpmath, sympy, future, pyglet, gym, h5py, scipy, tensor2tensor Successfully installed Jinja2-2.10 MarkupSafe-1.0 Werkzeug-0.14.1 bz2file-0.98 cachetools-2.1.0 certifi-2018.8.24 chardet-3.0.4 click-6.7 flask-1.0.2 future-0.16.0 gevent-1.3.6 google-api-python-client-1.7.4 google-auth-1.5.1 google-auth-httplib2-0.0.3 greenlet-0.4.15 gunicorn-19.9.0 gym-0.10.5 h5py-2.8.0 httplib2-0.11.3 idna-2.7 itsdangerous-0.24 mpmath-1.0.0 numpy-1.15.1 oauth2client-4.1.3 pyasn1-0.4.4 pyasn1-modules-0.2.2 pyglet-1.3.2 requests-2.19.1 rsa-3.4.2 scipy-1.1.0 six-1.11.0 sympy-1.2 tensor2tensor-1.9.0 tqdm-4.25.0 uritemplate-3.0.0 urllib3-1.23 t2t-trainer: command not found
— You are receiving this because you are subscribed to this thread. Reply to this email directly, view it on GitHub https://github.com/tensorflow/tensor2tensor/issues/1050, or mute the thread https://github.com/notifications/unsubscribe-auth/ABFCFpzjutNXe0pKAcbJlwan17K1kbDVks5uZKoegaJpZM4WgJ61 .
sohrabsaran
commented
6 years ago I'm on latest Ubuntu.
sohrab@sohrab-HP-Notebook:~/.local/bin$ ls
chardetect pasteurize pyrsa-sign t2t-insights-server
f2py pyrsa-decrypt pyrsa-verify t2t-make-tf-configs
flask pyrsa-decrypt-bigfile t2t-avg-all t2t-query-server
futurize pyrsa-encrypt t2t-bleu t2t-trainer
gunicorn pyrsa-encrypt-bigfile t2t-datagen t2t-translate-all
gunicorn_paster pyrsa-keygen t2t-decoder tqdm
isympy pyrsa-priv2pub t2t-exporterPasting the original command directly into the gnome terminal causes two lesser-than signs to appear on each line that further seems to cause various errors. Manually made the multi-line command into a single-line command as below:
sohrab@sohrab-HP-Notebook:~/.local/bin$ ./t2t-trainer --generate_data --data_dir=./t2t_data --output_dir=./t2t_train/mnist --problem=image_mnist --model=shake_shake --hparams_set=shake_shake_quick --train_steps=1000 --eval_steps=100
Traceback (most recent call last):
File "./t2t-trainer", line 23, in <module>
from tensor2tensor.bin import t2t_trainer
File "/home/sohrab/.local/lib/python2.7/site-packages/tensor2tensor/bin/t2t_trainer.py", line 23, in <module>
from tensor2tensor import models # pylint: disable=unused-import
File "/home/sohrab/.local/lib/python2.7/site-packages/tensor2tensor/models/__init__.py", line 21, in <module>
from tensor2tensor.layers import modalities # pylint: disable=g-import-not-at-top
File "/home/sohrab/.local/lib/python2.7/site-packages/tensor2tensor/layers/modalities.py", line 21, in <module>
from tensor2tensor.layers import common_layers
File "/home/sohrab/.local/lib/python2.7/site-packages/tensor2tensor/layers/common_layers.py", line 30, in <module>
import tensorflow as tf
ImportError: No module named tensorflowDoing
pip install tensorflow...and then re-running the command, resolves the above error.
kpe
commented
5 years ago I also had that problem, and it looks its related to the python 2.7 implementation of input used here:
def confirm():
out = input("Confirm (Y/n)? > ")
return out == "Y"help(input) says:
Help on built-in function input in module __builtin__:
input(...)
input([prompt]) -> value
Equivalent to eval(raw_input(prompt)).so actually it should not work, until you enter a double quoted Y i.e. "'Y'". I'm wondering, why there seems to be cases where it seems to work!?!?!
Oh, I found it - it is the missing import
from six.moves import input # pylint: disable=redefined-builtinthat has disappeared during https://github.com/tensorflow/tensor2tensor/commit/e1cf9f4c76033ff9cc004964af079e95f338c6d3.