search

tensorflow / tensorboard

TensorFlow's Visualization Toolkit
Apache License 2.0
6.68k stars 1.65k forks source link

Keep getting "The profile plugin has moved." even after installing lib #5731

Closed tgpsantos closed 2 years ago

tgpsantos commented 2 years ago

Environment information (required)

`diagnose_tensorboard.py` Output Details `````` --- check: autoidentify INFO: diagnose_tensorboard.py version e43767ef2b648d0d5d57c00f38ccbd38390e38da INFO: diagnose_tensorboard.py version e43767ef2b648d0d5d57c00f38ccbd38390e38da --- check: general INFO: sys.version_info: sys.version_info(major=3, minor=7, micro=4, releaselevel='final', serial=0) INFO: sys.version_info: sys.version_info(major=3, minor=7, micro=4, releaselevel='final', serial=0) INFO: os.name: nt INFO: os.name: nt INFO: os.uname(): N/A INFO: os.uname(): N/A INFO: sys.getwindowsversion(): sys.getwindowsversion(major=10, minor=0, build=19044, platform=2, service_pack='') INFO: sys.getwindowsversion(): sys.getwindowsversion(major=10, minor=0, build=19044, platform=2, service_pack='') --- check: package_management INFO: has conda-meta: True INFO: has conda-meta: True INFO: $VIRTUAL_ENV: None INFO: $VIRTUAL_ENV: None --- check: installed_packages INFO: installed: tensorboard==2.7.0 INFO: installed: tensorboard==2.7.0 INFO: installed: tensorflow==2.7.0 INFO: installed: tensorflow==2.7.0 INFO: installed: tensorflow-estimator==2.7.0 INFO: installed: tensorflow-estimator==2.7.0 INFO: installed: tensorboard-data-server==0.6.1 INFO: installed: tensorboard-data-server==0.6.1 --- check: tensorboard_python_version INFO: tensorboard.version.VERSION: '2.7.0' INFO: tensorboard.version.VERSION: '2.7.0' --- check: tensorflow_python_version INFO: tensorflow.__version__: '2.7.0' INFO: tensorflow.__version__: '2.7.0' INFO: tensorflow.__git_version__: 'v2.7.0-rc1-69-gc256c071bb2' INFO: tensorflow.__git_version__: 'v2.7.0-rc1-69-gc256c071bb2' --- check: tensorboard_data_server_version INFO: data server binary: None INFO: data server binary: None --- check: tensorboard_binary_path INFO: which tensorboard: b'C:\\Users\\ppp\\Anaconda3\\envs\\tfx\\Scripts\\tensorboard.exe\r\n' INFO: which tensorboard: b'C:\\Users\\ppp\\Anaconda3\\envs\\tfx\\Scripts\\tensorboard.exe\r\n' --- check: addrinfos socket.has_ipv6 = True socket.AF_UNSPEC = socket.SOCK_STREAM = socket.AI_ADDRCONFIG = socket.AI_PASSIVE = Loopback flags: Loopback infos: [(, , 0, '', ('::1', 0, 0, 0)), (, , 0, '', ('127.0.0.1', 0))] Wildcard flags: Wildcard infos: [(, , 0, '', ('::', 0, 0, 0)), (, , 0, '', ('0.0.0.0', 0))] --- check: readable_fqdn INFO: socket.getfqdn(): 'portatilese0030.home' INFO: socket.getfqdn(): 'portatilese0030.home' --- check: stat_tensorboardinfo INFO: directory: C:\Users\ppp\AppData\Local\Temp\.tensorboard-info INFO: directory: C:\Users\ppp\AppData\Local\Temp\.tensorboard-info INFO: os.stat(...): os.stat_result(st_mode=16895, st_ino=45035996274984714, st_dev=2734036061, st_nlink=1, st_uid=0, st_gid=0, st_size=0, st_atime=1653998346, st_mtime=1653998346, st_ctime=1653987147) INFO: os.stat(...): os.stat_result(st_mode=16895, st_ino=45035996274984714, st_dev=2734036061, st_nlink=1, st_uid=0, st_gid=0, st_size=0, st_atime=1653998346, st_mtime=1653998346, st_ctime=1653987147) INFO: mode: 0o40777 INFO: mode: 0o40777 --- check: source_trees_without_genfiles INFO: tensorboard_roots (1): ['c:\\Users\\ppp\\Anaconda3\\envs\\tfx\\lib\\site-packages']; bad_roots (0): [] INFO: tensorboard_roots (1): ['c:\\Users\\ppp\\Anaconda3\\envs\\tfx\\lib\\site-packages']; bad_roots (0): [] --- check: full_pip_freeze INFO: pip freeze --all: absl-py==0.8.1 altgraph==0.17 appdirs==1.4.4 astor==0.8.0 astroid==2.9.0 astunparse==1.6.3 attrs==21.4.0 auto-py-to-exe==2.7.8 backcall==0.2.0 backports.functools-lru-cache==1.6.4 black==22.3.0 bleach==3.1.0 bottle==0.12.18 bottle-websocket==0.2.9 CacheControl==0.12.6 cachetools==4.1.1 certifi==2022.5.18.1 cffi==1.14.3 chardet==3.0.4 click==8.0.4 colorama==0.4.4 cycler==0.10.0 dataclasses==0.8 decorator==5.1.1 defusedxml==0.6.0 dill==0.3.1.1 dropbox==11.29.0 Eel==0.12.4 entrypoints==0.3 et-xmlfile==1.0.1 firebase-admin==4.5.0 flake8==4.0.1 flatbuffers==2.0 future==0.18.0 gast==0.3.3 gevent==20.9.0 gevent-websocket==0.10.1 google-api-core==2.8.0 google-api-python-client==1.12.8 google-auth==1.30.1 google-auth-httplib2==0.0.4 google-auth-oauthlib==0.4.1 google-cloud-bigquery==2.17.0 google-cloud-bigquery-storage==2.4.0 google-cloud-core==2.3.0 google-cloud-firestore==2.0.2 google-cloud-storage==2.3.0 google-cloud-texttospeech==2.4.0 google-crc32c==1.1.0 google-pasta==0.2.0 google-resumable-media==2.3.2 googleapis-common-protos==1.56.1 greenlet==0.4.17 grpcio==1.34.0 guppy3==3.0.9 gviz-api==1.10.0 h5py==2.10.0 httplib2==0.18.1 idna==2.8 import-ipynb==0.1.3 importlib-metadata==4.11.3 intel-tensorflow==2.7.0 ipykernel==5.1.2 ipython==7.33.0 ipython-genutils==0.2.0 ipywidgets==7.6.5 isort==5.9.3 jedi==0.18.1 Jinja2==2.10.3 joblib==0.14.1 json5==0.8.5 jsonschema==3.1.1 jupyter==1.0.0 jupyter-client==5.3.4 jupyter-console==6.4.0 jupyter-core==4.6.0 jupyterlab==1.1.4 jupyterlab-server==1.0.6 jupyterlab-widgets==1.0.2 keras==2.7.0 Keras-Applications==1.0.8 Keras-Preprocessing==1.1.2 kiwisolver==1.1.0 lazy-object-proxy==1.6.0 libclang==13.0.0 libcst==0.3.19 Markdown==3.1.1 MarkupSafe==1.1.1 matplotlib==3.2.0 matplotlib-inline==0.1.3 mccabe==0.7.0 memory-profiler==0.57.0 mistune==0.8.4 mixpanel==4.8.3 mixpanel-utils==2.0.0b2 mkl-fft==1.0.14 mkl-random==1.1.0 mkl-service==2.3.0 more-itertools==7.2.0 MouseInfo==0.1.3 msgpack==1.0.2 multiprocess==0.70.9 mypy-extensions==0.4.3 nbconvert==5.6.0 nbformat==4.4.0 nbresuse==0.3.3 ndjson==0.3.1 neural-structured-learning==1.1.0 notebook==6.0.1 numpy==1.20.3 oauthlib==3.1.0 opencv-python==4.1.2.30 openpyxl==3.0.7 opt-einsum==3.1.0 packaging==20.9 pandas==0.25.3 pandas-gbq==0.15.0 pandocfilters==1.4.2 parso==0.8.3 pathspec==0.9.0 pefile==2019.4.18 pickleshare==0.7.5 Pillow==6.2.0 pip==19.2.3 platformdirs==2.4.0 ply==3.11 prometheus-client==0.7.1 promise==2.2.1 prompt-toolkit==3.0.29 proto-plus==1.13.0 protobuf==3.14.0 psutil==5.6.3 pyarrow==4.0.0 pyasn1==0.4.8 pyasn1-modules==0.2.8 PyAutoGUI==0.9.50 pycodestyle==2.8.0 pycparser==2.20 pydata-google-auth==1.2.0 pydot==1.4.1 pyflakes==2.4.0 PyGetWindow==0.0.8 Pygments==2.12.0 pyinstaller==4.0 pyinstaller-hooks-contrib==2020.9 pylint==2.12.2 Pympler==0.8 PyMsgBox==1.0.7 pyparsing==2.4.2 pyperclip==1.8.0 pypiwin32==223 PyQt5==5.15.1 PyQt5-sip==12.8.1 pyrealsense2==2.31.0.1235 PyRect==0.1.4 pyrsistent==0.15.4 PyScreeze==0.1.26 PySide2==5.15.1 python-dateutil==2.8.0 python-vlc==3.0.7110 PyTweening==1.0.3 pytz==2019.3 pywin32==228 pywin32-ctypes==0.2.0 pywinpty==0.5.5 PyYAML==5.4.1 pyzmq==18.1.0 qtconsole==5.2.2 QtPy==2.0.1 regex==2022.3.15 requests==2.22.0 requests-oauthlib==1.3.0 rsa==4.6 scikit-learn==0.22.1 scipy==1.4.1 screeninfo==0.6.5 Send2Trash==1.5.0 setuptools==41.4.0 shiboken2==5.15.1 six==1.16.0 sklearn==0.0 stone==3.3.1 tensorboard==2.7.0 tensorboard-data-server==0.6.1 tensorboard-plugin-profile==2.5.0 tensorboard-plugin-wit==1.7.0 tensorflow==2.7.0 tensorflow-addons==0.16.1 tensorflow-datasets==1.2.0 tensorflow-estimator==2.7.0 tensorflow-io-gcs-filesystem==0.24.0 tensorflow-metadata==0.15.0 termcolor==1.1.0 terminado==0.8.2 testpath==0.4.2 tfutils==0.0.1 tokenize-rt==4.2.1 toml==0.10.2 tomli==2.0.1 tornado==6.0.3 tqdm==4.36.1 traitlets==5.2.1.post0 typed-ast==1.4.3 typeguard==2.13.3 typing-extensions==4.1.1 typing-inspect==0.6.0 uritemplate==3.0.1 urllib3==1.25.6 wcwidth==0.2.5 webencodings==0.5.1 Werkzeug==0.16.0 wheel==0.33.6 whichcraft==0.6.1 widgetsnbextension==3.5.2 wincertstore==0.2 wrapt==1.13.3 xlrd==1.2.0 XlsxWriter==1.3.9 xlutils==2.0.0 xlwt==1.3.0 zipp==3.8.0 zope.event==4.5.0 zope.interface==5.1.2 INFO: pip freeze --all: absl-py==0.8.1 altgraph==0.17 appdirs==1.4.4 astor==0.8.0 astroid==2.9.0 astunparse==1.6.3 attrs==21.4.0 auto-py-to-exe==2.7.8 backcall==0.2.0 backports.functools-lru-cache==1.6.4 black==22.3.0 bleach==3.1.0 bottle==0.12.18 bottle-websocket==0.2.9 CacheControl==0.12.6 cachetools==4.1.1 certifi==2022.5.18.1 cffi==1.14.3 chardet==3.0.4 click==8.0.4 colorama==0.4.4 cycler==0.10.0 dataclasses==0.8 decorator==5.1.1 defusedxml==0.6.0 dill==0.3.1.1 dropbox==11.29.0 Eel==0.12.4 entrypoints==0.3 et-xmlfile==1.0.1 firebase-admin==4.5.0 flake8==4.0.1 flatbuffers==2.0 future==0.18.0 gast==0.3.3 gevent==20.9.0 gevent-websocket==0.10.1 google-api-core==2.8.0 google-api-python-client==1.12.8 google-auth==1.30.1 google-auth-httplib2==0.0.4 google-auth-oauthlib==0.4.1 google-cloud-bigquery==2.17.0 google-cloud-bigquery-storage==2.4.0 google-cloud-core==2.3.0 google-cloud-firestore==2.0.2 google-cloud-storage==2.3.0 google-cloud-texttospeech==2.4.0 google-crc32c==1.1.0 google-pasta==0.2.0 google-resumable-media==2.3.2 googleapis-common-protos==1.56.1 greenlet==0.4.17 grpcio==1.34.0 guppy3==3.0.9 gviz-api==1.10.0 h5py==2.10.0 httplib2==0.18.1 idna==2.8 import-ipynb==0.1.3 importlib-metadata==4.11.3 intel-tensorflow==2.7.0 ipykernel==5.1.2 ipython==7.33.0 ipython-genutils==0.2.0 ipywidgets==7.6.5 isort==5.9.3 jedi==0.18.1 Jinja2==2.10.3 joblib==0.14.1 json5==0.8.5 jsonschema==3.1.1 jupyter==1.0.0 jupyter-client==5.3.4 jupyter-console==6.4.0 jupyter-core==4.6.0 jupyterlab==1.1.4 jupyterlab-server==1.0.6 jupyterlab-widgets==1.0.2 keras==2.7.0 Keras-Applications==1.0.8 Keras-Preprocessing==1.1.2 kiwisolver==1.1.0 lazy-object-proxy==1.6.0 libclang==13.0.0 libcst==0.3.19 Markdown==3.1.1 MarkupSafe==1.1.1 matplotlib==3.2.0 matplotlib-inline==0.1.3 mccabe==0.7.0 memory-profiler==0.57.0 mistune==0.8.4 mixpanel==4.8.3 mixpanel-utils==2.0.0b2 mkl-fft==1.0.14 mkl-random==1.1.0 mkl-service==2.3.0 more-itertools==7.2.0 MouseInfo==0.1.3 msgpack==1.0.2 multiprocess==0.70.9 mypy-extensions==0.4.3 nbconvert==5.6.0 nbformat==4.4.0 nbresuse==0.3.3 ndjson==0.3.1 neural-structured-learning==1.1.0 notebook==6.0.1 numpy==1.20.3 oauthlib==3.1.0 opencv-python==4.1.2.30 openpyxl==3.0.7 opt-einsum==3.1.0 packaging==20.9 pandas==0.25.3 pandas-gbq==0.15.0 pandocfilters==1.4.2 parso==0.8.3 pathspec==0.9.0 pefile==2019.4.18 pickleshare==0.7.5 Pillow==6.2.0 pip==19.2.3 platformdirs==2.4.0 ply==3.11 prometheus-client==0.7.1 promise==2.2.1 prompt-toolkit==3.0.29 proto-plus==1.13.0 protobuf==3.14.0 psutil==5.6.3 pyarrow==4.0.0 pyasn1==0.4.8 pyasn1-modules==0.2.8 PyAutoGUI==0.9.50 pycodestyle==2.8.0 pycparser==2.20 pydata-google-auth==1.2.0 pydot==1.4.1 pyflakes==2.4.0 PyGetWindow==0.0.8 Pygments==2.12.0 pyinstaller==4.0 pyinstaller-hooks-contrib==2020.9 pylint==2.12.2 Pympler==0.8 PyMsgBox==1.0.7 pyparsing==2.4.2 pyperclip==1.8.0 pypiwin32==223 PyQt5==5.15.1 PyQt5-sip==12.8.1 pyrealsense2==2.31.0.1235 PyRect==0.1.4 pyrsistent==0.15.4 PyScreeze==0.1.26 PySide2==5.15.1 python-dateutil==2.8.0 python-vlc==3.0.7110 PyTweening==1.0.3 pytz==2019.3 pywin32==228 pywin32-ctypes==0.2.0 pywinpty==0.5.5 PyYAML==5.4.1 pyzmq==18.1.0 qtconsole==5.2.2 QtPy==2.0.1 regex==2022.3.15 requests==2.22.0 requests-oauthlib==1.3.0 rsa==4.6 scikit-learn==0.22.1 scipy==1.4.1 screeninfo==0.6.5 Send2Trash==1.5.0 setuptools==41.4.0 shiboken2==5.15.1 six==1.16.0 sklearn==0.0 stone==3.3.1 tensorboard==2.7.0 tensorboard-data-server==0.6.1 tensorboard-plugin-profile==2.5.0 tensorboard-plugin-wit==1.7.0 tensorflow==2.7.0 tensorflow-addons==0.16.1 tensorflow-datasets==1.2.0 tensorflow-estimator==2.7.0 tensorflow-io-gcs-filesystem==0.24.0 tensorflow-metadata==0.15.0 termcolor==1.1.0 terminado==0.8.2 testpath==0.4.2 tfutils==0.0.1 tokenize-rt==4.2.1 toml==0.10.2 tomli==2.0.1 tornado==6.0.3 tqdm==4.36.1 traitlets==5.2.1.post0 typed-ast==1.4.3 typeguard==2.13.3 typing-extensions==4.1.1 typing-inspect==0.6.0 uritemplate==3.0.1 urllib3==1.25.6 wcwidth==0.2.5 webencodings==0.5.1 Werkzeug==0.16.0 wheel==0.33.6 whichcraft==0.6.1 widgetsnbextension==3.5.2 wincertstore==0.2 wrapt==1.13.3 xlrd==1.2.0 XlsxWriter==1.3.9 xlutils==2.0.0 xlwt==1.3.0 zipp==3.8.0 zope.event==4.5.0 zope.interface==5.1.2 `````` ### Next steps No action items identified. Please copy ALL of the above output, including the lines containing only backticks, into your GitHub issue or comment. Be sure to redact any sensitive information.

Issue description

Hello guys,

I've added a tensorboard callback to my model.fit() with profile_batch param set to trace operations in my local machine (windows).

It seems to be saving the trace files correctly to logs/plugins/profile folders.

My tensorboard also seems to be plotting data from these trainings, as you can see in my dashboard, even though I find it strange that all my runs are visible without the option to filter them.

The problem I'm facing is when going to the profiler section, I get this message saying The plugin has moved adivising me to pip install -U tensorboard-plugin-profile.

I've already installed the tensorboard-plugin-profile (I have tried both versions 2.8 and 2.5); my tf version is 2.7.0 and the tb version is also 2.7.0.

This happens when running tensorboard from:

In both cases I see the plotted data as shown above, and the error message in the profiler section.

Am I missing something here?

yatbear commented 2 years ago

Hi @tgpsantos,

I was able to load the profile plugin following the instructions in the README here: https://github.com/tensorflow/profiler, could you double check if you ran all the steps in the README?

Also, tensorboard profiler is moved to its own repo, if you still couldn't load it, can you please move this issue to https://github.com/tensorflow/profiler/issues?

Thanks!

tgpsantos commented 2 years ago

@yatbear thanks! I will give it a check.

If I still find something unusual I will report it in the correct repo (I was unaware of its existence).

Cheers!