PaddlePaddle / PaddleNLP

👑 Easy-to-use and powerful NLP and LLM library with 🤗 Awesome model zoo, supporting wide-range of NLP tasks from research to industrial applications, including 🗂Text Classification, 🔍 Neural Search, ❓ Question Answering, ℹ️ Information Extraction, 📄 Document Intelligence, 💌 Sentiment Analysis etc.
https://paddlenlp.readthedocs.io
Apache License 2.0
12.13k stars 2.94k forks source link

How to view visual training results? #8271

Closed watertianyi closed 7 months ago

watertianyi commented 7 months ago

请提出你的问题

https://github.com/PaddlePaddle/PaddleNLP/tree/develop/model_zoo/uie

w5688414 commented 7 months ago

please refer to training_args.py for more trainer.py usage:

https://github.com/PaddlePaddle/PaddleNLP/blob/3566381385f62c17440be9c6e196eefa43177e37/paddlenlp/trainer/training_args.py#L331

watertianyi commented 7 months ago

默认已经是visualdl 还需要进行设置为--report_to visualdl ?,上面都正常,下一步怎么可视化呢

w5688414 commented 7 months ago

用法跟tensorboard差不多,例如:

visualdl --logdir ./your_log_path

更详细的文档请参考:https://github.com/PaddlePaddle/VisualDL

watertianyi commented 7 months ago

报错:TypeError: _install_callables() got an unexpected keyword argument 'pgettext'

w5688414 commented 7 months ago

提供一下更详细的报错信息和paddle,paddlenlp的版本信息

watertianyi commented 7 months ago

错误信息如下: VisualDL 2.5.3 Traceback (most recent call last): File "/home/water/anaconda3/envs/paddlenlp/bin/visualdl", line 8, in sys.exit(main()) File "/home/water/anaconda3/envs/paddlenlp/lib/python3.9/site-packages/visualdl/server/app.py", line 744, in main _run(args) File "/home/water/anaconda3/envs/paddlenlp/lib/python3.9/site-packages/visualdl/server/app.py", line 725, in _run app = create_app(args) File "/home/water/anaconda3/envs/paddlenlp/lib/python3.9/site-packages/visualdl/server/app.py", line 83, in create_app babel = Babel(app, locale_selector=get_locale) # noqa:F841 File "/home/water/anaconda3/envs/paddlenlp/lib/python3.9/site-packages/flask_babel/init.py", line 86, in init self.init_app(app, *args, **kwargs) File "/home/water/anaconda3/envs/paddlenlp/lib/python3.9/site-packages/flask_babel/init.py", line 165, in init_app app.jinja_env.install_gettext_callables( TypeError: _install_callables() got an unexpected keyword argument 'pgettext'

paddle版本信息如下: paddle-bfloat 0.1.7 paddle-serving-app 0.9.0 paddle-serving-client 0.9.0 paddle-serving-server 0.9.0 paddle2onnx 1.1.0 paddlefsl 1.1.0 paddlenlp 2.7.2 paddlepaddle-gpu 2.6.1

w5688414 commented 7 months ago

我试了一下没问题:

visualdl --logdir checkpoint/model_best/ --host 0.0.0.0

我给出我的环境供参考:

aiofiles==23.2.1
aiohttp==3.8.6
aiosignal==1.3.1
aistudio-sdk==0.1.3
altair==5.1.2
annotated-types==0.6.0
antlr4-python3-runtime==4.9.3
anyio==3.7.1
argon2-cffi==23.1.0
argon2-cffi-bindings==21.2.0
arrow==1.3.0
asgiref==3.7.2
astor==0.8.1
asttokens==2.4.1
async-lru==2.0.4
async-timeout==4.0.3
asyncio-atexit==1.0.1
attrdict==2.0.1
attrs==23.1.0
Babel==2.13.1
backoff==2.2.1
bce-python-sdk==0.8.92
beautifulsoup4==4.12.2
beir==2.0.0
black==23.12.0
bleach==6.1.0
blinker==1.7.0
blis==0.7.11
boilerpy3==1.0.7
Brotli==1.1.0
cachetools==5.3.2
cairocffi==1.6.1
CairoSVG==2.7.1
catalogue==2.0.10
certifi==2023.7.22
chardet==5.2.0
charset-normalizer==3.3.2
click==8.0.0
cloudpathlib==0.16.0
colorama==0.4.6
coloredlogs==15.0.1
colorlog==6.7.0
comm==0.2.0
confection==0.1.3
contourpy==1.2.0
coverage==7.3.4
cryptography==41.0.5
cssselect==1.2.0
cssselect2==0.7.0
cssutils==2.9.0
cuda-python==12.3.0
cycler==0.12.1
cymem==2.0.8
Cython==3.0.5
dataclasses-json==0.6.2
datasets==2.14.6
debugpy==1.8.0
decorator==5.1.1
defusedxml==0.7.1
Deprecated==1.2.14
dill==0.3.4
distro==1.8.0
docopt==0.6.2
effdet==0.4.1
elasticsearch==7.9.1
emoji==2.9.0
et-xmlfile==1.1.0
Events==0.5
exceptiongroup==1.1.3
executing==2.0.1
faiss-cpu==1.7.4
fastapi==0.103.2
fastjsonschema==2.19.0
ffmpy==0.3.1
filetype==1.2.0
fire==0.5.0
flake8==6.1.0
Flask==2.2.5
flask-babel==4.0.0
Flask-Cors==4.0.0
Flask-HTTPAuth==4.8.0
Flask-SQLAlchemy==3.1.1
flatbuffers==23.5.26
fonttools==4.44.0
fqdn==1.5.1
frozenlist==1.4.0
fsspec==2023.10.0
future==0.18.3
gevent==23.9.1
geventhttpclient==2.0.2
ghp-import==2.1.0
gitdb==4.0.11
GitPython==3.1.40
google-ai-generativelanguage==0.3.3
google-api-core==2.15.0
google-auth==2.25.2
google-generativeai==0.2.2
googleapis-common-protos==1.62.0
gradio==3.41.2
gradio_client==0.5.0
greenlet==3.0.1
griffe==0.38.1
grpcio==1.58.0
grpcio-status==1.60.0
h11==0.14.0
htbuilder==0.6.2
html5lib==1.1
httpcore==1.0.1
httpx==0.25.1
huggingface-hub==0.21.4
humanfriendly==10.0
idna==3.4
imageio==2.32.0
imgaug==0.4.0
importlib-metadata==6.8.0
importlib-resources==6.1.1
iniconfig==2.0.0
iopath==0.1.10
ipykernel==6.27.1
ipython==8.18.1
isoduration==20.11.0
isort==5.13.2
itsdangerous==2.1.2
jedi==0.19.1
jieba==0.42.1
Jinja2==3.1.2
joblib==1.3.2
json5==0.9.14
jsonlines==4.0.0
jsonpatch==1.33
jsonpointer==2.4
jsonschema==4.19.2
jsonschema-path==0.3.2
jsonschema-specifications==2023.7.1
jupyter-events==0.9.0
jupyter-lsp==2.2.1
jupyter_client==8.6.0
jupyter_core==5.5.0
jupyter_server==2.12.1
jupyter_server_terminals==0.4.4
jupyterlab==4.0.9
jupyterlab_pygments==0.3.0
jupyterlab_server==2.25.2
jupytext==1.16.0
kiwisolver==1.4.5
langchain==0.1.0
langchain-community==0.0.20
langchain-core==0.1.23
langchain-text-splitters==0.0.1
langcodes==3.3.0
langdetect==1.0.9
langsmith==0.0.87
layoutparser==0.3.4
lazy-object-proxy==1.9.0
lazy_loader==0.3
llvmlite==0.41.1
lmdb==1.4.1
lxml==4.9.3
Markdown==3.5.1
markdown-it-py==3.0.0
markdown2==2.4.12
MarkupSafe==2.1.3
marshmallow==3.20.1
matplotlib==3.8.1
matplotlib-inline==0.1.6
mccabe==0.7.0
md2pdf==1.0.1
mdit-py-plugins==0.4.0
mdurl==0.1.2
mergedeep==1.3.4
minio==7.1.17
mistune==3.0.2
mkdocs==1.5.3
mkdocs-autorefs==0.5.0
mkdocs-jupyter==0.24.6
mkdocs-material==9.5.3
mkdocs-material-extensions==1.3.1
mkdocs-rss-plugin==1.11.0
mkdocstrings==0.24.0
mkdocstrings-python==1.7.5
mmh3==4.0.1
more-itertools==10.1.0
mpmath==1.3.0
mteb==1.1.1
multidict==6.0.4
multiprocess==0.70.12.2
murmurhash==1.0.10
mypy==1.7.1
mypy-extensions==1.0.0
nbclient==0.9.0
nbconvert==7.12.0
nbformat==5.9.2
nest-asyncio==1.5.8
networkx==3.2.1
nltk==3.8.1
notebook_shim==0.2.3
numba==0.58.1
numpy==1.26.1
omegaconf==2.3.0
onnx==1.15.0
onnxconverter-common==1.14.0
onnxruntime==1.15.1
onnxruntime-gpu==1.16.2
openai==1.12.0
openapi-schema-validator==0.6.2
openapi-spec-validator==0.7.1
opencv-contrib-python==4.6.0.66
opencv-contrib-python-headless==4.8.1.78
opencv-python==4.6.0.66
openpyxl==3.1.2
opt-einsum==3.3.0
orjson==3.9.15
overrides==7.4.0
packaging==23.2
paddle2onnx==1.1.0
paddlefsl==1.1.0
paddleocr==2.6.1.3
paddlenlp==2.7.2
paddlepaddle-gpu==0.0.0.post117
paginate==0.5.6
pandas==2.1.2
pandocfilters==1.5.0
parso==0.8.3
pathable==0.4.3
pathspec==0.12.1
pdf2docx==0.5.6
pdf2image==1.16.3
pdfminer.six==20221105
pdfplumber==0.10.3
pexpect==4.9.0
pikepdf==8.9.0
Pillow==9.5.0
pluggy==1.3.0
portalocker==2.8.2
premailer==3.10.0
preshed==3.0.9
prettytable==3.9.0
prometheus-client==0.19.0
prompt-toolkit==3.0.41
proto-plus==1.23.0
protobuf==3.20.3
psutil==5.9.6
ptyprocess==0.7.0
pure-eval==0.2.2
pyarrow==14.0.0
pyasn1==0.5.1
pyasn1-modules==0.3.0
pybind11==2.11.1
pyclipper==1.3.0.post5
pycocotools==2.0.7
pycodestyle==2.11.1
pycryptodome==3.19.0
pydantic==1.10.14
pydantic_core==2.14.5
pydeck==0.8.1b0
pydub==0.25.1
pydyf==0.8.0
pyflakes==3.1.0
Pygments==2.16.1
pymdown-extensions==10.5
pymilvus==2.3.2
Pympler==1.0.1
PyMuPDF==1.20.2
pyOpenSSL==24.1.0
pyparsing==3.1.1
pypdf==3.17.1
pypdfium2==4.23.1
pyphen==0.14.0
pytesseract==0.3.10
pytest==7.4.2
pytest-asyncio==0.23.2
pytest-cov==4.1.0
python-dateutil==2.8.2
python-docx==1.1.0
python-dotenv==1.0.0
python-iso639==2023.12.11
python-json-logger==2.0.7
python-magic==0.4.27
python-multipart==0.0.6
python-rapidjson==1.13
pytrec-eval==0.5
pytz==2023.3.post1
pyyaml_env_tag==0.1
pyzmq==25.1.2
rapidfuzz==3.5.2
rarfile==4.1
referencing==0.30.2
regex==2023.10.3
requests==2.31.0
rfc3339-validator==0.1.4
rfc3986-validator==0.1.1
rich==13.6.0
rpds-py==0.12.0
rsa==4.9
safetensors==0.4.0
scikit-image==0.22.0
scikit-learn==1.3.2
scipy==1.11.3
semantic-version==2.10.0
semver==3.0.2
Send2Trash==1.8.2
sentence-transformers==2.2.2
sentencepiece==0.1.99
seqeval==1.2.2
shapely==2.0.2
shellingham==1.5.4
six==1.16.0
smart-open==6.4.0
smmap==5.0.1
sniffio==1.3.0
soupsieve==2.5
spacy==3.7.2
spacy-legacy==3.0.12
spacy-loggers==1.0.5
spacy-pkuseg==0.0.33
SQLAlchemy==1.4.52
SQLAlchemy-Utils==0.41.1
srsly==2.4.8
sseclient-py==1.7.2
st-annotated-text==4.0.1
stack-data==0.6.3
starlette==0.27.0
streamlit==1.11.1
sympy==1.12
tabulate==0.9.0
tenacity==8.2.3
termcolor==2.3.0
terminado==0.18.0
thinc==8.2.1
threadpoolctl==3.2.0
tifffile==2023.9.26
tiktoken==0.5.1
timm==0.9.12
tinycss2==1.2.1
tokenize-rt==5.2.0
tokenizers==0.13.3
toml==0.10.2
tomli==2.0.1
tomlkit==0.12.0
tool-helpers==0.1.1
toolz==0.12.0
torch==2.1.0
torchvision==0.16.0
tornado==6.3.3
tqdm==4.66.1
traitlets==5.14.0
transformers==4.33.0
triton==2.1.0
tritonclient==2.39.0
typer==0.9.0
types-beautifulsoup4==4.12.0.20240106
types-Flask-Cors==4.0.0.20240106
types-html5lib==1.1.11.20240106
types-python-dateutil==2.8.19.14
types-PyYAML==6.0.12.12
types-requests==2.31.0.10
typing-inspect==0.9.0
typing_extensions==4.5.0
tzdata==2023.3
tzlocal==5.2
ujson==5.8.0
unstructured==0.11.2
unstructured-inference==0.7.18
unstructured.pytesseract==0.3.12
updog==1.4
uri-template==1.3.0
urllib3==2.1.0
uvicorn==0.24.0.post1
validators==0.22.0
visualdl==2.5.3
wasabi==1.1.2
watchdog==3.0.0
wcwidth==0.2.12
weasel==0.3.4
WeasyPrint==52.5
webcolors==1.13
webencodings==0.5.1
websocket-client==1.7.0
websockets==11.0.3
Werkzeug==3.0.1
wordcloud==1.8.2.2
wrapt==1.16.0
xxhash==3.4.1
yarl==1.9.2
zhon==2.0.2
zipp==3.17.0
zope.event==5.0
zope.interface==6.1
zopfli==0.2.3
watertianyi commented 7 months ago

TypeError: _install_callables() got an unexpected keyword argument 'pgettext' 还是这个原因

watertianyi commented 7 months ago

找到原因了,是Flask版本的问题