Open Puiching-Memory opened 5 months ago
经过我的测试，以下环境可以使用 系统：ubuntu22.04 Python3.10
uvicorn fastapi sse_starlette transformers==4.38.2 tiktoken datasets trl==0.7.2 peft jieba rouge_chinese nltk gradio
完整环境：
absl-py 2.0.0 accelerate 0.29.3 aiofiles 23.2.1 aiohttp 3.9.5 aiosignal 1.3.1 altair 5.3.0 annotated-types 0.6.0 anyio 4.2.0 argon2-cffi 23.1.0 argon2-cffi-bindings 21.2.0 arrow 1.3.0 asttokens 2.4.1 async-lru 2.0.4 async-timeout 4.0.3 attrs 23.2.0 Babel 2.14.0 beautifulsoup4 4.12.2 bleach 6.1.0 brotlipy 0.7.0 cachetools 5.3.2 certifi 2022.12.7 cffi 1.15.1 charset-normalizer 2.0.4 click 8.1.7 comm 0.2.1 conda 22.11.1 conda-content-trust 0.1.3 conda-package-handling 1.9.0 contourpy 1.2.0 cryptography 38.0.1 cycler 0.12.1 datasets 2.19.0 debugpy 1.8.0 decorator 5.1.1 defusedxml 0.7.1 dill 0.3.8 docstring_parser 0.16 exceptiongroup 1.2.0 executing 2.0.1 fastapi 0.110.2 fastjsonschema 2.19.1 ffmpy 0.3.2 filelock 3.13.1 fonttools 4.47.0 fqdn 1.5.1 frozenlist 1.4.1 fsspec 2023.12.2 google-auth 2.26.1 google-auth-oauthlib 1.2.0 gradio 4.28.3 gradio_client 0.16.0 grpcio 1.60.0 h11 0.14.0 httpcore 1.0.5 httpx 0.27.0 huggingface-hub 0.22.2 idna 3.4 importlib_resources 6.4.0 ipykernel 6.28.0 ipython 8.20.0 ipywidgets 8.1.1 isoduration 20.11.0 jedi 0.19.1 jieba 0.42.1 Jinja2 3.1.2 joblib 1.4.0 json5 0.9.14 jsonpointer 2.4 jsonschema 4.20.0 jsonschema-specifications 2023.12.1 jupyter_client 8.6.0 jupyter_core 5.7.1 jupyter-events 0.9.0 jupyter-lsp 2.2.1 jupyter_server 2.12.2 jupyter_server_terminals 0.5.1 jupyterlab 4.0.10 jupyterlab-language-pack-zh-CN 4.0.post6 jupyterlab_pygments 0.3.0 jupyterlab_server 2.25.2 jupyterlab-widgets 3.0.9 kiwisolver 1.4.5 Markdown 3.5.1 markdown-it-py 3.0.0 MarkupSafe 2.1.3 matplotlib 3.8.2 matplotlib-inline 0.1.6 mdurl 0.1.2 mistune 3.0.2 mpmath 1.3.0 multidict 6.0.5 multiprocess 0.70.16 nbclient 0.9.0 nbconvert 7.14.0 nbformat 5.9.2 nest-asyncio 1.5.8 networkx 3.2.1 nltk 3.8.1 notebook_shim 0.2.3 numpy 1.26.3 oauthlib 3.2.2 orjson 3.10.1 overrides 7.4.0 packaging 23.2 pandas 2.2.2 pandocfilters 1.5.0 parso 0.8.3 peft 0.10.0 pexpect 4.9.0 pillow 10.2.0 pip 22.3.1 platformdirs 4.1.0 pluggy 1.0.0 prometheus-client 0.19.0 prompt-toolkit 3.0.43 protobuf 4.23.4 psutil 5.9.7 ptyprocess 0.7.0 pure-eval 0.2.2 pyarrow 16.0.0 pyarrow-hotfix 0.6 pyasn1 0.5.1 pyasn1-modules 0.3.0 pycosat 0.6.4 pycparser 2.21 pydantic 2.7.1 pydantic_core 2.18.2 pydub 0.25.1 Pygments 2.17.2 pyOpenSSL 22.0.0 pyparsing 3.1.1 PySocks 1.7.1 python-dateutil 2.8.2 python-json-logger 2.0.7 python-multipart 0.0.9 pytz 2024.1 PyYAML 6.0.1 pyzmq 25.1.2 referencing 0.32.1 regex 2024.4.28 requests 2.31.0 requests-oauthlib 1.3.1 rfc3339-validator 0.1.4 rfc3986-validator 0.1.1 rich 13.7.1 rouge-chinese 1.0.3 rpds-py 0.16.2 rsa 4.9 ruamel.yaml 0.17.21 ruamel.yaml.clib 0.2.6 ruff 0.4.2 safetensors 0.4.3 semantic-version 2.10.0 Send2Trash 1.8.2 setuptools 65.5.0 shellingham 1.5.4 shtab 1.7.1 six 1.16.0 sniffio 1.3.0 soupsieve 2.5 sse-starlette 2.1.0 stack-data 0.6.3 starlette 0.37.2 supervisor 4.2.5 sympy 1.12 tensorboard 2.15.1 tensorboard-data-server 0.7.2 terminado 0.18.0 tiktoken 0.6.0 tinycss2 1.2.1 tokenizers 0.15.2 tomli 2.0.1 tomlkit 0.12.0 toolz 0.12.0 torch 2.1.2+cu121 torchvision 0.16.2+cu121 tornado 6.4 tqdm 4.64.1 traitlets 5.14.1 transformers 4.38.2 triton 2.1.0 trl 0.7.2 typer 0.12.3 types-python-dateutil 2.8.19.20240106 typing_extensions 4.9.0 tyro 0.8.3 tzdata 2024.1 uri-template 1.3.0 urllib3 2.2.1 uvicorn 0.29.0 wcwidth 0.2.13 webcolors 1.13 webencodings 0.5.1 websocket-client 1.7.0 websockets 11.0.3 Werkzeug 3.0.1 wheel 0.37.1 widgetsnbextension 4.0.9 xxhash 3.4.1 yarl 1.9.4
补充：sentencepiece库
Puiching-Memory
commented
5 months ago Puiching-Memory
commented
5 months ago
经过我的测试，以下环境可以使用 系统：ubuntu22.04 Python3.10
完整环境：