Xiaoxiao-Liu
commented
1 year ago 这个可能能帮到你：https://github.com/InternLM/xtuner/issues/181 试一下 pip install fsspec==2023.6.0
Open CathyKitten opened 1 year ago
Xiaoxiao-Liu
commented
1 year ago 这个可能能帮到你：https://github.com/InternLM/xtuner/issues/181 试一下 pip install fsspec==2023.6.0
wmm228
commented
9 months ago 您好 请问这个问题解决了吗 我还不知道该怎么解决
CathyKitten
commented
9 months ago absl-py==2.0.0 aiohttp==3.9.0 aiosignal==1.3.1 asttokens==2.4.1 astunparse==1.6.3 async-timeout==4.0.3 attrs==23.1.0 bert-score==0.3.11 -e git+https://github.com/google-research/bleurt.git@cebe7e6f996b40910cfaa520a63db47807e3bf5c#egg=BLEURT blis==0.7.11 cachetools==5.3.2 catalogue==2.0.10 certifi==2023.11.17 charset-normalizer==3.3.2 click==7.1.2 cloudpickle==3.0.0 colorama==0.4.6 commonmark==0.9.1 contourpy==1.1.1 cycler==0.12.1 cymem==2.0.8 datasets==2.5.1 dill==0.3.5.1 diskcache==5.6.3 docker==5.0.0 docker-pycreds==0.4.0 evaluate==0.4.0 executing==2.0.1 faiss-cpu==1.7.3 fasttext==0.9.2 filelock==3.13.1 flatbuffers==23.5.26 fonttools==4.45.1 frozenlist==1.4.0 fsspec==2023.10.0 gast==0.4.0 -e git+https://github.com/GEM-benchmark/GEM-metrics.git@8162210e73728c68f886cad6c09160694e3be9d9#egg=gem_metrics gitdb==4.0.11 GitPython==3.1.40 google-auth==2.23.4 google-auth-oauthlib==1.0.0 google-pasta==0.2.0 graphviz==0.20.1 grpcio==1.59.3 gym==0.21.0 h5py==3.10.0 huggingface-hub==0.11.1 icecream==2.1.3 idna==3.5 importlib-metadata==4.13.0 importlib-resources==6.1.1 iniconfig==2.0.0 jellyfish==1.0.3 Jinja2==3.1.2 joblib==1.3.2 jsonlines==3.0.0 keras==2.13.1 keybert==0.7.0 kiwisolver==1.4.5 libclang==16.0.6 logzero==1.7.0 lxml==4.9.3 Markdown==3.5.1 MarkupSafe==2.1.3 matplotlib==3.7.4 mpmath==1.3.0 multidict==6.0.4 multiprocess==0.70.13 murmurhash==1.0.10 networkx==3.1 nltk==3.7 numpy==1.24.3 nvidia-cublas-cu12==12.1.3.1 nvidia-cuda-cupti-cu12==12.1.105 nvidia-cuda-nvrtc-cu12==12.1.105 nvidia-cuda-runtime-cu12==12.1.105 nvidia-cudnn-cu12==8.9.2.26 nvidia-cufft-cu12==11.0.2.54 nvidia-curand-cu12==10.3.2.106 nvidia-cusolver-cu12==11.4.5.107 nvidia-cusparse-cu12==12.1.0.106 nvidia-nccl-cu12==2.18.1 nvidia-nvjitlink-cu12==12.3.101 nvidia-nvtx-cu12==12.1.105 oauthlib==3.2.2 openai==0.27.2 opt-einsum==3.3.0 overrides==3.1.0 packaging==23.2 pandas==1.3.5 pathtools==0.1.2 pathy==0.10.3 Pillow==10.1.0 pluggy==0.13.1 portalocker==2.8.2 preshed==3.0.9 progressbar==2.5 promise==2.3 protobuf==3.20.3 psutil==5.9.6 py==1.11.0 py-rouge==1.1 pyarrow==14.0.1 pyasn1==0.5.1 pyasn1-modules==0.3.0 pybind11==2.11.1 pycountry==22.3.5 pydantic==1.7.4 Pygments==2.17.2 pyparsing==3.1.1 pytest==6.2.4 pytextrank==3.2.4 python-dateutil==2.8.2 pytz==2023.3.post1 PyYAML==6.0.1 regex==2023.10.3 repro==0.1.4 requests==2.31.0 requests-oauthlib==1.3.1 responses==0.18.0 rich==12.0.0 -e git+https://github.com/leezekun/Directional-Stimulus-Prompting.git@93b44f9e74d608732fd7809e664cdc6c9f1f769b#egg=rl4lms rouge-score==0.0.4 rsa==4.9 sacrebleu==2.2.0 sacremoses==0.1.1 scikit-learn==1.3.2 scipy==1.10.1 segtok==1.5.11 sentence-transformers==2.2.2 sentencepiece==0.1.99 sentry-sdk==1.37.1 setproctitle==1.3.3 shortuuid==1.0.11 six==1.16.0 smart-open==6.4.0 smmap==5.0.1 spacy==3.0.6 spacy-legacy==3.0.12 srsly==2.4.8 stable-baselines3==1.5.1a5 string2string==0.0.145 sympy==1.12 tabulate==0.9.0 tensorboard==2.13.0 tensorboard-data-server==0.7.2 tensorflow==2.13.1 tensorflow-estimator==2.13.0 tensorflow-io-gcs-filesystem==0.34.0 termcolor==2.3.0 tf-slim==1.1.0 thinc==8.0.17 threadpoolctl==3.2.0 tokenizers==0.12.1 toml==0.10.2 torch==1.11.0+cu113 torchaudio==0.11.0+cu113 torchvision==0.12.0+cu113 tqdm==4.64.0 transformers==4.18.0 triton==2.1.0 typer==0.3.2 typing_extensions==4.5.0 urllib3==2.1.0 wandb==0.12.15 wasabi==0.10.1 websocket-client==1.6.4 Werkzeug==3.0.1 wrapt==1.16.0 xxhash==3.4.1 yake==0.4.8 yarl==1.9.3 zipp==3.17.0
CathyKitten
commented
9 months ago 你好！后来是解决了，具体有点忘了，在这个requirement环境里我是可以运行的。
CathyKitten
commented
9 months ago 可以参考下面的 absl-py==2.0.0 aiohttp==3.9.0 aiosignal==1.3.1 asttokens==2.4.1 astunparse==1.6.3 async-timeout==4.0.3 attrs==23.1.0 bert-score==0.3.11 -e @.#egg=BLEURT blis==0.7.11 cachetools==5.3.2 catalogue==2.0.10 certifi==2023.11.17 charset-normalizer==3.3.2 click==7.1.2 cloudpickle==3.0.0 colorama==0.4.6 commonmark==0.9.1 contourpy==1.1.1 cycler==0.12.1 cymem==2.0.8 datasets==2.5.1 dill==0.3.5.1 diskcache==5.6.3 docker==5.0.0 docker-pycreds==0.4.0 evaluate==0.4.0 executing==2.0.1 faiss-cpu==1.7.3 fasttext==0.9.2 filelock==3.13.1 flatbuffers==23.5.26 fonttools==4.45.1 frozenlist==1.4.0 fsspec==2023.10.0 gast==0.4.0 -e @.#egg=gem_metrics gitdb==4.0.11 GitPython==3.1.40 google-auth==2.23.4 google-auth-oauthlib==1.0.0 google-pasta==0.2.0 graphviz==0.20.1 grpcio==1.59.3 gym==0.21.0 h5py==3.10.0 huggingface-hub==0.11.1 icecream==2.1.3 idna==3.5 importlib-metadata==4.13.0 importlib-resources==6.1.1 iniconfig==2.0.0 jellyfish==1.0.3 Jinja2==3.1.2 joblib==1.3.2 jsonlines==3.0.0 keras==2.13.1 keybert==0.7.0 kiwisolver==1.4.5 libclang==16.0.6 logzero==1.7.0 lxml==4.9.3 Markdown==3.5.1 MarkupSafe==2.1.3 matplotlib==3.7.4 mpmath==1.3.0 multidict==6.0.4 multiprocess==0.70.13 murmurhash==1.0.10 networkx==3.1 nltk==3.7 numpy==1.24.3 nvidia-cublas-cu12==12.1.3.1 nvidia-cuda-cupti-cu12==12.1.105 nvidia-cuda-nvrtc-cu12==12.1.105 nvidia-cuda-runtime-cu12==12.1.105 nvidia-cudnn-cu12==8.9.2.26 nvidia-cufft-cu12==11.0.2.54 nvidia-curand-cu12==10.3.2.106 nvidia-cusolver-cu12==11.4.5.107 nvidia-cusparse-cu12==12.1.0.106 nvidia-nccl-cu12==2.18.1 nvidia-nvjitlink-cu12==12.3.101 nvidia-nvtx-cu12==12.1.105 oauthlib==3.2.2 openai==0.27.2 opt-einsum==3.3.0 overrides==3.1.0 packaging==23.2 pandas==1.3.5 pathtools==0.1.2 pathy==0.10.3 Pillow==10.1.0 pluggy==0.13.1 portalocker==2.8.2 preshed==3.0.9 progressbar==2.5 promise==2.3 protobuf==3.20.3 psutil==5.9.6 py==1.11.0 py-rouge==1.1 pyarrow==14.0.1 pyasn1==0.5.1 pyasn1-modules==0.3.0 pybind11==2.11.1 pycountry==22.3.5 pydantic==1.7.4 Pygments==2.17.2 pyparsing==3.1.1 pytest==6.2.4 pytextrank==3.2.4 python-dateutil==2.8.2 pytz==2023.3.post1 PyYAML==6.0.1 regex==2023.10.3 repro==0.1.4 requests==2.31.0 requests-oauthlib==1.3.1 responses==0.18.0 rich==12.0.0 -e @.***#egg=rl4lms rouge-score==0.0.4 rsa==4.9 sacrebleu==2.2.0 sacremoses==0.1.1 scikit-learn==1.3.2 scipy==1.10.1 segtok==1.5.11 sentence-transformers==2.2.2 sentencepiece==0.1.99 sentry-sdk==1.37.1 setproctitle==1.3.3 shortuuid==1.0.11 six==1.16.0 smart-open==6.4.0 smmap==5.0.1 spacy==3.0.6 spacy-legacy==3.0.12 srsly==2.4.8 stable-baselines3==1.5.1a5 string2string==0.0.145 sympy==1.12 tabulate==0.9.0 tensorboard==2.13.0 tensorboard-data-server==0.7.2 tensorflow==2.13.1 tensorflow-estimator==2.13.0 tensorflow-io-gcs-filesystem==0.34.0 termcolor==2.3.0 tf-slim==1.1.0 thinc==8.0.17 threadpoolctl==3.2.0 tokenizers==0.12.1 toml==0.10.2 torch==1.11.0+cu113 torchaudio==0.11.0+cu113 torchvision==0.12.0+cu113 tqdm==4.64.0 transformers==4.18.0 triton==2.1.0 typer==0.3.2 typing_extensions==4.5.0 urllib3==2.1.0 wandb==0.12.15 wasabi==0.10.1 websocket-client==1.6.4 Werkzeug==3.0.1 wrapt==1.16.0 xxhash==3.4.1 yake==0.4.8 yarl==1.9.3 zipp==3.17.0
榭 @.***
------------------ 原始邮件 ------------------ 发件人: "Leezekun/Directional-Stimulus-Prompting" @.>; 发送时间: 2024年1月25日(星期四) 晚上8:38 @.>; @.**@.>; 主题: Re: [Leezekun/Directional-Stimulus-Prompting] NotImplementedError: Loading a dataset cached in a LocalFileSystem is not supported.解决后，又遇到datasets会和rl4lms冲突 (Issue #1)
您好 请问这个问题解决了吗 我还不知道该怎么解决
— Reply to this email directly, view it on GitHub, or unsubscribe. You are receiving this because you authored the thread.Message ID: @.***>
wmm228
commented
9 months ago 谢谢您的回答！我还想请教一个问题：未定义的变量错误（selecteddata）（download.py文件第189行）是通过升级或者降级环境包解决的，还是通过修改代码解决的呢？如果是修改代码能否告知修改之后的代码吗？再次感谢！
lrgao
commented
5 months ago 谢谢您的回答！我还想请教一个问题：未定义的变量错误（selecteddata）（download.py文件第189行）是通过升级或者降级环境包解决的，还是通过修改代码解决的呢？如果是修改代码能否告知修改之后的代码吗？
请问这个问题解决了吗？怎么处理这个呢
CathyKitten
commented
5 months ago hello！这样应该是可以运行，但是不知道是否正确： 一开始直接把selected_data换成train_data会报错 然后就模仿下面的一些代码 改成把train_data塞进selected_data里
榭 @.***
------------------ 原始邮件 ------------------ 发件人: "Leezekun/Directional-Stimulus-Prompting" @.>; 发送时间: 2024年5月28日(星期二) 下午3:52 @.>; @.**@.>; 主题: Re: [Leezekun/Directional-Stimulus-Prompting] NotImplementedError: Loading a dataset cached in a LocalFileSystem is not supported.解决后，又遇到datasets会和rl4lms冲突 (Issue #1)
谢谢您的回答！我还想请教一个问题：未定义的变量错误（selecteddata）（download.py文件第189行）是通过升级或者降级环境包解决的，还是通过修改代码解决的呢？如果是修改代码能否告知修改之后的代码吗？
请问这个问题解决了吗？怎么处理这个呢
— Reply to this email directly, view it on GitHub, or unsubscribe. You are receiving this because you authored the thread.Message ID: @.***>
lrgao
commented
5 months ago hello！这样应该是可以运行，但是不知道是否正确： 一开始直接把selected_data换成train_data会报错 然后就模仿下面的一些代码 改成把train_data塞进selected_data里 榭 @. … ------------------ 原始邮件 ------------------ 发件人: "Leezekun/Directional-Stimulus-Prompting" @.>; 发送时间: 2024年5月28日(星期二) 下午3:52 @.>; @*.**@*.>; 主题: Re: [Leezekun/Directional-Stimulus-Prompting] NotImplementedError: Loading a dataset cached in a LocalFileSystem is not supported.解决后，又遇到datasets会和rl4lms冲突 (Issue #1) 谢谢您的回答！我还想请教一个问题：未定义的变量错误（selecteddata）（download.py文件第189行）是通过升级或者降级环境包解决的，还是通过修改代码解决的呢？如果是修改代码能否告知修改之后的代码吗？ 请问这个问题解决了吗？怎么处理这个呢 — Reply to this email directly, view it on GitHub, or unsubscribe. You are receiving this because you authored the thread.Message ID: @.>
ok，解决了，感谢
遇到了一个报错NotImplementedError: Loading a dataset cached in a LocalFileSystem is not supported.然后我看了一下github上的issue，好像都是这几天才发现的问题。按照github上的解决方法，是更新datasets包。但是更新datasets会和rl4lms冲突，rl4lms会退版本，然后报几个变量定义为空的错；更新rl4lms会把datasets退版本，然后报错: LocalFileSystem is not supported.还有一种方法是升级这个包，pip install fsspec==2023.9.2，但是也是会报错变量未定义。未定义的变量是selected_data和test_data等。
