OrionStarAI / Orion

Orion-14B is a family of models includes a 14B foundation LLM, and a series of models: a chat model, a long context model, a quantized model, a RAG fine-tuned model, and an Agent fine-tuned model. Orion-14B 系列模型包括一个具有140亿参数的多语言基座大模型以及一系列相关的衍生模型,包括对话模型,长文本模型,量化模型,RAG微调模型,Agent微调模型等。
Apache License 2.0
784 stars 57 forks source link

mac-m1 yi bug #36

Open zyxcambridge opened 9 months ago

zyxcambridge commented 9 months ago

llm_load_tensors: ggml ctx size = 0.41 MiB ggml_backend_metal_buffer_from_ptr: error: failed to allocate buffer, size = 0.00 MiB llama_model_load: error loading model: failed to allocate buffer llama_load_model_from_file: failed to load model llama_init_from_gpt_params: error: failed to load model '/Users/zhangyixin/Desktop/llama.cpp/TheBloke/Yi-34B-Chat-GGUF/yi-34b-chat.Q8_0.gguf' main: error: unable to load model

1021 huggingface-cli download --token YOUR_TOKEN --resume-download --local-dir-use-symlinks False TheBloke/Yi-34B-Chat-GGUF --include "yi-34b-chat.Q8_0.gguf" --local-dir TheBloke/Yi-34B-Chat-GGUF\n 1022 chmod +x /Users/zhangyixin/Desktop/llama.cpp/TheBloke/Yi-34B-Chat-GGUF/yi-34b-chat.Q8_0.gguf 1023 /Users/zhangyixin/Desktop/llama.cpp/TheBloke/Yi-34B-Chat-GGUF/yi-34b-chat.Q8_0.gguf 1024 ./main --frequency-penalty 0.5 --frequency-penalty 0.5 --top-k 5 --top-p 0.9 -m /Users/zhangyixin/Desktop/llama.cpp/TheBloke/Yi-34B-Chat-GGUF/yi-34b-chat.Q8_0.gguf -p "Building a website can be done in 10 simple steps:\nStep 1:" -n 400 -e\n 1025 hist

zyxcambridge commented 9 months ago

Last login: Mon Jan 22 22:13:11 on ttys011 (base) zhangyixin@zhangyixin call_rec % (base) zhangyixin@zhangyixin call_rec % code .. (base) zhangyixin@zhangyixin call_rec % [Restored Jan 24, 2024 at 15:06:23] Last login: Wed Jan 24 15:06:23 on ttys014 /bin/date: option requires an argument -- r usage: date [-jnRu] [-I[date|hours|minutes|seconds]] [-f input_fmt] [-r filename|seconds] [-v[+|-]val[y|m|w|d|H|M|S]] [[[[mm]dd]HH]MM[[cc]yy][.SS] | new_date] [+output_fmt] /Users/zhangyixin/.zsh_sessions/686DBD1D-CCFD-4E3A-A998-6E96A9EB8A9E.session:2: command not found: Saving (base) zhangyixin@zhangyixin call_rec % (base) zhangyixin@zhangyixin call_rec % (base) zhangyixin@zhangyixin call_rec % (base) zhangyixin@zhangyixin call_rec % cd 。。 cd: no such file or directory: 。。 (base) zhangyixin@zhangyixin call_rec % cd .. (base) zhangyixin@zhangyixin record_voice % l zsh: command not found: l (base) zhangyixin@zhangyixin record_voice % cd .. (base) zhangyixin@zhangyixin Desktop % ls 1111 bev-compare.mp4 prescan_vis 128线仿真配置参数.xlsx chatgpt-on-wechat project_plan_v2111.xlsx 2023GECC上海站模板(1).pptx cognitive-services-speech-sdk python-vlc 292367948-db99d650-dec1-4531-b4b2-e085bfcadfb7.mp4 drive-sim-semantic-sensors-plugin question.docx AI-voice-chat examples react-trello AppAgent focalboard record_voice AppFlowy.zip git rem Azure-OpenAI-demos gpt-crawler run.nvidia-drive-smi.sh CogVLM gpt-crawler-py sa DSVT gstreamer sagittarius DetZero hackathon-baidu seamless_communication FastChat hackathon-google siyuan FasterTransformer hackathon20231215 siyuan.1 GECCSH讲师填写模板-张益新.docx hcgf sn372862211719_12_14_2023_06_45_07_2F.pcd Google AI studio.pptx instruction_merge_set speech_zyx Inno_demo jan stable-diffusion-webui-chinese LLaVA jiaban stable_dff_lep.py LifeLogging-QiJuZhu jitsi-meet tcp_connect_ps32 MFTCoder jitsi-meet-sdk-samples tensorrt7.2 MeetingSummary joplin transcript_txt OmniList latest-generic 2 trilium OpenPCDet latest-generic-1 trt Prescan 试用 License 申请信息表格-inno-zhangyixin.xlsx latest-generic-202305最新的nvidia-drive-smi文档.zip twitter_download Prescan 试用 License 申请信息表格.xlsx lidar-log (1).txt uhabits Presentation2 [Autosaved].pptx life创想1.wav untitled.webm RecordLife llama.cpp vditor Screen Recording 2023-07-18 at 09.11.40.mov llamafile vlc Screen Recording 2023-07-18 at 18.12.11.mov llm-vscode vlc-android Screen Recording 2023-09-07 at 11.17.59.mov llm-vscode-inference-server vllm Screen Recording 2023-10-20 at 11.44.49.mov macOSpilot-ai-assistant wekan Screen Recording 2023-11-08 at 15.31.32.mov magic-animate x.data.zyx.py Screen Recording 2023-11-27 at 10.41.16.mov mattermost zcgs_202311101547 Screen Recording 2023-11-27 at 10.42.57.mov mlx-examples 出差小结模板--20230531.doc ShareX mp4_summary 出差小结模板--20230731.doc TaskBoard my-crawler 出差小结模板--20230918.doc Teamlinker nizijibunengxunma.m4a 出差小结模板--20230920.doc TomatoBar nvidia-drive-smi.mov 图达通-光轮.docx agents obs-studio 图达通-张益新 ai_algorithm_training_and_deployment_process.pptx ollama-voice-mac 图达通Demo ai_models omnisense 图达通作为一家激光雷达公司生态合作战略.docx apollo openai-translator 字幕及脚本 appflowy optimum-intel 感知结果数据分析 appflowy-board orion 汇总数据99.xlsx appflowy-editor orionstar.py 边缘计算- AI时代编程指南-张益新 [Autosaved].pptx audacity output_image.png 边缘计算- AI时代编程指南-张益新1215 [Autosaved].pptx baichuan_hackathon.py pdf baichuanhackathon pic (base) zhangyixin@zhangyixin Desktop % git clone https://github.com/facebookresearch/llama.git Cloning into 'llama'... ^C (base) zhangyixin@zhangyixin Desktop % export https_proxy=http://127.0.0.1:7890 http_proxy=http://127.0.0.1:7890 all_proxy=socks5://127.0.0.1:7890 (base) zhangyixin@zhangyixin Desktop % git clone https://github.com/facebookresearch/llama.git
Cloning into 'llama'... remote: Enumerating objects: 417, done. remote: Total 417 (delta 0), reused 0 (delta 0), pack-reused 417 Receiving objects: 100% (417/417), 1.09 MiB | 1.87 MiB/s, done. Resolving deltas: 100% (219/219), done. (base) zhangyixin@zhangyixin Desktop % cd llama (base) zhangyixin@zhangyixin llama % ls CODE_OF_CONDUCT.md LICENSE README.md UPDATES.md download.sh example_text_completion.py requirements.txt CONTRIBUTING.md MODEL_CARD.md Responsible-Use-Guide.pdf USE_POLICY.md example_chat_completion.py llama setup.py (base) zhangyixin@zhangyixin llama % code . (base) zhangyixin@zhangyixin llama % meta-llama/Llama-2-13b-hf zsh: no such file or directory: meta-llama/Llama-2-13b-hf (base) zhangyixin@zhangyixin llama % huggingface-cli download --token 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 --resume-download --local-dir-use-symlinks False jartine/Mixtral-8x7B-Instruct-v0.1-llamafile --include "mixtral-8x7b-instruct-v0.1.Q8_0.llamafile" --local-dir jartine/Mixtral-8x7B-Instruct-v0.1-llamafile (base) zhangyixin@zhangyixin llama % huggingface-cli download --token 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 --resume-download --local-dir-use-symlinks False meta-llama/Llama-2-13b-hf Consider using hf_transfer for faster downloads. This solution comes with some limitations. See https://huggingface.co/docs/huggingface_hub/hf_transfer for more details. Traceback (most recent call last): File "/Users/zhangyixin/anaconda3/lib/python3.11/site-packages/huggingface_hub/utils/_errors.py", line 270, in hf_raise_for_status response.raise_for_status() File "/Users/zhangyixin/anaconda3/lib/python3.11/site-packages/requests/models.py", line 1021, in raise_for_status raise HTTPError(http_error_msg, response=self) requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://hf-mirror.com/api/models/meta-llama/Llama-2-13b-hf/revision/main

The above exception was the direct cause of the following exception:

Traceback (most recent call last): File "/Users/zhangyixin/anaconda3/bin/huggingface-cli", line 8, in sys.exit(main()) ^^^^^^ File "/Users/zhangyixin/anaconda3/lib/python3.11/site-packages/huggingface_hub/commands/huggingface_cli.py", line 49, in main service.run() File "/Users/zhangyixin/anaconda3/lib/python3.11/site-packages/huggingface_hub/commands/download.py", line 160, in run print(self._download()) # Print path to downloaded files ^^^^^^^^^^^^^^^^ File "/Users/zhangyixin/anaconda3/lib/python3.11/site-packages/huggingface_hub/commands/download.py", line 201, in _download return snapshot_download( ^^^^^^^^^^^^^^^^^^ File "/Users/zhangyixin/anaconda3/lib/python3.11/site-packages/huggingface_hub/utils/_validators.py", line 118, in _inner_fn return fn(*args, kwargs) ^^^^^^^^^^^^^^^^^^^ File "/Users/zhangyixin/anaconda3/lib/python3.11/site-packages/huggingface_hub/_snapshot_download.py", line 187, in snapshot_download repo_info = api.repo_info(repo_id=repo_id, repo_type=repo_type, revision=revision, token=token) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/Users/zhangyixin/anaconda3/lib/python3.11/site-packages/huggingface_hub/utils/_validators.py", line 118, in _inner_fn return fn(*args, *kwargs) ^^^^^^^^^^^^^^^^^^^ File "/Users/zhangyixin/anaconda3/lib/python3.11/site-packages/huggingface_hub/hf_api.py", line 2112, in repo_info return method( ^^^^^^^ File "/Users/zhangyixin/anaconda3/lib/python3.11/site-packages/huggingface_hub/utils/_validators.py", line 118, in _inner_fn return fn(args, kwargs) ^^^^^^^^^^^^^^^^^^^ File "/Users/zhangyixin/anaconda3/lib/python3.11/site-packages/huggingface_hub/hf_api.py", line 1922, in model_info hf_raise_for_status(r) File "/Users/zhangyixin/anaconda3/lib/python3.11/site-packages/huggingface_hub/utils/_errors.py", line 286, in hf_raise_for_status raise GatedRepoError(message, response) from e huggingface_hub.utils._errors.GatedRepoError: 403 Client Error. (Request ID: Root=1-65b8a524-24aad0f3022fa2b252f76e2e;97c39b27-5f11-4605-afcd-4fee8d203666)

Cannot access gated repo for url https://hf-mirror.com/api/models/meta-llama/Llama-2-13b-hf/revision/main. Your request to access model meta-llama/Llama-2-13b-hf is awaiting a review from the repo authors. (base) zhangyixin@zhangyixin llama % huggingface-cli download --token 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 --resume-download --local-dir-use-symlinks False meta-llama/Llama-2-13b-hf (base) zhangyixin@zhangyixin llama % ikawrakow/qwen-14b-chat-gguf zsh: no such file or directory: ikawrakow/qwen-14b-chat-gguf (base) zhangyixin@zhangyixin llama % meta-llama/Llama-2-13b-hf
(base) zhangyixin@zhangyixin llama % huggingface-cli download --token YOUR_TOKEN --resume-download --local-dir-use-symlinks False ikawrakow/qwen-14b-chat-gguf --include "qwen-14b-chat-q5-0.gguf" --local-dir ikawrakow/qwen-14b-chat-gguf

Consider using hf_transfer for faster downloads. This solution comes with some limitations. See https://huggingface.co/docs/huggingface_hub/hf_transfer for more details. Fetching 1 files: 0%| | 0/1 [00:00<?, ?it/s]downloading https://hf-mirror.com/ikawrakow/qwen-14b-chat-gguf/resolve/8b50175075c72c068f0118ed292f71caf81727ce/qwen-14b-chat-q5-0.gguf to /Users/zhangyixin/.cache/huggingface/hub/models--ikawrakow--qwen-14b-chat-gguf/blobs/7ecc891a8eedbaf98c76d7e276406f09698c07cdc1558ede96830c1dc38c2ea1.incomplete ^Fetching 1 files: 0%| | 0/1 [03:36<?, ?it/s] ^CTraceback (most recent call last): File "/Users/zhangyixin/anaconda3/lib/python3.11/site-packages/tqdm/contrib/concurrent.py", line 51, in _executor_map return list(tqdm_class(ex.map(fn, *iterables, chunksize=chunksize), **kwargs)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/Users/zhangyixin/anaconda3/lib/python3.11/site-packages/tqdm/std.py", line 1178, in iter for obj in iterable: File "/Users/zhangyixin/anaconda3/lib/python3.11/concurrent/futures/_base.py", line 619, in result_iterator yield _result_or_cancel(fs.pop()) ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/Users/zhangyixin/anaconda3/lib/python3.11/concurrent/futures/_base.py", line 317, in _result_or_cancel return fut.result(timeout) ^^^^^^^^^^^^^^^^^^^ File "/Users/zhangyixin/anaconda3/lib/python3.11/concurrent/futures/_base.py", line 451, in result self._condition.wait(timeout) File "/Users/zhangyixin/anaconda3/lib/python3.11/threading.py", line 320, in wait waiter.acquire() KeyboardInterrupt

During handling of the above exception, another exception occurred:

Traceback (most recent call last): File "/Users/zhangyixin/anaconda3/bin/huggingface-cli", line 8, in sys.exit(main()) ^^^^^^ File "/Users/zhangyixin/anaconda3/lib/python3.11/site-packages/huggingface_hub/commands/huggingface_cli.py", line 49, in main service.run() File "/Users/zhangyixin/anaconda3/lib/python3.11/site-packages/huggingface_hub/commands/download.py", line 160, in run print(self._download()) # Print path to downloaded files ^^^^^^^^^^^^^^^^ File "/Users/zhangyixin/anaconda3/lib/python3.11/site-packages/huggingface_hub/commands/download.py", line 201, in _download return snapshot_download( ^^^^^^^^^^^^^^^^^^ File "/Users/zhangyixin/anaconda3/lib/python3.11/site-packages/huggingface_hub/utils/_validators.py", line 118, in _inner_fn return fn(*args, *kwargs) ^^^^^^^^^^^^^^^^^^^ File "/Users/zhangyixin/anaconda3/lib/python3.11/site-packages/huggingface_hub/_snapshot_download.py", line 238, in snapshot_download thread_map( File "/Users/zhangyixin/anaconda3/lib/python3.11/site-packages/tqdm/contrib/concurrent.py", line 69, in thread_map return _executor_map(ThreadPoolExecutor, fn, iterables, **tqdm_kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/Users/zhangyixin/anaconda3/lib/python3.11/site-packages/tqdm/contrib/concurrent.py", line 49, in _executor_map with PoolExecutor(max_workers=max_workers, initializer=tqdm_class.set_lock, File "/Users/zhangyixin/anaconda3/lib/python3.11/concurrent/futures/_base.py", line 647, in exit self.shutdown(wait=True) File "/Users/zhangyixin/anaconda3/lib/python3.11/concurrent/futures/thread.py", line 235, in shutdown t.join() File "/Users/zhangyixin/anaconda3/lib/python3.11/threading.py", line 1112, in join self._wait_for_tstate_lock() File "/Users/zhangyixin/anaconda3/lib/python3.11/threading.py", line 1132, in _wait_for_tstate_lock if lock.acquire(block, timeout): ^^^^^^^^^^^^^^^^^^^^^^^^^^^^ KeyboardInterrupt

(base) zhangyixin@zhangyixin llama % cd ../llama.cpp (base) zhangyixin@zhangyixin llama.cpp % huggingface-cli download --token YOUR_TOKEN --resume-download --local-dir-use-symlinks False ikawrakow/qwen-14b-chat-gguf --include "qwen-14b-chat-q5-0.gguf" --local-dir ikawrakow/qwen-14b-chat-gguf

Consider using hf_transfer for faster downloads. This solution comes with some limitations. See https://huggingface.co/docs/huggingface_hub/hf_transfer for more details. Fetching 1 files: 0%| | 0/1 [00:00<?, ?it/s]downloading https://hf-mirror.com/ikawrakow/qwen-14b-chat-gguf/resolve/8b50175075c72c068f0118ed292f71caf81727ce/qwen-14b-chat-q5-0.gguf to /Users/zhangyixin/.cache/huggingface/hub/models--ikawrakow--qwen-14b-chat-gguf/blobs/7ecc891a8eedbaf98c76d7e276406f09698c07cdc1558ede96830c1dc38c2ea1.incomplete Fetching 1 files: 0%| | 0/1 [00:00<?, ?it/s] Traceback (most recent call last): File "/Users/zhangyixin/anaconda3/lib/python3.11/site-packages/urllib3/connectionpool.py", line 711, in urlopen self._prepare_proxy(conn) File "/Users/zhangyixin/anaconda3/lib/python3.11/site-packages/urllib3/connectionpool.py", line 1007, in _prepare_proxy conn.connect() File "/Users/zhangyixin/anaconda3/lib/python3.11/site-packages/urllib3/connection.py", line 419, in connect self.sock = ssl_wrapsocket( ^^^^^^^^^^^^^^^^ File "/Users/zhangyixin/anaconda3/lib/python3.11/site-packages/urllib3/util/ssl.py", line 449, in ssl_wrap_socket ssl_sock = _ssl_wrap_socketimpl( ^^^^^^^^^^^^^^^^^^^^^^ File "/Users/zhangyixin/anaconda3/lib/python3.11/site-packages/urllib3/util/ssl.py", line 493, in _ssl_wrap_socket_impl return ssl_context.wrap_socket(sock, server_hostname=server_hostname) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/Users/zhangyixin/anaconda3/lib/python3.11/ssl.py", line 517, in wrap_socket return self.sslsocket_class._create( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/Users/zhangyixin/anaconda3/lib/python3.11/ssl.py", line 1075, in _create self.do_handshake() File "/Users/zhangyixin/anaconda3/lib/python3.11/ssl.py", line 1346, in do_handshake self._sslobj.do_handshake() ssl.SSLEOFError: EOF occurred in violation of protocol (_ssl.c:1002)

During handling of the above exception, another exception occurred:

Traceback (most recent call last): File "/Users/zhangyixin/anaconda3/lib/python3.11/site-packages/requests/adapters.py", line 486, in send resp = conn.urlopen( ^^^^^^^^^^^^^ File "/Users/zhangyixin/anaconda3/lib/python3.11/site-packages/urllib3/connectionpool.py", line 798, in urlopen retries = retries.increment( ^^^^^^^^^^^^^^^^^^ File "/Users/zhangyixin/anaconda3/lib/python3.11/site-packages/urllib3/util/retry.py", line 592, in increment raise MaxRetryError(_pool, url, error or ResponseError(cause)) urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='cdn-lfs-us-1.hf-mirror.com', port=443): Max retries exceeded with url: /repos/8e/f9/8ef9c2281bce6adb0d57e67ffea7e037e0c719177b55822553587c465ba8c0a2/7ecc891a8eedbaf98c76d7e276406f09698c07cdc1558ede96830c1dc38c2ea1?response-content-disposition=attachment%3B+filename*%3DUTF-8%27%27qwen-14b-chat-q5-0.gguf%3B+filename%3D%22qwen-14b-chat-q5-0.gguf%22%3B&Expires=1706859586&Policy=eyJTdGF0ZW1lbnQiOlt7IkNvbmRpdGlvbiI6eyJEYXRlTGVzc1RoYW4iOnsiQVdTOkVwb2NoVGltZSI6MTcwNjg1OTU4Nn19LCJSZXNvdXJjZSI6Imh0dHBzOi8vY2RuLWxmcy11cy0xLmh1Z2dpbmdmYWNlLmNvL3JlcG9zLzhlL2Y5LzhlZjljMjI4MWJjZTZhZGIwZDU3ZTY3ZmZlYTdlMDM3ZTBjNzE5MTc3YjU1ODIyNTUzNTg3YzQ2NWJhOGMwYTIvN2VjYzg5MWE4ZWVkYmFmOThjNzZkN2UyNzY0MDZmMDk2OThjMDdjZGMxNTU4ZWRlOTY4MzBjMWRjMzhjMmVhMT9yZXNwb25zZS1jb250ZW50LWRpc3Bvc2l0aW9uPSoifV19&Signature=BpcXicbD8FXy8NzDbeL-ox7uRQnpbUghYiGjvMRDinqWPCxaqg8XdI5cdBkNSHEWkxnW44fwrMWJuOefkmsHA9ie1TWJKQ8KLRHUi920232ZkQNVgPuoS5hT3ZkgHzJEBFrk5Lf7oXd6j5JhVQDqxnWj4Ha-c8MwDXrmi-DHTTI8JrqSX1MoKCO1K0NFW~DYBlbqRSrbMcoMf6VSRwQUKmXOPOWuKmuWK6P4DsS6k9UF2cscZ8VUBsaE-ZAF6C4ATIWgSpyVeeVS38DpSKCAOZIxDcFwv3cDEPSyg6XIvWkSjPaKP7yRc9bnSr-NQN7DlEkE8cxLXg8wvFhR4Gylbw__&Key-Pair-Id=KCD77M1F0VK2B (Caused by SSLError(SSLEOFError(8, 'EOF occurred in violation of protocol (_ssl.c:1002)')))

During handling of the above exception, another exception occurred:

Traceback (most recent call last): File "/Users/zhangyixin/anaconda3/bin/huggingface-cli", line 8, in sys.exit(main()) ^^^^^^ File "/Users/zhangyixin/anaconda3/lib/python3.11/site-packages/huggingface_hub/commands/huggingface_cli.py", line 49, in main service.run() File "/Users/zhangyixin/anaconda3/lib/python3.11/site-packages/huggingface_hub/commands/download.py", line 160, in run print(self._download()) # Print path to downloaded files ^^^^^^^^^^^^^^^^ File "/Users/zhangyixin/anaconda3/lib/python3.11/site-packages/huggingface_hub/commands/download.py", line 201, in _download return snapshot_download( ^^^^^^^^^^^^^^^^^^ File "/Users/zhangyixin/anaconda3/lib/python3.11/site-packages/huggingface_hub/utils/_validators.py", line 118, in _inner_fn return fn(*args, kwargs) ^^^^^^^^^^^^^^^^^^^ File "/Users/zhangyixin/anaconda3/lib/python3.11/site-packages/huggingface_hub/_snapshot_download.py", line 238, in snapshot_download thread_map( File "/Users/zhangyixin/anaconda3/lib/python3.11/site-packages/tqdm/contrib/concurrent.py", line 69, in thread_map return _executor_map(ThreadPoolExecutor, fn, *iterables, *tqdm_kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/Users/zhangyixin/anaconda3/lib/python3.11/site-packages/tqdm/contrib/concurrent.py", line 51, in _executor_map return list(tqdm_class(ex.map(fn, iterables, chunksize=chunksize), kwargs)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/Users/zhangyixin/anaconda3/lib/python3.11/site-packages/tqdm/std.py", line 1178, in iter for obj in iterable: File "/Users/zhangyixin/anaconda3/lib/python3.11/concurrent/futures/_base.py", line 619, in result_iterator yield _result_or_cancel(fs.pop()) ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/Users/zhangyixin/anaconda3/lib/python3.11/concurrent/futures/_base.py", line 317, in _result_or_cancel return fut.result(timeout) ^^^^^^^^^^^^^^^^^^^ File "/Users/zhangyixin/anaconda3/lib/python3.11/concurrent/futures/_base.py", line 456, in result return self.get_result() ^^^^^^^^^^^^^^^^^^^ File "/Users/zhangyixin/anaconda3/lib/python3.11/concurrent/futures/_base.py", line 401, in get_result raise self._exception File "/Users/zhangyixin/anaconda3/lib/python3.11/concurrent/futures/thread.py", line 58, in run result = self.fn(*self.args, self.kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/Users/zhangyixin/anaconda3/lib/python3.11/site-packages/huggingface_hub/_snapshot_download.py", line 213, in _inner_hf_hub_download return hf_hub_download( ^^^^^^^^^^^^^^^^ File "/Users/zhangyixin/anaconda3/lib/python3.11/site-packages/huggingface_hub/utils/_validators.py", line 118, in _inner_fn return fn(args, kwargs) ^^^^^^^^^^^^^^^^^^^ File "/Users/zhangyixin/anaconda3/lib/python3.11/site-packages/huggingface_hub/file_download.py", line 1461, in hf_hub_download http_get( File "/Users/zhangyixin/anaconda3/lib/python3.11/site-packages/huggingface_hub/file_download.py", line 468, in http_get r = _request_wrapper( ^^^^^^^^^^^^^^^^^ File "/Users/zhangyixin/anaconda3/lib/python3.11/site-packages/huggingface_hub/file_download.py", line 425, in _request_wrapper response = get_session().request(method=method, url=url, params) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/Users/zhangyixin/anaconda3/lib/python3.11/site-packages/requests/sessions.py", line 589, in request resp = self.send(prep, send_kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/Users/zhangyixin/anaconda3/lib/python3.11/site-packages/requests/sessions.py", line 703, in send r = adapter.send(request, kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/Users/zhangyixin/anaconda3/lib/python3.11/site-packages/huggingface_hub/utils/_http.py", line 63, in send return super().send(request, args, kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/Users/zhangyixin/anaconda3/lib/python3.11/site-packages/requests/adapters.py", line 517, in send raise SSLError(e, request=request) requests.exceptions.SSLError: (MaxRetryError("HTTPSConnectionPool(host='cdn-lfs-us-1.hf-mirror.com', port=443): Max retries exceeded with url: /repos/8e/f9/8ef9c2281bce6adb0d57e67ffea7e037e0c719177b55822553587c465ba8c0a2/7ecc891a8eedbaf98c76d7e276406f09698c07cdc1558ede96830c1dc38c2ea1?response-content-disposition=attachment%3B+filename*%3DUTF-8%27%27qwen-14b-chat-q5-0.gguf%3B+filename%3D%22qwen-14b-chat-q5-0.gguf%22%3B&Expires=1706859586&Policy=eyJTdGF0ZW1lbnQiOlt7IkNvbmRpdGlvbiI6eyJEYXRlTGVzc1RoYW4iOnsiQVdTOkVwb2NoVGltZSI6MTcwNjg1OTU4Nn19LCJSZXNvdXJjZSI6Imh0dHBzOi8vY2RuLWxmcy11cy0xLmh1Z2dpbmdmYWNlLmNvL3JlcG9zLzhlL2Y5LzhlZjljMjI4MWJjZTZhZGIwZDU3ZTY3ZmZlYTdlMDM3ZTBjNzE5MTc3YjU1ODIyNTUzNTg3YzQ2NWJhOGMwYTIvN2VjYzg5MWE4ZWVkYmFmOThjNzZkN2UyNzY0MDZmMDk2OThjMDdjZGMxNTU4ZWRlOTY4MzBjMWRjMzhjMmVhMT9yZXNwb25zZS1jb250ZW50LWRpc3Bvc2l0aW9uPSoifV19&Signature=BpcXicbD8FXy8NzDbeL-ox7uRQnpbUghYiGjvMRDinqWPCxaqg8XdI5cdBkNSHEWkxnW44fwrMWJuOefkmsHA9ie1TWJKQ8KLRHUi920232ZkQNVgPuoS5hT3ZkgHzJEBFrk5Lf7oXd6j5JhVQDqxnWj4Ha-c8MwDXrmi-DHTTI8JrqSX1MoKCO1K0NFW~DYBlbqRSrbMcoMf6VSRwQUKmXOPOWuKmuWK6P4DsS6k9UF2cscZ8VUBsaE-ZAF6C4ATIWgSpyVeeVS38DpSKCAOZIxDcFwv3cDEPSyg6XIvWkSjPaKP7yRc9bnSr-NQN7DlEkE8cxLXg8wvFhR4Gylbw__&Key-Pair-Id=KCD77M1F0VK2B (Caused by SSLError(SSLEOFError(8, 'EOF occurred in violation of protocol (_ssl.c:1002)')))"), '(Request ID: 8e1f27a7-c44e-4225-8a9a-b5bd154562ed)') (base) zhangyixin@zhangyixin llama.cpp % huggingface-cli download --token YOUR_TOKEN --resume-download --local-dir-use-symlinks False TheBloke/Yi-34B-Chat-GGUF --include "yi-34b-chat.Q8_0.gguf" --local-dir TheBloke/Yi-34B-Chat-GGUF

Consider using hf_transfer for faster downloads. This solution comes with some limitations. See https://huggingface.co/docs/huggingface_hub/hf_transfer for more details. Fetching 1 files: 0%| | 0/1 [00:00<?, ?it/s]downloading https://hf-mirror.com/TheBloke/Yi-34B-Chat-GGUF/resolve/ee827f906e733381ab65c650dcfdd2caf6de8762/yi-34b-chat.Q8_0.gguf to /Users/zhangyixin/.cache/huggingface/hub/models--TheBloke--Yi-34B-Chat-GGUF/blobs/163011ba9907f85336681293420c12a3c7ab3e531618552be2340bcb298eba1e.incomplete

yi-34b-chat.Q8_0.gguf: 12%|█████████████████████ | 4.36G/36.5G [31:21<5:52:39, 1.52MB/s]

yi-34b-chat.Q8_0.gguf: 12%|█████████████████████ | 4.37G/36.5G [31:30<6:21:15, 1.41MB/s] yi-34b-chat.Q8_0.gguf: 19%|█████████████████████████████████ | 6.93G/36.5G [1:13:20<5:13:19, 1.58MB/s] Fetching 1 files: 0%| | 0/1 [1:13:21<?, ?it/s] Traceback (most recent call last): File "/Users/zhangyixin/anaconda3/bin/huggingface-cli", line 8, in sys.exit(main()) ^^^^^^ File "/Users/zhangyixin/anaconda3/lib/python3.11/site-packages/huggingface_hub/commands/huggingface_cli.py", line 49, in main service.run() File "/Users/zhangyixin/anaconda3/lib/python3.11/site-packages/huggingface_hub/commands/download.py", line 160, in run print(self._download()) # Print path to downloaded files ^^^^^^^^^^^^^^^^ File "/Users/zhangyixin/anaconda3/lib/python3.11/site-packages/huggingface_hub/commands/download.py", line 201, in _download return snapshot_download( ^^^^^^^^^^^^^^^^^^ File "/Users/zhangyixin/anaconda3/lib/python3.11/site-packages/huggingface_hub/utils/_validators.py", line 118, in _inner_fn return fn(*args, kwargs) ^^^^^^^^^^^^^^^^^^^ File "/Users/zhangyixin/anaconda3/lib/python3.11/site-packages/huggingface_hub/_snapshot_download.py", line 238, in snapshot_download thread_map( File "/Users/zhangyixin/anaconda3/lib/python3.11/site-packages/tqdm/contrib/concurrent.py", line 69, in thread_map return _executor_map(ThreadPoolExecutor, fn, *iterables, *tqdm_kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/Users/zhangyixin/anaconda3/lib/python3.11/site-packages/tqdm/contrib/concurrent.py", line 51, in _executor_map return list(tqdm_class(ex.map(fn, iterables, chunksize=chunksize), kwargs)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/Users/zhangyixin/anaconda3/lib/python3.11/site-packages/tqdm/std.py", line 1178, in iter for obj in iterable: File "/Users/zhangyixin/anaconda3/lib/python3.11/concurrent/futures/_base.py", line 619, in result_iterator yield _result_or_cancel(fs.pop()) ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/Users/zhangyixin/anaconda3/lib/python3.11/concurrent/futures/_base.py", line 317, in _result_or_cancel return fut.result(timeout) ^^^^^^^^^^^^^^^^^^^ File "/Users/zhangyixin/anaconda3/lib/python3.11/concurrent/futures/_base.py", line 456, in result return self.get_result() ^^^^^^^^^^^^^^^^^^^ File "/Users/zhangyixin/anaconda3/lib/python3.11/concurrent/futures/_base.py", line 401, in get_result raise self._exception File "/Users/zhangyixin/anaconda3/lib/python3.11/concurrent/futures/thread.py", line 58, in run result = self.fn(*self.args, *self.kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/Users/zhangyixin/anaconda3/lib/python3.11/site-packages/huggingface_hub/_snapshot_download.py", line 213, in _inner_hf_hub_download return hf_hub_download( ^^^^^^^^^^^^^^^^ File "/Users/zhangyixin/anaconda3/lib/python3.11/site-packages/huggingface_hub/utils/_validators.py", line 118, in _inner_fn return fn(args, **kwargs) ^^^^^^^^^^^^^^^^^^^ File "/Users/zhangyixin/anaconda3/lib/python3.11/site-packages/huggingface_hub/file_download.py", line 1461, in hf_hub_download http_get( File "/Users/zhangyixin/anaconda3/lib/python3.11/site-packages/huggingface_hub/file_download.py", line 569, in http_get raise EnvironmentError( OSError: Consistency check failed: file should be of size 36542282080 but has size 6931435298 (yi-34b-chat.Q8_0.gguf). We are sorry for the inconvenience. Please retry download and pass force_download=True, resume_download=False as argument. If the issue persists, please let us know by opening an issue on https://github.com/huggingface/huggingface_hub. (base) zhangyixin@zhangyixin llama.cpp % (base) zhangyixin@zhangyixin llama.cpp % (base) zhangyixin@zhangyixin llama.cpp % (base) zhangyixin@zhangyixin llama.cpp % (base) zhangyixin@zhangyixin llama.cpp % huggingface-cli download --token YOUR_TOKEN --resume-download --local-dir-use-symlinks False TheBloke/Yi-34B-Chat-GGUF --include "yi-34b-chat.Q8_0.gguf" --local-dir TheBloke/Yi-34B-Chat-GGUF

Consider using hf_transfer for faster downloads. This solution comes with some limitations. See https://huggingface.co/docs/huggingface_hub/hf_transfer for more details. Traceback (most recent call last): File "/Users/zhangyixin/anaconda3/lib/python3.11/site-packages/urllib3/connectionpool.py", line 711, in urlopen self._prepare_proxy(conn) File "/Users/zhangyixin/anaconda3/lib/python3.11/site-packages/urllib3/connectionpool.py", line 1007, in _prepare_proxy conn.connect() File "/Users/zhangyixin/anaconda3/lib/python3.11/site-packages/urllib3/connection.py", line 419, in connect self.sock = ssl_wrapsocket( ^^^^^^^^^^^^^^^^ File "/Users/zhangyixin/anaconda3/lib/python3.11/site-packages/urllib3/util/ssl.py", line 449, in ssl_wrap_socket ssl_sock = _ssl_wrap_socketimpl( ^^^^^^^^^^^^^^^^^^^^^^ File "/Users/zhangyixin/anaconda3/lib/python3.11/site-packages/urllib3/util/ssl.py", line 493, in _ssl_wrap_socket_impl return ssl_context.wrap_socket(sock, server_hostname=server_hostname) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/Users/zhangyixin/anaconda3/lib/python3.11/ssl.py", line 517, in wrap_socket return self.sslsocket_class._create( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/Users/zhangyixin/anaconda3/lib/python3.11/ssl.py", line 1075, in _create self.do_handshake() File "/Users/zhangyixin/anaconda3/lib/python3.11/ssl.py", line 1346, in do_handshake self._sslobj.do_handshake() ssl.SSLEOFError: EOF occurred in violation of protocol (_ssl.c:1002)

During handling of the above exception, another exception occurred:

Traceback (most recent call last): File "/Users/zhangyixin/anaconda3/lib/python3.11/site-packages/requests/adapters.py", line 486, in send resp = conn.urlopen( ^^^^^^^^^^^^^ File "/Users/zhangyixin/anaconda3/lib/python3.11/site-packages/urllib3/connectionpool.py", line 798, in urlopen retries = retries.increment( ^^^^^^^^^^^^^^^^^^ File "/Users/zhangyixin/anaconda3/lib/python3.11/site-packages/urllib3/util/retry.py", line 592, in increment raise MaxRetryError(_pool, url, error or ResponseError(cause)) urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='hf-mirror.com', port=443): Max retries exceeded with url: /api/models/TheBloke/Yi-34B-Chat-GGUF/revision/main (Caused by SSLError(SSLEOFError(8, 'EOF occurred in violation of protocol (_ssl.c:1002)')))

During handling of the above exception, another exception occurred:

Traceback (most recent call last): File "/Users/zhangyixin/anaconda3/bin/huggingface-cli", line 8, in sys.exit(main()) ^^^^^^ File "/Users/zhangyixin/anaconda3/lib/python3.11/site-packages/huggingface_hub/commands/huggingface_cli.py", line 49, in main service.run() File "/Users/zhangyixin/anaconda3/lib/python3.11/site-packages/huggingface_hub/commands/download.py", line 160, in run print(self._download()) # Print path to downloaded files ^^^^^^^^^^^^^^^^ File "/Users/zhangyixin/anaconda3/lib/python3.11/site-packages/huggingface_hub/commands/download.py", line 201, in _download return snapshot_download( ^^^^^^^^^^^^^^^^^^ File "/Users/zhangyixin/anaconda3/lib/python3.11/site-packages/huggingface_hub/utils/_validators.py", line 118, in _inner_fn return fn(*args, kwargs) ^^^^^^^^^^^^^^^^^^^ File "/Users/zhangyixin/anaconda3/lib/python3.11/site-packages/huggingface_hub/_snapshot_download.py", line 187, in snapshot_download repo_info = api.repo_info(repo_id=repo_id, repo_type=repo_type, revision=revision, token=token) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/Users/zhangyixin/anaconda3/lib/python3.11/site-packages/huggingface_hub/utils/_validators.py", line 118, in _inner_fn return fn(*args, *kwargs) ^^^^^^^^^^^^^^^^^^^ File "/Users/zhangyixin/anaconda3/lib/python3.11/site-packages/huggingface_hub/hf_api.py", line 2112, in repo_info return method( ^^^^^^^ File "/Users/zhangyixin/anaconda3/lib/python3.11/site-packages/huggingface_hub/utils/_validators.py", line 118, in _inner_fn return fn(args, kwargs) ^^^^^^^^^^^^^^^^^^^ File "/Users/zhangyixin/anaconda3/lib/python3.11/site-packages/huggingface_hub/hf_api.py", line 1921, in model_info r = get_session().get(path, headers=headers, timeout=timeout, params=params) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/Users/zhangyixin/anaconda3/lib/python3.11/site-packages/requests/sessions.py", line 602, in get return self.request("GET", url, kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/Users/zhangyixin/anaconda3/lib/python3.11/site-packages/requests/sessions.py", line 589, in request resp = self.send(prep, send_kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/Users/zhangyixin/anaconda3/lib/python3.11/site-packages/requests/sessions.py", line 703, in send r = adapter.send(request, *kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/Users/zhangyixin/anaconda3/lib/python3.11/site-packages/huggingface_hub/utils/_http.py", line 63, in send return super().send(request, args, **kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/Users/zhangyixin/anaconda3/lib/python3.11/site-packages/requests/adapters.py", line 517, in send raise SSLError(e, request=request) requests.exceptions.SSLError: (MaxRetryError("HTTPSConnectionPool(host='hf-mirror.com', port=443): Max retries exceeded with url: /api/models/TheBloke/Yi-34B-Chat-GGUF/revision/main (Caused by SSLError(SSLEOFError(8, 'EOF occurred in violation of protocol (_ssl.c:1002)')))"), '(Request ID: b872205a-367c-4034-a828-53a70d3b852b)') (base) zhangyixin@zhangyixin llama.cpp % huggingface-cli download --token YOUR_TOKEN --resume-download --local-dir-use-symlinks False TheBloke/Yi-34B-Chat-GGUF --include "yi-34b-chat.Q8_0.gguf" --local-dir TheBloke/Yi-34B-Chat-GGUF

Consider using hf_transfer for faster downloads. This solution comes with some limitations. See https://huggingface.co/docs/huggingface_hub/hf_transfer for more details. Fetching 1 files: 0%| | 0/1 [00:00<?, ?it/s]downloading https://hf-mirror.com/TheBloke/Yi-34B-Chat-GGUF/resolve/ee827f906e733381ab65c650dcfdd2caf6de8762/yi-34b-chat.Q8_0.gguf to /Users/zhangyixin/.cache/huggingface/hub/models--TheBloke--Yi-34B-Chat-GGUF/blobs/163011ba9907f85336681293420c12a3c7ab3e531618552be2340bcb298eba1e.incomplete Error while downloading from https://cdn-lfs-us-1.hf-mirror.com/repos/3c/42/3c429a32fd39f4234ac446273af0c092c59000a64cb19950a9c561a44e41c043/163011ba9907f85336681293420c12a3c7ab3e531618552be2340bcb298eba1e?response-content-disposition=attachment%3B+filename*%3DUTF-8%27%27yi-34b-chat.Q8_0.gguf%3B+filename%3D%22yi-34b-chat.Q8_0.gguf%22%3B&Expires=1706875115&Policy=eyJTdGF0ZW1lbnQiOlt7IkNvbmRpdGlvbiI6eyJEYXRlTGVzc1RoYW4iOnsiQVdTOkVwb2NoVGltZSI6MTcwNjg3NTExNX19LCJSZXNvdXJjZSI6Imh0dHBzOi8vY2RuLWxmcy11cy0xLmh1Z2dpbmdmYWNlLmNvL3JlcG9zLzNjLzQyLzNjNDI5YTMyZmQzOWY0MjM0YWM0NDYyNzNhZjBjMDkyYzU5MDAwYTY0Y2IxOTk1MGE5YzU2MWE0NGU0MWMwNDMvMTYzMDExYmE5OTA3Zjg1MzM2NjgxMjkzNDIwYzEyYTNjN2FiM2U1MzE2MTg1NTJiZTIzNDBiY2IyOThlYmExZT9yZXNwb25zZS1jb250ZW50LWRpc3Bvc2l0aW9uPSoifV19&Signature=TnClf5zxF5eMscBqjNhwlcnnUAIrx3NzDUROQcb2CgqTw1-uIw9W4Q2Hs9wh6qlbCXma2CM%7ECyamqVCNf%7E5KOAYdAugu2ge7uoqFnk6j13gJwAia3jyuYM3RMcVjJPIYM7pd4JUgNMpQbTv9N8V7m0fSjPseS9egaKc1b-ZNW%7Ehc6dMg8EmVSIbQmio4iKxuPfbGGUPW6YeraoOa2YMSze7O3-OQEjEpF%7E2kTAv32SmfL6bZGjPiL1RUDWMZ8OQlqOG4g-oppW3D-uUOW2VbrwG367Pl5O5aadtavsTuyKIwocTSUUVtA8bAr%7EcczAkRNH3AmI6%7EEcin9N86z6g55w__&Key-Pair-Id=KCD77M1F0VK2B: HTTPSConnectionPool(host='cdn-lfs-us-1.hf-mirror.com', port=443): Read timed out. Trying to resume download... Error while downloading from https://cdn-lfs-us-1.hf-mirror.com/repos/3c/42/3c429a32fd39f4234ac446273af0c092c59000a64cb19950a9c561a44e41c043/163011ba9907f85336681293420c12a3c7ab3e531618552be2340bcb298eba1e?response-content-disposition=attachment%3B+filename*%3DUTF-8%27%27yi-34b-chat.Q8_0.gguf%3B+filename%3D%22yi-34b-chat.Q8_0.gguf%22%3B&Expires=1706875115&Policy=eyJTdGF0ZW1lbnQiOlt7IkNvbmRpdGlvbiI6eyJEYXRlTGVzc1RoYW4iOnsiQVdTOkVwb2NoVGltZSI6MTcwNjg3NTExNX19LCJSZXNvdXJjZSI6Imh0dHBzOi8vY2RuLWxmcy11cy0xLmh1Z2dpbmdmYWNlLmNvL3JlcG9zLzNjLzQyLzNjNDI5YTMyZmQzOWY0MjM0YWM0NDYyNzNhZjBjMDkyYzU5MDAwYTY0Y2IxOTk1MGE5YzU2MWE0NGU0MWMwNDMvMTYzMDExYmE5OTA3Zjg1MzM2NjgxMjkzNDIwYzEyYTNjN2FiM2U1MzE2MTg1NTJiZTIzNDBiY2IyOThlYmExZT9yZXNwb25zZS1jb250ZW50LWRpc3Bvc2l0aW9uPSoifV19&Signature=TnClf5zxF5eMscBqjNhwlcnnUAIrx3NzDUROQcb2CgqTw1-uIw9W4Q2Hs9wh6qlbCXma2CM%7ECyamqVCNf%7E5KOAYdAugu2ge7uoqFnk6j13gJwAia3jyuYM3RMcVjJPIYM7pd4JUgNMpQbTv9N8V7m0fSjPseS9egaKc1b-ZNW%7Ehc6dMg8EmVSIbQmio4iKxuPfbGGUPW6YeraoOa2YMSze7O3-OQEjEpF%7E2kTAv32SmfL6bZGjPiL1RUDWMZ8OQlqOG4g-oppW3D-uUOW2VbrwG367Pl5O5aadtavsTuyKIwocTSUUVtA8bAr%7EcczAkRNH3AmI6%7EEcin9N86z6g55w__&Key-Pair-Id=KCD77M1F0VK2B: HTTPSConnectionPool(host='cdn-lfs-us-1.hf-mirror.com', port=443): Read timed out. Trying to resume download... Error while downloading from https://cdn-lfs-us-1.hf-mirror.com/repos/3c/42/3c429a32fd39f4234ac446273af0c092c59000a64cb19950a9c561a44e41c043/163011ba9907f85336681293420c12a3c7ab3e531618552be2340bcb298eba1e?response-content-disposition=attachment%3B+filename*%3DUTF-8%27%27yi-34b-chat.Q8_0.gguf%3B+filename%3D%22yi-34b-chat.Q8_0.gguf%22%3B&Expires=1706875115&Policy=eyJTdGF0ZW1lbnQiOlt7IkNvbmRpdGlvbiI6eyJEYXRlTGVzc1RoYW4iOnsiQVdTOkVwb2NoVGltZSI6MTcwNjg3NTExNX19LCJSZXNvdXJjZSI6Imh0dHBzOi8vY2RuLWxmcy11cy0xLmh1Z2dpbmdmYWNlLmNvL3JlcG9zLzNjLzQyLzNjNDI5YTMyZmQzOWY0MjM0YWM0NDYyNzNhZjBjMDkyYzU5MDAwYTY0Y2IxOTk1MGE5YzU2MWE0NGU0MWMwNDMvMTYzMDExYmE5OTA3Zjg1MzM2NjgxMjkzNDIwYzEyYTNjN2FiM2U1MzE2MTg1NTJiZTIzNDBiY2IyOThlYmExZT9yZXNwb25zZS1jb250ZW50LWRpc3Bvc2l0aW9uPSoifV19&Signature=TnClf5zxF5eMscBqjNhwlcnnUAIrx3NzDUROQcb2CgqTw1-uIw9W4Q2Hs9wh6qlbCXma2CM%7ECyamqVCNf%7E5KOAYdAugu2ge7uoqFnk6j13gJwAia3jyuYM3RMcVjJPIYM7pd4JUgNMpQbTv9N8V7m0fSjPseS9egaKc1b-ZNW%7Ehc6dMg8EmVSIbQmio4iKxuPfbGGUPW6YeraoOa2YMSze7O3-OQEjEpF%7E2kTAv32SmfL6bZGjPiL1RUDWMZ8OQlqOG4g-oppW3D-uUOW2VbrwG367Pl5O5aadtavsTuyKIwocTSUUVtA8bAr%7EcczAkRNH3AmI6%7EEcin9N86z6g55w__&Key-Pair-Id=KCD77M1F0VK2B: HTTPSConnectionPool(host='cdn-lfs-us-1.hf-mirror.com', port=443): Read timed out. Trying to resume download... Error while downloading from https://cdn-lfs-us-1.hf-mirror.com/repos/3c/42/3c429a32fd39f4234ac446273af0c092c59000a64cb19950a9c561a44e41c043/163011ba9907f85336681293420c12a3c7ab3e531618552be2340bcb298eba1e?response-content-disposition=attachment%3B+filename*%3DUTF-8%27%27yi-34b-chat.Q8_0.gguf%3B+filename%3D%22yi-34b-chat.Q8_0.gguf%22%3B&Expires=1706875115&Policy=eyJTdGF0ZW1lbnQiOlt7IkNvbmRpdGlvbiI6eyJEYXRlTGVzc1RoYW4iOnsiQVdTOkVwb2NoVGltZSI6MTcwNjg3NTExNX19LCJSZXNvdXJjZSI6Imh0dHBzOi8vY2RuLWxmcy11cy0xLmh1Z2dpbmdmYWNlLmNvL3JlcG9zLzNjLzQyLzNjNDI5YTMyZmQzOWY0MjM0YWM0NDYyNzNhZjBjMDkyYzU5MDAwYTY0Y2IxOTk1MGE5YzU2MWE0NGU0MWMwNDMvMTYzMDExYmE5OTA3Zjg1MzM2NjgxMjkzNDIwYzEyYTNjN2FiM2U1MzE2MTg1NTJiZTIzNDBiY2IyOThlYmExZT9yZXNwb25zZS1jb250ZW50LWRpc3Bvc2l0aW9uPSoifV19&Signature=TnClf5zxF5eMscBqjNhwlcnnUAIrx3NzDUROQcb2CgqTw1-uIw9W4Q2Hs9wh6qlbCXma2CM%7ECyamqVCNf%7E5KOAYdAugu2ge7uoqFnk6j13gJwAia3jyuYM3RMcVjJPIYM7pd4JUgNMpQbTv9N8V7m0fSjPseS9egaKc1b-ZNW%7Ehc6dMg8EmVSIbQmio4iKxuPfbGGUPW6YeraoOa2YMSze7O3-OQEjEpF%7E2kTAv32SmfL6bZGjPiL1RUDWMZ8OQlqOG4g-oppW3D-uUOW2VbrwG367Pl5O5aadtavsTuyKIwocTSUUVtA8bAr%7EcczAkRNH3AmI6%7EEcin9N86z6g55w__&Key-Pair-Id=KCD77M1F0VK2B: HTTPSConnectionPool(host='cdn-lfs-us-1.hf-mirror.com', port=443): Read timed out. Trying to resume download... Error while downloading from https://cdn-lfs-us-1.hf-mirror.com/repos/3c/42/3c429a32fd39f4234ac446273af0c092c59000a64cb19950a9c561a44e41c043/163011ba9907f85336681293420c12a3c7ab3e531618552be2340bcb298eba1e?response-content-disposition=attachment%3B+filename*%3DUTF-8%27%27yi-34b-chat.Q8_0.gguf%3B+filename%3D%22yi-34b-chat.Q8_0.gguf%22%3B&Expires=1706875115&Policy=eyJTdGF0ZW1lbnQiOlt7IkNvbmRpdGlvbiI6eyJEYXRlTGVzc1RoYW4iOnsiQVdTOkVwb2NoVGltZSI6MTcwNjg3NTExNX19LCJSZXNvdXJjZSI6Imh0dHBzOi8vY2RuLWxmcy11cy0xLmh1Z2dpbmdmYWNlLmNvL3JlcG9zLzNjLzQyLzNjNDI5YTMyZmQzOWY0MjM0YWM0NDYyNzNhZjBjMDkyYzU5MDAwYTY0Y2IxOTk1MGE5YzU2MWE0NGU0MWMwNDMvMTYzMDExYmE5OTA3Zjg1MzM2NjgxMjkzNDIwYzEyYTNjN2FiM2U1MzE2MTg1NTJiZTIzNDBiY2IyOThlYmExZT9yZXNwb25zZS1jb250ZW50LWRpc3Bvc2l0aW9uPSoifV19&Signature=TnClf5zxF5eMscBqjNhwlcnnUAIrx3NzDUROQcb2CgqTw1-uIw9W4Q2Hs9wh6qlbCXma2CM%7ECyamqVCNf%7E5KOAYdAugu2ge7uoqFnk6j13gJwAia3jyuYM3RMcVjJPIYM7pd4JUgNMpQbTv9N8V7m0fSjPseS9egaKc1b-ZNW%7Ehc6dMg8EmVSIbQmio4iKxuPfbGGUPW6YeraoOa2YMSze7O3-OQEjEpF%7E2kTAv32SmfL6bZGjPiL1RUDWMZ8OQlqOG4g-oppW3D-uUOW2VbrwG367Pl5O5aadtavsTuyKIwocTSUUVtA8bAr%7EcczAkRNH3AmI6%7EEcin9N86z6g55w__&Key-Pair-Id=KCD77M1F0VK2B: HTTPSConnectionPool(host='cdn-lfs-us-1.hf-mirror.com', port=443): Read timed out. | 12.5G/36.5G [11:48<13:43:20, 486kB/s] Trying to resume download... yi-34b-chat.Q8_0.gguf: 38%|██████████████████████████████████████████████████████████████████████████▏ | 13.8G/36.5G [19:00<5:43:53, 1.10MB/s] yi-34b-chat.Q8_0.gguf: 34%|███████████████████████████████████████████████████████████████████▍ | 12.5G/36.5G [30:54<19:21:32, 345kB/s] yi-34b-chat.Q8_0.gguf: 32%|███████████████████████████████████████████████████████████████▎ | 11.9G/36.5G [39:50<520:51:13, 13.2kB/s] yi-34b-chat.Q8_0.gguf: 32%|███████████████████████████████████████████████████████████████▏ | 11.8G/36.5G [2:19:28<13:33:22, 506kB/s] yi-34b-chat.Q8_0.gguf: 21%|████████████████████████████████████████▏ | 7.60G/36.5G [2:21:01<499:00:00, 16.1kB/s] yi-34b-chat.Q8_0.gguf: 20%|███████████████████████████████████████▍ | 7.47G/36.5G [2:24:06<130:35:19, 61.8kB/s] Fetching 1 files: 0%| | 0/1 [2:24:10<?, ?it/s] Traceback (most recent call last): File "/Users/zhangyixin/anaconda3/lib/python3.11/site-packages/urllib3/response.py", line 444, in _error_catcher yield File "/Users/zhangyixin/anaconda3/lib/python3.11/site-packages/urllib3/response.py", line 567, in read data = self._fp_read(amt) if not fp_closed else b"" ^^^^^^^^^^^^^^^^^^ File "/Users/zhangyixin/anaconda3/lib/python3.11/site-packages/urllib3/response.py", line 533, in _fp_read return self._fp.read(amt) if amt is not None else self._fp.read() ^^^^^^^^^^^^^^^^^^ File "/Users/zhangyixin/anaconda3/lib/python3.11/http/client.py", line 466, in read s = self.fp.read(amt) ^^^^^^^^^^^^^^^^^ File "/Users/zhangyixin/anaconda3/lib/python3.11/socket.py", line 706, in readinto return self._sock.recv_into(b) ^^^^^^^^^^^^^^^^^^^^^^^ File "/Users/zhangyixin/anaconda3/lib/python3.11/ssl.py", line 1278, in recv_into return self.read(nbytes, buffer) ^^^^^^^^^^^^^^^^^^^^^^^^^ File "/Users/zhangyixin/anaconda3/lib/python3.11/ssl.py", line 1134, in read return self._sslobj.read(len, buffer) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ TimeoutError: The read operation timed out

During handling of the above exception, another exception occurred:

Traceback (most recent call last): File "/Users/zhangyixin/anaconda3/lib/python3.11/site-packages/requests/models.py", line 816, in generate yield from self.raw.stream(chunk_size, decode_content=True) File "/Users/zhangyixin/anaconda3/lib/python3.11/site-packages/urllib3/response.py", line 628, in stream data = self.read(amt=amt, decode_content=decode_content) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/Users/zhangyixin/anaconda3/lib/python3.11/site-packages/urllib3/response.py", line 566, in read with self._error_catcher(): File "/Users/zhangyixin/anaconda3/lib/python3.11/contextlib.py", line 155, in exit self.gen.throw(typ, value, traceback) File "/Users/zhangyixin/anaconda3/lib/python3.11/site-packages/urllib3/response.py", line 449, in _error_catcher raise ReadTimeoutError(self._pool, None, "Read timed out.") urllib3.exceptions.ReadTimeoutError: HTTPSConnectionPool(host='cdn-lfs-us-1.hf-mirror.com', port=443): Read timed out.

During handling of the above exception, another exception occurred:

Traceback (most recent call last): File "/Users/zhangyixin/anaconda3/lib/python3.11/site-packages/huggingface_hub/file_download.py", line 541, in http_get for chunk in r.iter_content(chunk_size=DOWNLOAD_CHUNK_SIZE): File "/Users/zhangyixin/anaconda3/lib/python3.11/site-packages/requests/models.py", line 822, in generate raise ConnectionError(e) requests.exceptions.ConnectionError: HTTPSConnectionPool(host='cdn-lfs-us-1.hf-mirror.com', port=443): Read timed out.

During handling of the above exception, another exception occurred:

Traceback (most recent call last): File "/Users/zhangyixin/anaconda3/lib/python3.11/site-packages/urllib3/response.py", line 444, in _error_catcher yield File "/Users/zhangyixin/anaconda3/lib/python3.11/site-packages/urllib3/response.py", line 567, in read data = self._fp_read(amt) if not fp_closed else b"" ^^^^^^^^^^^^^^^^^^ File "/Users/zhangyixin/anaconda3/lib/python3.11/site-packages/urllib3/response.py", line 533, in _fp_read return self._fp.read(amt) if amt is not None else self._fp.read() ^^^^^^^^^^^^^^^^^^ File "/Users/zhangyixin/anaconda3/lib/python3.11/http/client.py", line 466, in read s = self.fp.read(amt) ^^^^^^^^^^^^^^^^^ File "/Users/zhangyixin/anaconda3/lib/python3.11/socket.py", line 706, in readinto return self._sock.recv_into(b) ^^^^^^^^^^^^^^^^^^^^^^^ File "/Users/zhangyixin/anaconda3/lib/python3.11/ssl.py", line 1278, in recv_into return self.read(nbytes, buffer) ^^^^^^^^^^^^^^^^^^^^^^^^^ File "/Users/zhangyixin/anaconda3/lib/python3.11/ssl.py", line 1134, in read return self._sslobj.read(len, buffer) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ TimeoutError: The read operation timed out

During handling of the above exception, another exception occurred:

Traceback (most recent call last): File "/Users/zhangyixin/anaconda3/lib/python3.11/site-packages/requests/models.py", line 816, in generate yield from self.raw.stream(chunk_size, decode_content=True) File "/Users/zhangyixin/anaconda3/lib/python3.11/site-packages/urllib3/response.py", line 628, in stream data = self.read(amt=amt, decode_content=decode_content) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/Users/zhangyixin/anaconda3/lib/python3.11/site-packages/urllib3/response.py", line 566, in read with self._error_catcher(): File "/Users/zhangyixin/anaconda3/lib/python3.11/contextlib.py", line 155, in exit self.gen.throw(typ, value, traceback) File "/Users/zhangyixin/anaconda3/lib/python3.11/site-packages/urllib3/response.py", line 449, in _error_catcher raise ReadTimeoutError(self._pool, None, "Read timed out.") urllib3.exceptions.ReadTimeoutError: HTTPSConnectionPool(host='cdn-lfs-us-1.hf-mirror.com', port=443): Read timed out.

During handling of the above exception, another exception occurred:

Traceback (most recent call last): File "/Users/zhangyixin/anaconda3/lib/python3.11/site-packages/huggingface_hub/file_download.py", line 541, in http_get for chunk in r.iter_content(chunk_size=DOWNLOAD_CHUNK_SIZE): File "/Users/zhangyixin/anaconda3/lib/python3.11/site-packages/requests/models.py", line 822, in generate raise ConnectionError(e) requests.exceptions.ConnectionError: HTTPSConnectionPool(host='cdn-lfs-us-1.hf-mirror.com', port=443): Read timed out.

During handling of the above exception, another exception occurred:

Traceback (most recent call last): File "/Users/zhangyixin/anaconda3/lib/python3.11/site-packages/urllib3/response.py", line 444, in _error_catcher yield File "/Users/zhangyixin/anaconda3/lib/python3.11/site-packages/urllib3/response.py", line 567, in read data = self._fp_read(amt) if not fp_closed else b"" ^^^^^^^^^^^^^^^^^^ File "/Users/zhangyixin/anaconda3/lib/python3.11/site-packages/urllib3/response.py", line 533, in _fp_read return self._fp.read(amt) if amt is not None else self._fp.read() ^^^^^^^^^^^^^^^^^^ File "/Users/zhangyixin/anaconda3/lib/python3.11/http/client.py", line 466, in read s = self.fp.read(amt) ^^^^^^^^^^^^^^^^^ File "/Users/zhangyixin/anaconda3/lib/python3.11/socket.py", line 706, in readinto return self._sock.recv_into(b) ^^^^^^^^^^^^^^^^^^^^^^^ File "/Users/zhangyixin/anaconda3/lib/python3.11/ssl.py", line 1278, in recv_into return self.read(nbytes, buffer) ^^^^^^^^^^^^^^^^^^^^^^^^^ File "/Users/zhangyixin/anaconda3/lib/python3.11/ssl.py", line 1134, in read return self._sslobj.read(len, buffer) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ TimeoutError: The read operation timed out

During handling of the above exception, another exception occurred:

Traceback (most recent call last): File "/Users/zhangyixin/anaconda3/lib/python3.11/site-packages/requests/models.py", line 816, in generate yield from self.raw.stream(chunk_size, decode_content=True) File "/Users/zhangyixin/anaconda3/lib/python3.11/site-packages/urllib3/response.py", line 628, in stream data = self.read(amt=amt, decode_content=decode_content) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/Users/zhangyixin/anaconda3/lib/python3.11/site-packages/urllib3/response.py", line 566, in read with self._error_catcher(): File "/Users/zhangyixin/anaconda3/lib/python3.11/contextlib.py", line 155, in exit self.gen.throw(typ, value, traceback) File "/Users/zhangyixin/anaconda3/lib/python3.11/site-packages/urllib3/response.py", line 449, in _error_catcher raise ReadTimeoutError(self._pool, None, "Read timed out.") urllib3.exceptions.ReadTimeoutError: HTTPSConnectionPool(host='cdn-lfs-us-1.hf-mirror.com', port=443): Read timed out.

During handling of the above exception, another exception occurred:

Traceback (most recent call last): File "/Users/zhangyixin/anaconda3/lib/python3.11/site-packages/huggingface_hub/file_download.py", line 541, in http_get for chunk in r.iter_content(chunk_size=DOWNLOAD_CHUNK_SIZE): File "/Users/zhangyixin/anaconda3/lib/python3.11/site-packages/requests/models.py", line 822, in generate raise ConnectionError(e) requests.exceptions.ConnectionError: HTTPSConnectionPool(host='cdn-lfs-us-1.hf-mirror.com', port=443): Read timed out.

During handling of the above exception, another exception occurred:

Traceback (most recent call last): File "/Users/zhangyixin/anaconda3/lib/python3.11/site-packages/urllib3/response.py", line 444, in _error_catcher yield File "/Users/zhangyixin/anaconda3/lib/python3.11/site-packages/urllib3/response.py", line 567, in read data = self._fp_read(amt) if not fp_closed else b"" ^^^^^^^^^^^^^^^^^^ File "/Users/zhangyixin/anaconda3/lib/python3.11/site-packages/urllib3/response.py", line 533, in _fp_read return self._fp.read(amt) if amt is not None else self._fp.read() ^^^^^^^^^^^^^^^^^^ File "/Users/zhangyixin/anaconda3/lib/python3.11/http/client.py", line 466, in read s = self.fp.read(amt) ^^^^^^^^^^^^^^^^^ File "/Users/zhangyixin/anaconda3/lib/python3.11/socket.py", line 706, in readinto return self._sock.recv_into(b) ^^^^^^^^^^^^^^^^^^^^^^^ File "/Users/zhangyixin/anaconda3/lib/python3.11/ssl.py", line 1278, in recv_into return self.read(nbytes, buffer) ^^^^^^^^^^^^^^^^^^^^^^^^^ File "/Users/zhangyixin/anaconda3/lib/python3.11/ssl.py", line 1134, in read return self._sslobj.read(len, buffer) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ TimeoutError: The read operation timed out

During handling of the above exception, another exception occurred:

Traceback (most recent call last): File "/Users/zhangyixin/anaconda3/lib/python3.11/site-packages/requests/models.py", line 816, in generate yield from self.raw.stream(chunk_size, decode_content=True) File "/Users/zhangyixin/anaconda3/lib/python3.11/site-packages/urllib3/response.py", line 628, in stream data = self.read(amt=amt, decode_content=decode_content) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/Users/zhangyixin/anaconda3/lib/python3.11/site-packages/urllib3/response.py", line 566, in read with self._error_catcher(): File "/Users/zhangyixin/anaconda3/lib/python3.11/contextlib.py", line 155, in exit self.gen.throw(typ, value, traceback) File "/Users/zhangyixin/anaconda3/lib/python3.11/site-packages/urllib3/response.py", line 449, in _error_catcher raise ReadTimeoutError(self._pool, None, "Read timed out.") urllib3.exceptions.ReadTimeoutError: HTTPSConnectionPool(host='cdn-lfs-us-1.hf-mirror.com', port=443): Read timed out.

During handling of the above exception, another exception occurred:

Traceback (most recent call last): File "/Users/zhangyixin/anaconda3/lib/python3.11/site-packages/huggingface_hub/file_download.py", line 541, in http_get for chunk in r.iter_content(chunk_size=DOWNLOAD_CHUNK_SIZE): File "/Users/zhangyixin/anaconda3/lib/python3.11/site-packages/requests/models.py", line 822, in generate raise ConnectionError(e) requests.exceptions.ConnectionError: HTTPSConnectionPool(host='cdn-lfs-us-1.hf-mirror.com', port=443): Read timed out.

During handling of the above exception, another exception occurred:

Traceback (most recent call last): File "/Users/zhangyixin/anaconda3/lib/python3.11/site-packages/urllib3/response.py", line 444, in _error_catcher yield File "/Users/zhangyixin/anaconda3/lib/python3.11/site-packages/urllib3/response.py", line 567, in read data = self._fp_read(amt) if not fp_closed else b"" ^^^^^^^^^^^^^^^^^^ File "/Users/zhangyixin/anaconda3/lib/python3.11/site-packages/urllib3/response.py", line 533, in _fp_read return self._fp.read(amt) if amt is not None else self._fp.read() ^^^^^^^^^^^^^^^^^^ File "/Users/zhangyixin/anaconda3/lib/python3.11/http/client.py", line 466, in read s = self.fp.read(amt) ^^^^^^^^^^^^^^^^^ File "/Users/zhangyixin/anaconda3/lib/python3.11/socket.py", line 706, in readinto return self._sock.recv_into(b) ^^^^^^^^^^^^^^^^^^^^^^^ File "/Users/zhangyixin/anaconda3/lib/python3.11/ssl.py", line 1278, in recv_into return self.read(nbytes, buffer) ^^^^^^^^^^^^^^^^^^^^^^^^^ File "/Users/zhangyixin/anaconda3/lib/python3.11/ssl.py", line 1134, in read return self._sslobj.read(len, buffer) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ TimeoutError: The read operation timed out

During handling of the above exception, another exception occurred:

Traceback (most recent call last): File "/Users/zhangyixin/anaconda3/lib/python3.11/site-packages/requests/models.py", line 816, in generate yield from self.raw.stream(chunk_size, decode_content=True) File "/Users/zhangyixin/anaconda3/lib/python3.11/site-packages/urllib3/response.py", line 628, in stream data = self.read(amt=amt, decode_content=decode_content) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/Users/zhangyixin/anaconda3/lib/python3.11/site-packages/urllib3/response.py", line 566, in read with self._error_catcher(): File "/Users/zhangyixin/anaconda3/lib/python3.11/contextlib.py", line 155, in exit self.gen.throw(typ, value, traceback) File "/Users/zhangyixin/anaconda3/lib/python3.11/site-packages/urllib3/response.py", line 449, in _error_catcher raise ReadTimeoutError(self._pool, None, "Read timed out.") urllib3.exceptions.ReadTimeoutError: HTTPSConnectionPool(host='cdn-lfs-us-1.hf-mirror.com', port=443): Read timed out.

During handling of the above exception, another exception occurred:

Traceback (most recent call last): File "/Users/zhangyixin/anaconda3/lib/python3.11/site-packages/huggingface_hub/file_download.py", line 541, in http_get for chunk in r.iter_content(chunk_size=DOWNLOAD_CHUNK_SIZE): File "/Users/zhangyixin/anaconda3/lib/python3.11/site-packages/requests/models.py", line 822, in generate raise ConnectionError(e) requests.exceptions.ConnectionError: HTTPSConnectionPool(host='cdn-lfs-us-1.hf-mirror.com', port=443): Read timed out.

During handling of the above exception, another exception occurred:

Traceback (most recent call last): File "/Users/zhangyixin/anaconda3/bin/huggingface-cli", line 8, in sys.exit(main()) ^^^^^^ File "/Users/zhangyixin/anaconda3/lib/python3.11/site-packages/huggingface_hub/commands/huggingface_cli.py", line 49, in main service.run() File "/Users/zhangyixin/anaconda3/lib/python3.11/site-packages/huggingface_hub/commands/download.py", line 160, in run print(self._download()) # Print path to downloaded files ^^^^^^^^^^^^^^^^ File "/Users/zhangyixin/anaconda3/lib/python3.11/site-packages/huggingface_hub/commands/download.py", line 201, in _download return snapshot_download( ^^^^^^^^^^^^^^^^^^ File "/Users/zhangyixin/anaconda3/lib/python3.11/site-packages/huggingface_hub/utils/_validators.py", line 118, in _inner_fn return fn(*args, kwargs) ^^^^^^^^^^^^^^^^^^^ File "/Users/zhangyixin/anaconda3/lib/python3.11/site-packages/huggingface_hub/_snapshot_download.py", line 238, in snapshot_download thread_map( File "/Users/zhangyixin/anaconda3/lib/python3.11/site-packages/tqdm/contrib/concurrent.py", line 69, in thread_map return _executor_map(ThreadPoolExecutor, fn, *iterables, *tqdm_kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/Users/zhangyixin/anaconda3/lib/python3.11/site-packages/tqdm/contrib/concurrent.py", line 51, in _executor_map return list(tqdm_class(ex.map(fn, iterables, chunksize=chunksize), kwargs)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/Users/zhangyixin/anaconda3/lib/python3.11/site-packages/tqdm/std.py", line 1178, in iter for obj in iterable: File "/Users/zhangyixin/anaconda3/lib/python3.11/concurrent/futures/_base.py", line 619, in result_iterator yield _result_or_cancel(fs.pop()) ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/Users/zhangyixin/anaconda3/lib/python3.11/concurrent/futures/_base.py", line 317, in _result_or_cancel return fut.result(timeout) ^^^^^^^^^^^^^^^^^^^ File "/Users/zhangyixin/anaconda3/lib/python3.11/concurrent/futures/_base.py", line 456, in result return self.get_result() ^^^^^^^^^^^^^^^^^^^ File "/Users/zhangyixin/anaconda3/lib/python3.11/concurrent/futures/_base.py", line 401, in get_result raise self._exception File "/Users/zhangyixin/anaconda3/lib/python3.11/concurrent/futures/thread.py", line 58, in run result = self.fn(*self.args, *self.kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/Users/zhangyixin/anaconda3/lib/python3.11/site-packages/huggingface_hub/_snapshot_download.py", line 213, in _inner_hf_hub_download return hf_hub_download( ^^^^^^^^^^^^^^^^ File "/Users/zhangyixin/anaconda3/lib/python3.11/site-packages/huggingface_hub/utils/_validators.py", line 118, in _inner_fn return fn(args, **kwargs) ^^^^^^^^^^^^^^^^^^^ File "/Users/zhangyixin/anaconda3/lib/python3.11/site-packages/huggingface_hub/file_download.py", line 1461, in hf_hub_download http_get( File "/Users/zhangyixin/anaconda3/lib/python3.11/site-packages/huggingface_hub/file_download.py", line 558, in http_get return http_get( ^^^^^^^^^ File "/Users/zhangyixin/anaconda3/lib/python3.11/site-packages/huggingface_hub/file_download.py", line 558, in http_get return http_get( ^^^^^^^^^ File "/Users/zhangyixin/anaconda3/lib/python3.11/site-packages/huggingface_hub/file_download.py", line 558, in http_get return http_get( ^^^^^^^^^ [Previous line repeated 2 more times] File "/Users/zhangyixin/anaconda3/lib/python3.11/site-packages/huggingface_hub/file_download.py", line 544, in http_get temp_file.write(chunk) OSError: [Errno 28] No space left on device (base) zhangyixin@zhangyixin llama.cpp % huggingface-cli download --token YOUR_TOKEN --resume-download --local-dir-use-symlinks False TheBloke/Yi-34B-Chat-GGUF --include "yi-34b-chat.Q8_0.gguf" --local-dir TheBloke/Yi-34B-Chat-GGUF

Consider using hf_transfer for faster downloads. This solution comes with some limitations. See https://huggingface.co/docs/huggingface_hub/hf_transfer for more details. Fetching 1 files: 0%| | 0/1 [00:00<?, ?it/s]downloading https://hf-mirror.com/TheBloke/Yi-34B-Chat-GGUF/resolve/ee827f906e733381ab65c650dcfdd2caf6de8762/yi-34b-chat.Q8_0.gguf to /Users/zhangyixin/.cache/huggingface/hub/models--TheBloke--Yi-34B-Chat-GGUF/blobs/163011ba9907f85336681293420c12a3c7ab3e531618552be2340bcb298eba1e.incomplete Error while downloading from https://cdn-lfs-us-1.hf-mirror.com/repos/3c/42/3c429a32fd39f4234ac446273af0c092c59000a64cb19950a9c561a44e41c043/163011ba9907f85336681293420c12a3c7ab3e531618552be2340bcb298eba1e?response-content-disposition=attachment%3B+filename*%3DUTF-8%27%27yi-34b-chat.Q8_0.gguf%3B+filename%3D%22yi-34b-chat.Q8_0.gguf%22%3B&Expires=1706945273&Policy=eyJTdGF0ZW1lbnQiOlt7IkNvbmRpdGlvbiI6eyJEYXRlTGVzc1RoYW4iOnsiQVdTOkVwb2NoVGltZSI6MTcwNjk0NTI3M319LCJSZXNvdXJjZSI6Imh0dHBzOi8vY2RuLWxmcy11cy0xLmh1Z2dpbmdmYWNlLmNvL3JlcG9zLzNjLzQyLzNjNDI5YTMyZmQzOWY0MjM0YWM0NDYyNzNhZjBjMDkyYzU5MDAwYTY0Y2IxOTk1MGE5YzU2MWE0NGU0MWMwNDMvMTYzMDExYmE5OTA3Zjg1MzM2NjgxMjkzNDIwYzEyYTNjN2FiM2U1MzE2MTg1NTJiZTIzNDBiY2IyOThlYmExZT9yZXNwb25zZS1jb250ZW50LWRpc3Bvc2l0aW9uPSoifV19&Signature=gT614DUvGFxP4iS1OF4HBgm4jvE8yNNPYoOKwnTam2XqBfS1-fAGZBb2yLSIuAledqTMU6anetGlfyi4Vpet0lPVR1cncRImhWv4llDgUG8ZEDfd12N0SBBPjYKApG2512Vs413AZABL1Ku%7EsMvUbKOe3Gsly7zYQp0zr-BFhu8ApyvvZvMQh4-R-lgDipzcRNFKiaZyxXc77S8RkuO1wXmJ8whG4dNA8%7EytJ3lYJuIPfhwleRFkEYll5S8HGHe7DlCV7jQjxjQb6DmBXwhTpeKQxbpWe8O8LKzKOPXI57enY1J7Sz4s5sOnE4%7E6fHHq3gSrGCxKbNu18Doty32qOw__&Key-Pair-Id=KCD77M1F0VK2B: HTTPSConnectionPool(host='cdn-lfs-us-1.hf-mirror.com', port=443): Read timed out. Trying to resume download... Error while downloading from https://cdn-lfs-us-1.hf-mirror.com/repos/3c/42/3c429a32fd39f4234ac446273af0c092c59000a64cb19950a9c561a44e41c043/163011ba9907f85336681293420c12a3c7ab3e531618552be2340bcb298eba1e?response-content-disposition=attachment%3B+filename*%3DUTF-8%27%27yi-34b-chat.Q8_0.gguf%3B+filename%3D%22yi-34b-chat.Q8_0.gguf%22%3B&Expires=1706945273&Policy=eyJTdGF0ZW1lbnQiOlt7IkNvbmRpdGlvbiI6eyJEYXRlTGVzc1RoYW4iOnsiQVdTOkVwb2NoVGltZSI6MTcwNjk0NTI3M319LCJSZXNvdXJjZSI6Imh0dHBzOi8vY2RuLWxmcy11cy0xLmh1Z2dpbmdmYWNlLmNvL3JlcG9zLzNjLzQyLzNjNDI5YTMyZmQzOWY0MjM0YWM0NDYyNzNhZjBjMDkyYzU5MDAwYTY0Y2IxOTk1MGE5YzU2MWE0NGU0MWMwNDMvMTYzMDExYmE5OTA3Zjg1MzM2NjgxMjkzNDIwYzEyYTNjN2FiM2U1MzE2MTg1NTJiZTIzNDBiY2IyOThlYmExZT9yZXNwb25zZS1jb250ZW50LWRpc3Bvc2l0aW9uPSoifV19&Signature=gT614DUvGFxP4iS1OF4HBgm4jvE8yNNPYoOKwnTam2XqBfS1-fAGZBb2yLSIuAledqTMU6anetGlfyi4Vpet0lPVR1cncRImhWv4llDgUG8ZEDfd12N0SBBPjYKApG2512Vs413AZABL1Ku%7EsMvUbKOe3Gsly7zYQp0zr-BFhu8ApyvvZvMQh4-R-lgDipzcRNFKiaZyxXc77S8RkuO1wXmJ8whG4dNA8%7EytJ3lYJuIPfhwleRFkEYll5S8HGHe7DlCV7jQjxjQb6DmBXwhTpeKQxbpWe8O8LKzKOPXI57enY1J7Sz4s5sOnE4%7E6fHHq3gSrGCxKbNu18Doty32qOw__&Key-Pair-Id=KCD77M1F0VK2B: HTTPSConnectionPool(host='cdn-lfs-us-1.hf-mirror.com', port=443): Read timed out. Trying to resume download... yi-34b-chat.Q8_0.gguf: 100%|███████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 36.5G/36.5G [14:28<00:00, 18.5MB/s] yi-34b-chat.Q8_0.gguf: 56%|██████████████████████████████████████████████████████████████████████████████████████████████████████████████▌ | 20.5G/36.5G [26:52<1:06:24, 4.03MB/s] yi-34b-chat.Q8_0.gguf: 38%|███████████████████████████████████████████████████████████████████████████▌ | 14.0G/36.5G [27:37<41:14:06, 152kB/s] Fetching 1 files: 100%|█████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 1/1 [27:40<00:00, 1660.03s/it] /Users/zhangyixin/Desktop/llama.cpp/TheBloke/Yi-34B-Chat-GGUF (base) zhangyixin@zhangyixin llama.cpp % huggingface-cli download --token YOUR_TOKEN --resume-download --local-dir-use-symlinks False TheBloke/Yi-34B-Chat-GGUF --include "yi-34b-chat.Q8_0.gguf" --local-dir TheBloke/Yi-34B-Chat-GGUF

(base) zhangyixin@zhangyixin llama.cpp % chmod +x /Users/zhangyixin/Desktop/llama.cpp/TheBloke/Yi-34B-Chat-GGUF/yi-34b-chat.Q8_0.gguf (base) zhangyixin@zhangyixin llama.cpp % /Users/zhangyixin/Desktop/llama.cpp/TheBloke/Yi-34B-Chat-GGUF/yi-34b-chat.Q8_0.gguf zsh: exec format error: /Users/zhangyixin/Desktop/llama.cpp/TheBloke/Yi-34B-Chat-GGUF/yi-34b-chat.Q8_0.gguf (base) zhangyixin@zhangyixin llama.cpp % ./main --frequency-penalty 0.5 --frequency-penalty 0.5 --top-k 5 --top-p 0.9 -m /Users/zhangyixin/Desktop/llama.cpp/TheBloke/Yi-34B-Chat-GGUF/yi-34b-chat.Q8_0.gguf -p "Building a website can be done in 10 simple steps:\nStep 1:" -n 400 -e

Log start main: build = 1992 (b2b2bf98) main: built with clang version 14.0.6 for arm64-apple-darwin20.0.0 main: seed = 1706691529 llama_model_loader: loaded meta data with 23 key-value pairs and 543 tensors from /Users/zhangyixin/Desktop/llama.cpp/TheBloke/Yi-34B-Chat-GGUF/yi-34b-chat.Q8_0.gguf (version GGUF V3 (latest)) llama_model_loader: Dumping metadata keys/values. Note: KV overrides do not apply in this output. llama_model_loader: - kv 0: general.architecture str = llama llama_model_loader: - kv 1: general.name str = LLaMA v2 llama_model_loader: - kv 2: llama.context_length u32 = 4096 llama_model_loader: - kv 3: llama.embedding_length u32 = 7168 llama_model_loader: - kv 4: llama.block_count u32 = 60 llama_model_loader: - kv 5: llama.feed_forward_length u32 = 20480 llama_model_loader: - kv 6: llama.rope.dimension_count u32 = 128 llama_model_loader: - kv 7: llama.attention.head_count u32 = 56 llama_model_loader: - kv 8: llama.attention.head_count_kv u32 = 8 llama_model_loader: - kv 9: llama.attention.layer_norm_rms_epsilon f32 = 0.000010 llama_model_loader: - kv 10: llama.rope.freq_base f32 = 5000000.000000 llama_model_loader: - kv 11: general.file_type u32 = 7 llama_model_loader: - kv 12: tokenizer.ggml.model str = llama llama_model_loader: - kv 13: tokenizer.ggml.tokens arr[str,64000] = ["", "<|startoftext|>", "<|endof... llama_model_loader: - kv 14: tokenizer.ggml.scores arr[f32,64000] = [0.000000, 0.000000, 0.000000, 0.0000... llama_model_loader: - kv 15: tokenizer.ggml.token_type arr[i32,64000] = [2, 3, 3, 3, 3, 3, 1, 1, 1, 3, 3, 3, ... llama_model_loader: - kv 16: tokenizer.ggml.bos_token_id u32 = 1 llama_model_loader: - kv 17: tokenizer.ggml.eos_token_id u32 = 2 llama_model_loader: - kv 18: tokenizer.ggml.padding_token_id u32 = 0 llama_model_loader: - kv 19: tokenizer.ggml.add_bos_token bool = false llama_model_loader: - kv 20: tokenizer.ggml.add_eos_token bool = false llama_model_loader: - kv 21: tokenizer.chat_template str = {% if not add_generation_prompt is de... llama_model_loader: - kv 22: general.quantization_version u32 = 2 llama_model_loader: - type f32: 121 tensors llama_model_loader: - type q8_0: 422 tensors llm_load_vocab: mismatch in special tokens definition ( 498/64000 vs 267/64000 ). llm_load_print_meta: format = GGUF V3 (latest) llm_load_print_meta: arch = llama llm_load_print_meta: vocab type = SPM llm_load_print_meta: n_vocab = 64000 llm_load_print_meta: n_merges = 0 llm_load_print_meta: n_ctx_train = 4096 llm_load_print_meta: n_embd = 7168 llm_load_print_meta: n_head = 56 llm_load_print_meta: n_head_kv = 8 llm_load_print_meta: n_layer = 60 llm_load_print_meta: n_rot = 128 llm_load_print_meta: n_embd_head_k = 128 llm_load_print_meta: n_embd_head_v = 128 llm_load_print_meta: n_gqa = 7 llm_load_print_meta: n_embd_k_gqa = 1024 llm_load_print_meta: n_embd_v_gqa = 1024 llm_load_print_meta: f_norm_eps = 0.0e+00 llm_load_print_meta: f_norm_rms_eps = 1.0e-05 llm_load_print_meta: f_clamp_kqv = 0.0e+00 llm_load_print_meta: f_max_alibi_bias = 0.0e+00 llm_load_print_meta: n_ff = 20480 llm_load_print_meta: n_expert = 0 llm_load_print_meta: n_expert_used = 0 llm_load_print_meta: rope scaling = linear llm_load_print_meta: freq_base_train = 5000000.0 llm_load_print_meta: freq_scale_train = 1 llm_load_print_meta: n_yarn_orig_ctx = 4096 llm_load_print_meta: rope_finetuned = unknown llm_load_print_meta: model type = 30B llm_load_print_meta: model ftype = Q8_0 llm_load_print_meta: model params = 34.39 B llm_load_print_meta: model size = 34.03 GiB (8.50 BPW) llm_load_print_meta: general.name = LLaMA v2 llm_load_print_meta: BOS token = 1 '<|startoftext|>' llm_load_print_meta: EOS token = 2 '<|endoftext|>' llm_load_print_meta: UNK token = 0 '' llm_load_print_meta: PAD token = 0 '' llm_load_print_meta: LF token = 315 '<0x0A>' llm_load_tensors: ggml ctx size = 0.41 MiB ggml_backend_metal_buffer_from_ptr: error: failed to allocate buffer, size = 0.00 MiB llama_model_load: error loading model: failed to allocate buffer llama_load_model_from_file: failed to load model llama_init_from_gpt_params: error: failed to load model '/Users/zhangyixin/Desktop/llama.cpp/TheBloke/Yi-34B-Chat-GGUF/yi-34b-chat.Q8_0.gguf' main: error: unable to load model (base) zhangyixin@zhangyixin llama.cpp % hist zsh: command not found: hist (base) zhangyixin@zhangyixin llama.cpp % history 1010 ls 1011 code . 1012 meta-llama/Llama-2-13b-hf 1013 huggingface-cli download --token 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 --resume-download --local-dir-use-symlinks False meta-llama/Llama-2-13b-hf 1014 ikawrakow/qwen-14b-chat-gguf 1015 huggingface-cli download --token YOUR_TOKEN --resume-download --local-dir-use-symlinks False ikawrakow/qwen-14b-chat-gguf --include "qwen-14b-chat-q5-0.gguf" --local-dir ikawrakow/qwen-14b-chat-gguf\n 1016 cd ../llama.cpp 1017 huggingface-cli download --token YOUR_TOKEN --resume-download --local-dir-use-symlinks False ikawrakow/qwen-14b-chat-gguf --include "qwen-14b-chat-q5-0.gguf" --local-dir ikawrakow/qwen-14b-chat-gguf\n 1018 huggingface-cli download --token YOUR_TOKEN --resume-download --local-dir-use-symlinks False TheBloke/Yi-34B-Chat-GGUF --include "yi-34b-chat.Q8_0.gguf" --local-dir TheBloke/Yi-34B-Chat-GGUF\n 1019 huggingface-cli download --token YOUR_TOKEN --resume-download --local-dir-use-symlinks False TheBloke/Yi-34B-Chat-GGUF --include "yi-34b-chat.Q8_0.gguf" --local-dir TheBloke/Yi-34B-Chat-GGUF\n 1020 huggingface-cli download --token YOUR_TOKEN --resume-download --local-dir-use-symlinks False TheBloke/Yi-34B-Chat-GGUF --include "yi-34b-chat.Q8_0.gguf" --local-dir TheBloke/Yi-34B-Chat-GGUF\n 1021 huggingface-cli download --token YOUR_TOKEN --resume-download --local-dir-use-symlinks False TheBloke/Yi-34B-Chat-GGUF --include "yi-34b-chat.Q8_0.gguf" --local-dir TheBloke/Yi-34B-Chat-GGUF\n 1022 chmod +x /Users/zhangyixin/Desktop/llama.cpp/TheBloke/Yi-34B-Chat-GGUF/yi-34b-chat.Q8_0.gguf 1023 /Users/zhangyixin/Desktop/llama.cpp/TheBloke/Yi-34B-Chat-GGUF/yi-34b-chat.Q8_0.gguf 1024 ./main --frequency-penalty 0.5 --frequency-penalty 0.5 --top-k 5 --top-p 0.9 -m /Users/zhangyixin/Desktop/llama.cpp/TheBloke/Yi-34B-Chat-GGUF/yi-34b-chat.Q8_0.gguf -p "Building a website can be done in 10 simple steps:\nStep 1:" -n 400 -e\n 1025 hist (base) zhangyixin@zhangyixin llama.cpp %