ddzipp
commented
1 day ago I sincerely apologize for any inconvenience this may cause. I have already checked the Huggingface. The repo in Huggingface indeed contains the adapter_config.json file. The error message mentions a "Connection error," which suggests that, despite the file being available in the repository, an unstable or interrupted network connection might prevent the model files from downloading successfully. Please check the server's network connection to ensure it can access the Hugging Face repository without interruptions. If you have any further questions, please feel free to ask. By the way, we have updated latest model based on Llama3-8B-Instruct. You can use the latest model if you like.
python manage.py runserver using cuda device_map: auto Loading checkpoint shards: 100%|████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 2/2 [00:12<00:00, 6.48s/it] prompter and tokenizer is not None <utils.prompter.Prompter object at 0x7f640ff21c00> LlamaTokenizer(name_or_path='/root/autodl-tmp/AutoAudit/sandbox/yahma/llama-7b-hf', vocab_size=32000, model_max_length=1000000000000000019884624838656, is_fast=False, padding_side='right', truncation_side='right', special_tokens={'bos_token': '', 'pad_token': ''}, clean_up_tokenization_spaces=False)
using cude
device_map: auto
Loading checkpoint shards: 100%|████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 2/2 [00:12<00:00, 6.14s/it]
using cuda
device_map: auto
Loading checkpoint shards: 100%|████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 2/2 [00:13<00:00, 6.60s/it]
prompter and tokenizer is not None
<utils.prompter.Prompter object at 0x7f0d1892dba0>
LlamaTokenizer(name_or_path='/root/autodl-tmp/AutoAudit/sandbox/yahma/llama-7b-hf', vocab_size=32000, model_max_length=1000000000000000019884624838656, is_fast=False, padding_side='right', truncation_side='right', special_tokens={'bos_token': '', 'pad_token': ''}, clean_up_tokenization_spaces=False)
using cude
device_map: auto
Loading checkpoint shards: 100%|████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 2/2 [00:12<00:00, 6.20s/it]
Watching for file changes with StatReloader
Exception in thread django-main-thread:
Traceback (most recent call last):
File "/root/miniconda3/envs/AutoAudit/lib/python3.10/site-packages/peft/utils/config.py", line 99, in from_pretrained
config_file = hf_hub_download(pretrained_model_name_or_path, CONFIG_NAME)
File "/root/miniconda3/envs/AutoAudit/lib/python3.10/site-packages/huggingface_hub/utils/_validators.py", line 118, in _inner_fn
return fn(*args, **kwargs)
File "/root/miniconda3/envs/AutoAudit/lib/python3.10/site-packages/huggingface_hub/file_download.py", line 1291, in hf_hub_download
raise LocalEntryNotFoundError(
huggingface_hub.utils._errors.LocalEntryNotFoundError: Connection error, and we cannot find the requested files in the disk cache. Please try again or make sure your Internet connection is on.
', 'eos_token': '', 'unk_token': '', 'eos_token': '', 'unk_token': 'During handling of the above exception, another exception occurred:
Traceback (most recent call last): File "/root/miniconda3/envs/AutoAudit/lib/python3.10/threading.py", line 1016, in _bootstrap_inner self.run() File "/root/miniconda3/envs/AutoAudit/lib/python3.10/threading.py", line 953, in run self._target(*self._args, self._kwargs) File "/root/miniconda3/envs/AutoAudit/lib/python3.10/site-packages/django/utils/autoreload.py", line 64, in wrapper fn(*args, *kwargs) File "/root/miniconda3/envs/AutoAudit/lib/python3.10/site-packages/django/core/management/commands/runserver.py", line 125, in inner_run autoreload.raise_last_exception() File "/root/miniconda3/envs/AutoAudit/lib/python3.10/site-packages/django/utils/autoreload.py", line 87, in raise_last_exception raise _exception[1] File "/root/miniconda3/envs/AutoAudit/lib/python3.10/site-packages/django/core/management/init.py", line 394, in execute autoreload.check_errors(django.setup)() File "/root/miniconda3/envs/AutoAudit/lib/python3.10/site-packages/django/utils/autoreload.py", line 64, in wrapper fn(args, kwargs) File "/root/miniconda3/envs/AutoAudit/lib/python3.10/site-packages/django/init.py", line 24, in setup apps.populate(settings.INSTALLED_APPS) File "/root/miniconda3/envs/AutoAudit/lib/python3.10/site-packages/django/apps/registry.py", line 124, in populate app_config.ready() File "/root/autodl-tmp/AutoAudit/sandbox/AutoAudit/apps.py", line 201, in ready main_alpaca() File "/root/autodl-tmp/AutoAudit/sandbox/AutoAudit/apps.py", line 159, in main_alpaca AutoauditConfig.model = PeftModel.from_pretrained( File "/root/miniconda3/envs/AutoAudit/lib/python3.10/site-packages/peft/peft_model.py", line 137, in from_pretrained config = PEFT_TYPE_TO_CONFIG_MAPPING[PeftConfig.from_pretrained(model_id).peft_type].from_pretrained(model_id) File "/root/miniconda3/envs/AutoAudit/lib/python3.10/site-packages/peft/utils/config.py", line 101, in from_pretrained raise ValueError(f"Can't find '{CONFIG_NAME}' at '{pretrained_model_name_or_path}'") ValueError: Can't find 'adapter_config.json' at 'lilBuffaloEric/autoaudit_20230703_attempt2' using cuda