loading AutoTokenizer.from_pretrained with gated model

[maitagorri]

System Info

Using

• transformers version: 4.41.2
• Platform: Windows-10-10.0.17763-SP0
• Python version: 3.12.3
• Huggingface_hub version: 0.23.3
• Safetensors version: 0.4.3
• Accelerate version: not installed
• Accelerate config: not found
• PyTorch version (GPU?): 2.3.0+cpu (Fa lse)
• Tensorflow version (GPU?): not instal led (NA)
• Flax version (CPU?/GPU?/TPU?): not in stalled (NA)
• Jax version: not installed
• JaxLib version: not installed
• Using GPU in script?: no
• Using distributed or parallel set-up in script?: no

Who can help?

No response

Information

• [ ] The official example scripts
• [X] My own modified scripts

Tasks

• [X] An officially supported task in the examples folder (such as GLUE/SQuAD, ...)
• [ ] My own task or dataset (give details below)

Reproduction

I am attempting to create a Tokenizer via download from a gated model site on huggingface, mistralai/Mixtral-8x7B-Instruct-v0.1, using a token for authentication:

AutoTokenizer.from_pretrained('mistralai/Mixtral-8x7B-Instruct-v0.1',
                    token=settings.hf_token
 )

This results in an OSError that looks as if I couldn't reach huggingface at all (expand for traceback):

OSError referencing generic inability to read model

``` --------------------------------------------------------------------------- HTTPError Traceback (most recent call last) File c:\Users\schadem\Anaconda3\envs\watermark-env\Lib\site-packages\huggingface_hub\utils\_errors.py:304, in hf_raise_for_status(response, endpoint_name) [303](file:///C:/Users/schadem/Anaconda3/envs/watermark-env/Lib/site-packages/huggingface_hub/utils/_errors.py:303) try: --> [304](file:///C:/Users/schadem/Anaconda3/envs/watermark-env/Lib/site-packages/huggingface_hub/utils/_errors.py:304) response.raise_for_status() [305](file:///C:/Users/schadem/Anaconda3/envs/watermark-env/Lib/site-packages/huggingface_hub/utils/_errors.py:305) except HTTPError as e: File c:\Users\schadem\Anaconda3\envs\watermark-env\Lib\site-packages\requests\models.py:1024, in Response.raise_for_status(self) [1023](file:///C:/Users/schadem/Anaconda3/envs/watermark-env/Lib/site-packages/requests/models.py:1023) if http_error_msg: -> [1024](file:///C:/Users/schadem/Anaconda3/envs/watermark-env/Lib/site-packages/requests/models.py:1024) raise HTTPError(http_error_msg, response=self) HTTPError: 403 Client Error: Forbidden for url: https://huggingface.co/mistralai/Mixtral-8x7B-Instruct-v0.1/resolve/main/config.json The above exception was the direct cause of the following exception: HfHubHTTPError Traceback (most recent call last) File c:\Users\schadem\Anaconda3\envs\watermark-env\Lib\site-packages\huggingface_hub\file_download.py:1722, in _get_metadata_or_catch_error(repo_id, filename, repo_type, revision, endpoint, proxies, etag_timeout, headers, local_files_only, relative_filename, storage_folder) [1721](file:///C:/Users/schadem/Anaconda3/envs/watermark-env/Lib/site-packages/huggingface_hub/file_download.py:1721) try: -> [1722](file:///C:/Users/schadem/Anaconda3/envs/watermark-env/Lib/site-packages/huggingface_hub/file_download.py:1722) metadata = get_hf_file_metadata(url=url, proxies=proxies, timeout=etag_timeout, headers=headers) [1723](file:///C:/Users/schadem/Anaconda3/envs/watermark-env/Lib/site-packages/huggingface_hub/file_download.py:1723) except EntryNotFoundError as http_error: File c:\Users\schadem\Anaconda3\envs\watermark-env\Lib\site-packages\huggingface_hub\utils\_validators.py:114, in validate_hf_hub_args.._inner_fn(*args, **kwargs) [112](file:///C:/Users/schadem/Anaconda3/envs/watermark-env/Lib/site-packages/huggingface_hub/utils/_validators.py:112) kwargs = smoothly_deprecate_use_auth_token(fn_name=fn.__name__, has_token=has_token, kwargs=kwargs) --> [114](file:///C:/Users/schadem/Anaconda3/envs/watermark-env/Lib/site-packages/huggingface_hub/utils/_validators.py:114) return fn(*args, **kwargs) File c:\Users\schadem\Anaconda3\envs\watermark-env\Lib\site-packages\huggingface_hub\file_download.py:1645, in get_hf_file_metadata(url, token, proxies, timeout, library_name, library_version, user_agent, headers) [1644](file:///C:/Users/schadem/Anaconda3/envs/watermark-env/Lib/site-packages/huggingface_hub/file_download.py:1644) # Retrieve metadata -> [1645](file:///C:/Users/schadem/Anaconda3/envs/watermark-env/Lib/site-packages/huggingface_hub/file_download.py:1645) r = _request_wrapper( [1646](file:///C:/Users/schadem/Anaconda3/envs/watermark-env/Lib/site-packages/huggingface_hub/file_download.py:1646) method="HEAD", [1647](file:///C:/Users/schadem/Anaconda3/envs/watermark-env/Lib/site-packages/huggingface_hub/file_download.py:1647) url=url, [1648](file:///C:/Users/schadem/Anaconda3/envs/watermark-env/Lib/site-packages/huggingface_hub/file_download.py:1648) headers=headers, [1649](file:///C:/Users/schadem/Anaconda3/envs/watermark-env/Lib/site-packages/huggingface_hub/file_download.py:1649) allow_redirects=False, [1650](file:///C:/Users/schadem/Anaconda3/envs/watermark-env/Lib/site-packages/huggingface_hub/file_download.py:1650) follow_relative_redirects=True, [1651](file:///C:/Users/schadem/Anaconda3/envs/watermark-env/Lib/site-packages/huggingface_hub/file_download.py:1651) proxies=proxies, [1652](file:///C:/Users/schadem/Anaconda3/envs/watermark-env/Lib/site-packages/huggingface_hub/file_download.py:1652) timeout=timeout, [1653](file:///C:/Users/schadem/Anaconda3/envs/watermark-env/Lib/site-packages/huggingface_hub/file_download.py:1653) ) [1654](file:///C:/Users/schadem/Anaconda3/envs/watermark-env/Lib/site-packages/huggingface_hub/file_download.py:1654) hf_raise_for_status(r) File c:\Users\schadem\Anaconda3\envs\watermark-env\Lib\site-packages\huggingface_hub\file_download.py:372, in _request_wrapper(method, url, follow_relative_redirects, **params) [371](file:///C:/Users/schadem/Anaconda3/envs/watermark-env/Lib/site-packages/huggingface_hub/file_download.py:371) if follow_relative_redirects: --> [372](file:///C:/Users/schadem/Anaconda3/envs/watermark-env/Lib/site-packages/huggingface_hub/file_download.py:372) response = _request_wrapper( [373](file:///C:/Users/schadem/Anaconda3/envs/watermark-env/Lib/site-packages/huggingface_hub/file_download.py:373) method=method, [374](file:///C:/Users/schadem/Anaconda3/envs/watermark-env/Lib/site-packages/huggingface_hub/file_download.py:374) url=url, [375](file:///C:/Users/schadem/Anaconda3/envs/watermark-env/Lib/site-packages/huggingface_hub/file_download.py:375) follow_relative_redirects=False, [376](file:///C:/Users/schadem/Anaconda3/envs/watermark-env/Lib/site-packages/huggingface_hub/file_download.py:376) **params, [377](file:///C:/Users/schadem/Anaconda3/envs/watermark-env/Lib/site-packages/huggingface_hub/file_download.py:377) ) [379](file:///C:/Users/schadem/Anaconda3/envs/watermark-env/Lib/site-packages/huggingface_hub/file_download.py:379) # If redirection, we redirect only relative paths. [380](file:///C:/Users/schadem/Anaconda3/envs/watermark-env/Lib/site-packages/huggingface_hub/file_download.py:380) # This is useful in case of a renamed repository. File c:\Users\schadem\Anaconda3\envs\watermark-env\Lib\site-packages\huggingface_hub\file_download.py:396, in _request_wrapper(method, url, follow_relative_redirects, **params) [395](file:///C:/Users/schadem/Anaconda3/envs/watermark-env/Lib/site-packages/huggingface_hub/file_download.py:395) response = get_session().request(method=method, url=url, **params) --> [396](file:///C:/Users/schadem/Anaconda3/envs/watermark-env/Lib/site-packages/huggingface_hub/file_download.py:396) hf_raise_for_status(response) [397](file:///C:/Users/schadem/Anaconda3/envs/watermark-env/Lib/site-packages/huggingface_hub/file_download.py:397) return response File c:\Users\schadem\Anaconda3\envs\watermark-env\Lib\site-packages\huggingface_hub\utils\_errors.py:367, in hf_raise_for_status(response, endpoint_name) [361](file:///C:/Users/schadem/Anaconda3/envs/watermark-env/Lib/site-packages/huggingface_hub/utils/_errors.py:361) message = ( [362](file:///C:/Users/schadem/Anaconda3/envs/watermark-env/Lib/site-packages/huggingface_hub/utils/_errors.py:362) f"\n\n{response.status_code} Forbidden: {error_message}." [363](file:///C:/Users/schadem/Anaconda3/envs/watermark-env/Lib/site-packages/huggingface_hub/utils/_errors.py:363) + f"\nCannot access content at: {response.url}." [364](file:///C:/Users/schadem/Anaconda3/envs/watermark-env/Lib/site-packages/huggingface_hub/utils/_errors.py:364) + "\nIf you are trying to create or update content," [365](file:///C:/Users/schadem/Anaconda3/envs/watermark-env/Lib/site-packages/huggingface_hub/utils/_errors.py:365) + "make sure you have a token with the `write` role." [366](file:///C:/Users/schadem/Anaconda3/envs/watermark-env/Lib/site-packages/huggingface_hub/utils/_errors.py:366) ) --> [367](file:///C:/Users/schadem/Anaconda3/envs/watermark-env/Lib/site-packages/huggingface_hub/utils/_errors.py:367) raise HfHubHTTPError(message, response=response) from e [369](file:///C:/Users/schadem/Anaconda3/envs/watermark-env/Lib/site-packages/huggingface_hub/utils/_errors.py:369) # Convert `HTTPError` into a `HfHubHTTPError` to display request information [370](file:///C:/Users/schadem/Anaconda3/envs/watermark-env/Lib/site-packages/huggingface_hub/utils/_errors.py:370) # as well (request id and/or server error message) HfHubHTTPError: (Request ID: Root=1-666818f8-230ea286034686c1292284e2;30914542-67cc-4e0d-b00c-47864b3b95e6) 403 Forbidden: Authorization error.. Cannot access content at: https://huggingface.co/mistralai/Mixtral-8x7B-Instruct-v0.1/resolve/main/config.json. If you are trying to create or update content,make sure you have a token with the `write` role. The above exception was the direct cause of the following exception: LocalEntryNotFoundError Traceback (most recent call last) File c:\Users\schadem\Anaconda3\envs\watermark-env\Lib\site-packages\transformers\utils\hub.py:399, in cached_file(path_or_repo_id, filename, cache_dir, force_download, resume_download, proxies, token, revision, local_files_only, subfolder, repo_type, user_agent, _raise_exceptions_for_gated_repo, _raise_exceptions_for_missing_entries, _raise_exceptions_for_connection_errors, _commit_hash, **deprecated_kwargs) [397](file:///C:/Users/schadem/Anaconda3/envs/watermark-env/Lib/site-packages/transformers/utils/hub.py:397) try: [398](file:///C:/Users/schadem/Anaconda3/envs/watermark-env/Lib/site-packages/transformers/utils/hub.py:398) # Load from URL or cache if already cached --> [399](file:///C:/Users/schadem/Anaconda3/envs/watermark-env/Lib/site-packages/transformers/utils/hub.py:399) resolved_file = hf_hub_download( [400](file:///C:/Users/schadem/Anaconda3/envs/watermark-env/Lib/site-packages/transformers/utils/hub.py:400) path_or_repo_id, [401](file:///C:/Users/schadem/Anaconda3/envs/watermark-env/Lib/site-packages/transformers/utils/hub.py:401) filename, [402](file:///C:/Users/schadem/Anaconda3/envs/watermark-env/Lib/site-packages/transformers/utils/hub.py:402) subfolder=None if len(subfolder) == 0 else subfolder, [403](file:///C:/Users/schadem/Anaconda3/envs/watermark-env/Lib/site-packages/transformers/utils/hub.py:403) repo_type=repo_type, [404](file:///C:/Users/schadem/Anaconda3/envs/watermark-env/Lib/site-packages/transformers/utils/hub.py:404) revision=revision, [405](file:///C:/Users/schadem/Anaconda3/envs/watermark-env/Lib/site-packages/transformers/utils/hub.py:405) cache_dir=cache_dir, [406](file:///C:/Users/schadem/Anaconda3/envs/watermark-env/Lib/site-packages/transformers/utils/hub.py:406) user_agent=user_agent, [407](file:///C:/Users/schadem/Anaconda3/envs/watermark-env/Lib/site-packages/transformers/utils/hub.py:407) force_download=force_download, [408](file:///C:/Users/schadem/Anaconda3/envs/watermark-env/Lib/site-packages/transformers/utils/hub.py:408) proxies=proxies, [409](file:///C:/Users/schadem/Anaconda3/envs/watermark-env/Lib/site-packages/transformers/utils/hub.py:409) resume_download=resume_download, [410](file:///C:/Users/schadem/Anaconda3/envs/watermark-env/Lib/site-packages/transformers/utils/hub.py:410) token=token, [411](file:///C:/Users/schadem/Anaconda3/envs/watermark-env/Lib/site-packages/transformers/utils/hub.py:411) local_files_only=local_files_only, [412](file:///C:/Users/schadem/Anaconda3/envs/watermark-env/Lib/site-packages/transformers/utils/hub.py:412) ) [413](file:///C:/Users/schadem/Anaconda3/envs/watermark-env/Lib/site-packages/transformers/utils/hub.py:413) except GatedRepoError as e: File c:\Users\schadem\Anaconda3\envs\watermark-env\Lib\site-packages\huggingface_hub\utils\_validators.py:114, in validate_hf_hub_args.._inner_fn(*args, **kwargs) [112](file:///C:/Users/schadem/Anaconda3/envs/watermark-env/Lib/site-packages/huggingface_hub/utils/_validators.py:112) kwargs = smoothly_deprecate_use_auth_token(fn_name=fn.__name__, has_token=has_token, kwargs=kwargs) --> [114](file:///C:/Users/schadem/Anaconda3/envs/watermark-env/Lib/site-packages/huggingface_hub/utils/_validators.py:114) return fn(*args, **kwargs) File c:\Users\schadem\Anaconda3\envs\watermark-env\Lib\site-packages\huggingface_hub\file_download.py:1221, in hf_hub_download(repo_id, filename, subfolder, repo_type, revision, library_name, library_version, cache_dir, local_dir, user_agent, force_download, proxies, etag_timeout, token, local_files_only, headers, endpoint, legacy_cache_layout, resume_download, force_filename, local_dir_use_symlinks) [1220](file:///C:/Users/schadem/Anaconda3/envs/watermark-env/Lib/site-packages/huggingface_hub/file_download.py:1220) else: -> [1221](file:///C:/Users/schadem/Anaconda3/envs/watermark-env/Lib/site-packages/huggingface_hub/file_download.py:1221) return _hf_hub_download_to_cache_dir( [1222](file:///C:/Users/schadem/Anaconda3/envs/watermark-env/Lib/site-packages/huggingface_hub/file_download.py:1222) # Destination [1223](file:///C:/Users/schadem/Anaconda3/envs/watermark-env/Lib/site-packages/huggingface_hub/file_download.py:1223) cache_dir=cache_dir, [1224](file:///C:/Users/schadem/Anaconda3/envs/watermark-env/Lib/site-packages/huggingface_hub/file_download.py:1224) # File info [1225](file:///C:/Users/schadem/Anaconda3/envs/watermark-env/Lib/site-packages/huggingface_hub/file_download.py:1225) repo_id=repo_id, [1226](file:///C:/Users/schadem/Anaconda3/envs/watermark-env/Lib/site-packages/huggingface_hub/file_download.py:1226) filename=filename, [1227](file:///C:/Users/schadem/Anaconda3/envs/watermark-env/Lib/site-packages/huggingface_hub/file_download.py:1227) repo_type=repo_type, [1228](file:///C:/Users/schadem/Anaconda3/envs/watermark-env/Lib/site-packages/huggingface_hub/file_download.py:1228) revision=revision, [1229](file:///C:/Users/schadem/Anaconda3/envs/watermark-env/Lib/site-packages/huggingface_hub/file_download.py:1229) # HTTP info [1230](file:///C:/Users/schadem/Anaconda3/envs/watermark-env/Lib/site-packages/huggingface_hub/file_download.py:1230) headers=headers, [1231](file:///C:/Users/schadem/Anaconda3/envs/watermark-env/Lib/site-packages/huggingface_hub/file_download.py:1231) proxies=proxies, [1232](file:///C:/Users/schadem/Anaconda3/envs/watermark-env/Lib/site-packages/huggingface_hub/file_download.py:1232) etag_timeout=etag_timeout, [1233](file:///C:/Users/schadem/Anaconda3/envs/watermark-env/Lib/site-packages/huggingface_hub/file_download.py:1233) endpoint=endpoint, [1234](file:///C:/Users/schadem/Anaconda3/envs/watermark-env/Lib/site-packages/huggingface_hub/file_download.py:1234) # Additional options [1235](file:///C:/Users/schadem/Anaconda3/envs/watermark-env/Lib/site-packages/huggingface_hub/file_download.py:1235) local_files_only=local_files_only, [1236](file:///C:/Users/schadem/Anaconda3/envs/watermark-env/Lib/site-packages/huggingface_hub/file_download.py:1236) force_download=force_download, [1237](file:///C:/Users/schadem/Anaconda3/envs/watermark-env/Lib/site-packages/huggingface_hub/file_download.py:1237) ) File c:\Users\schadem\Anaconda3\envs\watermark-env\Lib\site-packages\huggingface_hub\file_download.py:1325, in _hf_hub_download_to_cache_dir(cache_dir, repo_id, filename, repo_type, revision, headers, proxies, etag_timeout, endpoint, local_files_only, force_download) [1324](file:///C:/Users/schadem/Anaconda3/envs/watermark-env/Lib/site-packages/huggingface_hub/file_download.py:1324) # Otherwise, raise appropriate error -> [1325](file:///C:/Users/schadem/Anaconda3/envs/watermark-env/Lib/site-packages/huggingface_hub/file_download.py:1325) _raise_on_head_call_error(head_call_error, force_download, local_files_only) [1327](file:///C:/Users/schadem/Anaconda3/envs/watermark-env/Lib/site-packages/huggingface_hub/file_download.py:1327) # From now on, etag, commit_hash, url and size are not None. File c:\Users\schadem\Anaconda3\envs\watermark-env\Lib\site-packages\huggingface_hub\file_download.py:1826, in _raise_on_head_call_error(head_call_error, force_download, local_files_only) [1824](file:///C:/Users/schadem/Anaconda3/envs/watermark-env/Lib/site-packages/huggingface_hub/file_download.py:1824) else: [1825](file:///C:/Users/schadem/Anaconda3/envs/watermark-env/Lib/site-packages/huggingface_hub/file_download.py:1825) # Otherwise: most likely a connection issue or Hub downtime => let's warn the user -> [1826](file:///C:/Users/schadem/Anaconda3/envs/watermark-env/Lib/site-packages/huggingface_hub/file_download.py:1826) raise LocalEntryNotFoundError( [1827](file:///C:/Users/schadem/Anaconda3/envs/watermark-env/Lib/site-packages/huggingface_hub/file_download.py:1827) "An error happened while trying to locate the file on the Hub and we cannot find the requested files" [1828](file:///C:/Users/schadem/Anaconda3/envs/watermark-env/Lib/site-packages/huggingface_hub/file_download.py:1828) " in the local cache. Please check your connection and try again or make sure your Internet connection" [1829](file:///C:/Users/schadem/Anaconda3/envs/watermark-env/Lib/site-packages/huggingface_hub/file_download.py:1829) " is on." [1830](file:///C:/Users/schadem/Anaconda3/envs/watermark-env/Lib/site-packages/huggingface_hub/file_download.py:1830) ) from head_call_error LocalEntryNotFoundError: An error happened while trying to locate the file on the Hub and we cannot find the requested files in the local cache. Please check your connection and try again or make sure your Internet connection is on. The above exception was the direct cause of the following exception: OSError Traceback (most recent call last) Cell In[8], [line 1](vscode-notebook-cell:?execution_count=8&line=1) ----> [1](vscode-notebook-cell:?execution_count=8&line=1) at.from_pretrained('mistralai/Mixtral-8x7B-Instruct-v0.1',# 'google-bert/bert-base-uncased',# [2](vscode-notebook-cell:?execution_count=8&line=2) # proxies={'http':proxystr, [3](vscode-notebook-cell:?execution_count=8&line=3) # 'https':proxystr [4](vscode-notebook-cell:?execution_count=8&line=4) # }, [5](vscode-notebook-cell:?execution_count=8&line=5) # use_auth_token=True, [6](vscode-notebook-cell:?execution_count=8&line=6) token=settings.hf_token [7](vscode-notebook-cell:?execution_count=8&line=7) ) File c:\Users\schadem\Anaconda3\envs\watermark-env\Lib\site-packages\transformers\models\auto\tokenization_auto.py:837, in AutoTokenizer.from_pretrained(cls, pretrained_model_name_or_path, *inputs, **kwargs) [835](file:///C:/Users/schadem/Anaconda3/envs/watermark-env/Lib/site-packages/transformers/models/auto/tokenization_auto.py:835) config = AutoConfig.for_model(**config_dict) [836](file:///C:/Users/schadem/Anaconda3/envs/watermark-env/Lib/site-packages/transformers/models/auto/tokenization_auto.py:836) else: --> [837](file:///C:/Users/schadem/Anaconda3/envs/watermark-env/Lib/site-packages/transformers/models/auto/tokenization_auto.py:837) config = AutoConfig.from_pretrained( [838](file:///C:/Users/schadem/Anaconda3/envs/watermark-env/Lib/site-packages/transformers/models/auto/tokenization_auto.py:838) pretrained_model_name_or_path, trust_remote_code=trust_remote_code, **kwargs [839](file:///C:/Users/schadem/Anaconda3/envs/watermark-env/Lib/site-packages/transformers/models/auto/tokenization_auto.py:839) ) [840](file:///C:/Users/schadem/Anaconda3/envs/watermark-env/Lib/site-packages/transformers/models/auto/tokenization_auto.py:840) config_tokenizer_class = config.tokenizer_class [841](file:///C:/Users/schadem/Anaconda3/envs/watermark-env/Lib/site-packages/transformers/models/auto/tokenization_auto.py:841) if hasattr(config, "auto_map") and "AutoTokenizer" in config.auto_map: File c:\Users\schadem\Anaconda3\envs\watermark-env\Lib\site-packages\transformers\models\auto\configuration_auto.py:934, in AutoConfig.from_pretrained(cls, pretrained_model_name_or_path, **kwargs) [931](file:///C:/Users/schadem/Anaconda3/envs/watermark-env/Lib/site-packages/transformers/models/auto/configuration_auto.py:931) trust_remote_code = kwargs.pop("trust_remote_code", None) [932](file:///C:/Users/schadem/Anaconda3/envs/watermark-env/Lib/site-packages/transformers/models/auto/configuration_auto.py:932) code_revision = kwargs.pop("code_revision", None) --> [934](file:///C:/Users/schadem/Anaconda3/envs/watermark-env/Lib/site-packages/transformers/models/auto/configuration_auto.py:934) config_dict, unused_kwargs = PretrainedConfig.get_config_dict(pretrained_model_name_or_path, **kwargs) [935](file:///C:/Users/schadem/Anaconda3/envs/watermark-env/Lib/site-packages/transformers/models/auto/configuration_auto.py:935) has_remote_code = "auto_map" in config_dict and "AutoConfig" in config_dict["auto_map"] [936](file:///C:/Users/schadem/Anaconda3/envs/watermark-env/Lib/site-packages/transformers/models/auto/configuration_auto.py:936) has_local_code = "model_type" in config_dict and config_dict["model_type"] in CONFIG_MAPPING File c:\Users\schadem\Anaconda3\envs\watermark-env\Lib\site-packages\transformers\configuration_utils.py:632, in PretrainedConfig.get_config_dict(cls, pretrained_model_name_or_path, **kwargs) [630](file:///C:/Users/schadem/Anaconda3/envs/watermark-env/Lib/site-packages/transformers/configuration_utils.py:630) original_kwargs = copy.deepcopy(kwargs) [631](file:///C:/Users/schadem/Anaconda3/envs/watermark-env/Lib/site-packages/transformers/configuration_utils.py:631) # Get config dict associated with the base config file --> [632](file:///C:/Users/schadem/Anaconda3/envs/watermark-env/Lib/site-packages/transformers/configuration_utils.py:632) config_dict, kwargs = cls._get_config_dict(pretrained_model_name_or_path, **kwargs) [633](file:///C:/Users/schadem/Anaconda3/envs/watermark-env/Lib/site-packages/transformers/configuration_utils.py:633) if "_commit_hash" in config_dict: [634](file:///C:/Users/schadem/Anaconda3/envs/watermark-env/Lib/site-packages/transformers/configuration_utils.py:634) original_kwargs["_commit_hash"] = config_dict["_commit_hash"] File c:\Users\schadem\Anaconda3\envs\watermark-env\Lib\site-packages\transformers\configuration_utils.py:689, in PretrainedConfig._get_config_dict(cls, pretrained_model_name_or_path, **kwargs) [685](file:///C:/Users/schadem/Anaconda3/envs/watermark-env/Lib/site-packages/transformers/configuration_utils.py:685) configuration_file = kwargs.pop("_configuration_file", CONFIG_NAME) if gguf_file is None else gguf_file [687](file:///C:/Users/schadem/Anaconda3/envs/watermark-env/Lib/site-packages/transformers/configuration_utils.py:687) try: [688](file:///C:/Users/schadem/Anaconda3/envs/watermark-env/Lib/site-packages/transformers/configuration_utils.py:688) # Load from local folder or from cache or download from model Hub and cache --> [689](file:///C:/Users/schadem/Anaconda3/envs/watermark-env/Lib/site-packages/transformers/configuration_utils.py:689) resolved_config_file = cached_file( [690](file:///C:/Users/schadem/Anaconda3/envs/watermark-env/Lib/site-packages/transformers/configuration_utils.py:690) pretrained_model_name_or_path, [691](file:///C:/Users/schadem/Anaconda3/envs/watermark-env/Lib/site-packages/transformers/configuration_utils.py:691) configuration_file, [692](file:///C:/Users/schadem/Anaconda3/envs/watermark-env/Lib/site-packages/transformers/configuration_utils.py:692) cache_dir=cache_dir, [693](file:///C:/Users/schadem/Anaconda3/envs/watermark-env/Lib/site-packages/transformers/configuration_utils.py:693) force_download=force_download, [694](file:///C:/Users/schadem/Anaconda3/envs/watermark-env/Lib/site-packages/transformers/configuration_utils.py:694) proxies=proxies, [695](file:///C:/Users/schadem/Anaconda3/envs/watermark-env/Lib/site-packages/transformers/configuration_utils.py:695) resume_download=resume_download, [696](file:///C:/Users/schadem/Anaconda3/envs/watermark-env/Lib/site-packages/transformers/configuration_utils.py:696) local_files_only=local_files_only, [697](file:///C:/Users/schadem/Anaconda3/envs/watermark-env/Lib/site-packages/transformers/configuration_utils.py:697) token=token, [698](file:///C:/Users/schadem/Anaconda3/envs/watermark-env/Lib/site-packages/transformers/configuration_utils.py:698) user_agent=user_agent, [699](file:///C:/Users/schadem/Anaconda3/envs/watermark-env/Lib/site-packages/transformers/configuration_utils.py:699) revision=revision, [700](file:///C:/Users/schadem/Anaconda3/envs/watermark-env/Lib/site-packages/transformers/configuration_utils.py:700) subfolder=subfolder, [701](file:///C:/Users/schadem/Anaconda3/envs/watermark-env/Lib/site-packages/transformers/configuration_utils.py:701) _commit_hash=commit_hash, [702](file:///C:/Users/schadem/Anaconda3/envs/watermark-env/Lib/site-packages/transformers/configuration_utils.py:702) ) [703](file:///C:/Users/schadem/Anaconda3/envs/watermark-env/Lib/site-packages/transformers/configuration_utils.py:703) commit_hash = extract_commit_hash(resolved_config_file, commit_hash) [704](file:///C:/Users/schadem/Anaconda3/envs/watermark-env/Lib/site-packages/transformers/configuration_utils.py:704) except EnvironmentError: [705](file:///C:/Users/schadem/Anaconda3/envs/watermark-env/Lib/site-packages/transformers/configuration_utils.py:705) # Raise any environment error raise by `cached_file`. It will have a helpful error message adapted to [706](file:///C:/Users/schadem/Anaconda3/envs/watermark-env/Lib/site-packages/transformers/configuration_utils.py:706) # the original exception. File c:\Users\schadem\Anaconda3\envs\watermark-env\Lib\site-packages\transformers\utils\hub.py:442, in cached_file(path_or_repo_id, filename, cache_dir, force_download, resume_download, proxies, token, revision, local_files_only, subfolder, repo_type, user_agent, _raise_exceptions_for_gated_repo, _raise_exceptions_for_missing_entries, _raise_exceptions_for_connection_errors, _commit_hash, **deprecated_kwargs) [436](file:///C:/Users/schadem/Anaconda3/envs/watermark-env/Lib/site-packages/transformers/utils/hub.py:436) if ( [437](file:///C:/Users/schadem/Anaconda3/envs/watermark-env/Lib/site-packages/transformers/utils/hub.py:437) resolved_file is not None [438](file:///C:/Users/schadem/Anaconda3/envs/watermark-env/Lib/site-packages/transformers/utils/hub.py:438) or not _raise_exceptions_for_missing_entries [439](file:///C:/Users/schadem/Anaconda3/envs/watermark-env/Lib/site-packages/transformers/utils/hub.py:439) or not _raise_exceptions_for_connection_errors [440](file:///C:/Users/schadem/Anaconda3/envs/watermark-env/Lib/site-packages/transformers/utils/hub.py:440) ): [441](file:///C:/Users/schadem/Anaconda3/envs/watermark-env/Lib/site-packages/transformers/utils/hub.py:441) return resolved_file --> [442](file:///C:/Users/schadem/Anaconda3/envs/watermark-env/Lib/site-packages/transformers/utils/hub.py:442) raise EnvironmentError( [443](file:///C:/Users/schadem/Anaconda3/envs/watermark-env/Lib/site-packages/transformers/utils/hub.py:443) f"We couldn't connect to '{HUGGINGFACE_CO_RESOLVE_ENDPOINT}' to load this file, couldn't find it in the" [444](file:///C:/Users/schadem/Anaconda3/envs/watermark-env/Lib/site-packages/transformers/utils/hub.py:444) f" cached files and it looks like {path_or_repo_id} is not the path to a directory containing a file named" [445](file:///C:/Users/schadem/Anaconda3/envs/watermark-env/Lib/site-packages/transformers/utils/hub.py:445) f" {full_filename}.\nCheckout your internet connection or see how to run the library in offline mode at" [446](file:///C:/Users/schadem/Anaconda3/envs/watermark-env/Lib/site-packages/transformers/utils/hub.py:446) " 'https://huggingface.co/docs/transformers/installation#offline-mode'." [447](file:///C:/Users/schadem/Anaconda3/envs/watermark-env/Lib/site-packages/transformers/utils/hub.py:447) ) from e [448](file:///C:/Users/schadem/Anaconda3/envs/watermark-env/Lib/site-packages/transformers/utils/hub.py:448) except EntryNotFoundError as e: [449](file:///C:/Users/schadem/Anaconda3/envs/watermark-env/Lib/site-packages/transformers/utils/hub.py:449) if not _raise_exceptions_for_missing_entries: OSError: We couldn't connect to 'https://huggingface.co/' to load this file, couldn't find it in the cached files and it looks like mistralai/Mixtral-8x7B-Instruct-v0.1 is not the path to a directory containing a file named config.json. Checkout your internet connection or see how to run the library in offline mode at 'https://huggingface.co/docs/transformers/installation#offline-mode'. ```

Expected behavior

• I would expect the same result as with download of an open model, which works just fine, e.g.

  autoTokenizer.from_pretrained( 'google-bert/bert-base-uncased',
                  token=settings.hf_token
  )

• I am able to access the model through the website when logged in.

• Attempting the download with an invalid token, I get the expected error (expand for traceback):

  OSError referencing gated model

---------------------------------------------------------------------------
HTTPError                                 Traceback (most recent call last)
File c:\Users\schadem\Anaconda3\envs\watermark-env\Lib\site-packages\huggingface_hub\utils\_errors.py:304, in hf_raise_for_status(response, endpoint_name)
    [303](file:///C:/Users/schadem/Anaconda3/envs/watermark-env/Lib/site-packages/huggingface_hub/utils/_errors.py:303) try:
--> [304](file:///C:/Users/schadem/Anaconda3/envs/watermark-env/Lib/site-packages/huggingface_hub/utils/_errors.py:304)     response.raise_for_status()
    [305](file:///C:/Users/schadem/Anaconda3/envs/watermark-env/Lib/site-packages/huggingface_hub/utils/_errors.py:305) except HTTPError as e:

File c:\Users\schadem\Anaconda3\envs\watermark-env\Lib\site-packages\requests\models.py:1024, in Response.raise_for_status(self)
   [1023](file:///C:/Users/schadem/Anaconda3/envs/watermark-env/Lib/site-packages/requests/models.py:1023) if http_error_msg:
-> [1024](file:///C:/Users/schadem/Anaconda3/envs/watermark-env/Lib/site-packages/requests/models.py:1024)     raise HTTPError(http_error_msg, response=self)

HTTPError: 403 Client Error: Forbidden for url: https://huggingface.co/mistralai/Mixtral-8x7B-Instruct-v0.1/resolve/main/config.json

The above exception was the direct cause of the following exception:

GatedRepoError                            Traceback (most recent call last)
File c:\Users\schadem\Anaconda3\envs\watermark-env\Lib\site-packages\transformers\utils\hub.py:399, in cached_file(path_or_repo_id, filename, cache_dir, force_download, resume_download, proxies, token, revision, local_files_only, subfolder, repo_type, user_agent, _raise_exceptions_for_gated_repo, _raise_exceptions_for_missing_entries, _raise_exceptions_for_connection_errors, _commit_hash, **deprecated_kwargs)
    [397](file:///C:/Users/schadem/Anaconda3/envs/watermark-env/Lib/site-packages/transformers/utils/hub.py:397) try:
    [398](file:///C:/Users/schadem/Anaconda3/envs/watermark-env/Lib/site-packages/transformers/utils/hub.py:398)     # Load from URL or cache if already cached
--> [399](file:///C:/Users/schadem/Anaconda3/envs/watermark-env/Lib/site-packages/transformers/utils/hub.py:399)     resolved_file = hf_hub_download(
    [400](file:///C:/Users/schadem/Anaconda3/envs/watermark-env/Lib/site-packages/transformers/utils/hub.py:400)         path_or_repo_id,
    [401](file:///C:/Users/schadem/Anaconda3/envs/watermark-env/Lib/site-packages/transformers/utils/hub.py:401)         filename,
    [402](file:///C:/Users/schadem/Anaconda3/envs/watermark-env/Lib/site-packages/transformers/utils/hub.py:402)         subfolder=None if len(subfolder) == 0 else subfolder,
    [403](file:///C:/Users/schadem/Anaconda3/envs/watermark-env/Lib/site-packages/transformers/utils/hub.py:403)         repo_type=repo_type,
    [404](file:///C:/Users/schadem/Anaconda3/envs/watermark-env/Lib/site-packages/transformers/utils/hub.py:404)         revision=revision,
    [405](file:///C:/Users/schadem/Anaconda3/envs/watermark-env/Lib/site-packages/transformers/utils/hub.py:405)         cache_dir=cache_dir,
    [406](file:///C:/Users/schadem/Anaconda3/envs/watermark-env/Lib/site-packages/transformers/utils/hub.py:406)         user_agent=user_agent,
    [407](file:///C:/Users/schadem/Anaconda3/envs/watermark-env/Lib/site-packages/transformers/utils/hub.py:407)         force_download=force_download,
    [408](file:///C:/Users/schadem/Anaconda3/envs/watermark-env/Lib/site-packages/transformers/utils/hub.py:408)         proxies=proxies,
    [409](file:///C:/Users/schadem/Anaconda3/envs/watermark-env/Lib/site-packages/transformers/utils/hub.py:409)         resume_download=resume_download,
    [410](file:///C:/Users/schadem/Anaconda3/envs/watermark-env/Lib/site-packages/transformers/utils/hub.py:410)         token=token,
    [411](file:///C:/Users/schadem/Anaconda3/envs/watermark-env/Lib/site-packages/transformers/utils/hub.py:411)         local_files_only=local_files_only,
    [412](file:///C:/Users/schadem/Anaconda3/envs/watermark-env/Lib/site-packages/transformers/utils/hub.py:412)     )
    [413](file:///C:/Users/schadem/Anaconda3/envs/watermark-env/Lib/site-packages/transformers/utils/hub.py:413) except GatedRepoError as e:

File c:\Users\schadem\Anaconda3\envs\watermark-env\Lib\site-packages\huggingface_hub\utils\_validators.py:114, in validate_hf_hub_args.<locals>._inner_fn(*args, **kwargs)
    [112](file:///C:/Users/schadem/Anaconda3/envs/watermark-env/Lib/site-packages/huggingface_hub/utils/_validators.py:112)     kwargs = smoothly_deprecate_use_auth_token(fn_name=fn.__name__, has_token=has_token, kwargs=kwargs)
--> [114](file:///C:/Users/schadem/Anaconda3/envs/watermark-env/Lib/site-packages/huggingface_hub/utils/_validators.py:114) return fn(*args, **kwargs)

File c:\Users\schadem\Anaconda3\envs\watermark-env\Lib\site-packages\huggingface_hub\file_download.py:1221, in hf_hub_download(repo_id, filename, subfolder, repo_type, revision, library_name, library_version, cache_dir, local_dir, user_agent, force_download, proxies, etag_timeout, token, local_files_only, headers, endpoint, legacy_cache_layout, resume_download, force_filename, local_dir_use_symlinks)
   [1220](file:///C:/Users/schadem/Anaconda3/envs/watermark-env/Lib/site-packages/huggingface_hub/file_download.py:1220) else:
-> [1221](file:///C:/Users/schadem/Anaconda3/envs/watermark-env/Lib/site-packages/huggingface_hub/file_download.py:1221)     return _hf_hub_download_to_cache_dir(
   [1222](file:///C:/Users/schadem/Anaconda3/envs/watermark-env/Lib/site-packages/huggingface_hub/file_download.py:1222)         # Destination
   [1223](file:///C:/Users/schadem/Anaconda3/envs/watermark-env/Lib/site-packages/huggingface_hub/file_download.py:1223)         cache_dir=cache_dir,
   [1224](file:///C:/Users/schadem/Anaconda3/envs/watermark-env/Lib/site-packages/huggingface_hub/file_download.py:1224)         # File info
   [1225](file:///C:/Users/schadem/Anaconda3/envs/watermark-env/Lib/site-packages/huggingface_hub/file_download.py:1225)         repo_id=repo_id,
   [1226](file:///C:/Users/schadem/Anaconda3/envs/watermark-env/Lib/site-packages/huggingface_hub/file_download.py:1226)         filename=filename,
   [1227](file:///C:/Users/schadem/Anaconda3/envs/watermark-env/Lib/site-packages/huggingface_hub/file_download.py:1227)         repo_type=repo_type,
   [1228](file:///C:/Users/schadem/Anaconda3/envs/watermark-env/Lib/site-packages/huggingface_hub/file_download.py:1228)         revision=revision,
   [1229](file:///C:/Users/schadem/Anaconda3/envs/watermark-env/Lib/site-packages/huggingface_hub/file_download.py:1229)         # HTTP info
   [1230](file:///C:/Users/schadem/Anaconda3/envs/watermark-env/Lib/site-packages/huggingface_hub/file_download.py:1230)         headers=headers,
   [1231](file:///C:/Users/schadem/Anaconda3/envs/watermark-env/Lib/site-packages/huggingface_hub/file_download.py:1231)         proxies=proxies,
   [1232](file:///C:/Users/schadem/Anaconda3/envs/watermark-env/Lib/site-packages/huggingface_hub/file_download.py:1232)         etag_timeout=etag_timeout,
   [1233](file:///C:/Users/schadem/Anaconda3/envs/watermark-env/Lib/site-packages/huggingface_hub/file_download.py:1233)         endpoint=endpoint,
   [1234](file:///C:/Users/schadem/Anaconda3/envs/watermark-env/Lib/site-packages/huggingface_hub/file_download.py:1234)         # Additional options
   [1235](file:///C:/Users/schadem/Anaconda3/envs/watermark-env/Lib/site-packages/huggingface_hub/file_download.py:1235)         local_files_only=local_files_only,
   [1236](file:///C:/Users/schadem/Anaconda3/envs/watermark-env/Lib/site-packages/huggingface_hub/file_download.py:1236)         force_download=force_download,
   [1237](file:///C:/Users/schadem/Anaconda3/envs/watermark-env/Lib/site-packages/huggingface_hub/file_download.py:1237)     )

File c:\Users\schadem\Anaconda3\envs\watermark-env\Lib\site-packages\huggingface_hub\file_download.py:1325, in _hf_hub_download_to_cache_dir(cache_dir, repo_id, filename, repo_type, revision, headers, proxies, etag_timeout, endpoint, local_files_only, force_download)
   [1324](file:///C:/Users/schadem/Anaconda3/envs/watermark-env/Lib/site-packages/huggingface_hub/file_download.py:1324)     # Otherwise, raise appropriate error
-> [1325](file:///C:/Users/schadem/Anaconda3/envs/watermark-env/Lib/site-packages/huggingface_hub/file_download.py:1325)     _raise_on_head_call_error(head_call_error, force_download, local_files_only)
   [1327](file:///C:/Users/schadem/Anaconda3/envs/watermark-env/Lib/site-packages/huggingface_hub/file_download.py:1327) # From now on, etag, commit_hash, url and size are not None.

File c:\Users\schadem\Anaconda3\envs\watermark-env\Lib\site-packages\huggingface_hub\file_download.py:1823, in _raise_on_head_call_error(head_call_error, force_download, local_files_only)
   [1821](file:///C:/Users/schadem/Anaconda3/envs/watermark-env/Lib/site-packages/huggingface_hub/file_download.py:1821) elif isinstance(head_call_error, RepositoryNotFoundError) or isinstance(head_call_error, GatedRepoError):
   [1822](file:///C:/Users/schadem/Anaconda3/envs/watermark-env/Lib/site-packages/huggingface_hub/file_download.py:1822)     # Repo not found or gated => let's raise the actual error
-> [1823](file:///C:/Users/schadem/Anaconda3/envs/watermark-env/Lib/site-packages/huggingface_hub/file_download.py:1823)     raise head_call_error
   [1824](file:///C:/Users/schadem/Anaconda3/envs/watermark-env/Lib/site-packages/huggingface_hub/file_download.py:1824) else:
   [1825](file:///C:/Users/schadem/Anaconda3/envs/watermark-env/Lib/site-packages/huggingface_hub/file_download.py:1825)     # Otherwise: most likely a connection issue or Hub downtime => let's warn the user

File c:\Users\schadem\Anaconda3\envs\watermark-env\Lib\site-packages\huggingface_hub\file_download.py:1722, in _get_metadata_or_catch_error(repo_id, filename, repo_type, revision, endpoint, proxies, etag_timeout, headers, local_files_only, relative_filename, storage_folder)
   [1721](file:///C:/Users/schadem/Anaconda3/envs/watermark-env/Lib/site-packages/huggingface_hub/file_download.py:1721) try:
-> [1722](file:///C:/Users/schadem/Anaconda3/envs/watermark-env/Lib/site-packages/huggingface_hub/file_download.py:1722)     metadata = get_hf_file_metadata(url=url, proxies=proxies, timeout=etag_timeout, headers=headers)
   [1723](file:///C:/Users/schadem/Anaconda3/envs/watermark-env/Lib/site-packages/huggingface_hub/file_download.py:1723) except EntryNotFoundError as http_error:

File c:\Users\schadem\Anaconda3\envs\watermark-env\Lib\site-packages\huggingface_hub\utils\_validators.py:114, in validate_hf_hub_args.<locals>._inner_fn(*args, **kwargs)
    [112](file:///C:/Users/schadem/Anaconda3/envs/watermark-env/Lib/site-packages/huggingface_hub/utils/_validators.py:112)     kwargs = smoothly_deprecate_use_auth_token(fn_name=fn.__name__, has_token=has_token, kwargs=kwargs)
--> [114](file:///C:/Users/schadem/Anaconda3/envs/watermark-env/Lib/site-packages/huggingface_hub/utils/_validators.py:114) return fn(*args, **kwargs)

File c:\Users\schadem\Anaconda3\envs\watermark-env\Lib\site-packages\huggingface_hub\file_download.py:1645, in get_hf_file_metadata(url, token, proxies, timeout, library_name, library_version, user_agent, headers)
   [1644](file:///C:/Users/schadem/Anaconda3/envs/watermark-env/Lib/site-packages/huggingface_hub/file_download.py:1644) # Retrieve metadata
-> [1645](file:///C:/Users/schadem/Anaconda3/envs/watermark-env/Lib/site-packages/huggingface_hub/file_download.py:1645) r = _request_wrapper(
   [1646](file:///C:/Users/schadem/Anaconda3/envs/watermark-env/Lib/site-packages/huggingface_hub/file_download.py:1646)     method="HEAD",
   [1647](file:///C:/Users/schadem/Anaconda3/envs/watermark-env/Lib/site-packages/huggingface_hub/file_download.py:1647)     url=url,
   [1648](file:///C:/Users/schadem/Anaconda3/envs/watermark-env/Lib/site-packages/huggingface_hub/file_download.py:1648)     headers=headers,
   [1649](file:///C:/Users/schadem/Anaconda3/envs/watermark-env/Lib/site-packages/huggingface_hub/file_download.py:1649)     allow_redirects=False,
   [1650](file:///C:/Users/schadem/Anaconda3/envs/watermark-env/Lib/site-packages/huggingface_hub/file_download.py:1650)     follow_relative_redirects=True,
   [1651](file:///C:/Users/schadem/Anaconda3/envs/watermark-env/Lib/site-packages/huggingface_hub/file_download.py:1651)     proxies=proxies,
   [1652](file:///C:/Users/schadem/Anaconda3/envs/watermark-env/Lib/site-packages/huggingface_hub/file_download.py:1652)     timeout=timeout,
   [1653](file:///C:/Users/schadem/Anaconda3/envs/watermark-env/Lib/site-packages/huggingface_hub/file_download.py:1653) )
   [1654](file:///C:/Users/schadem/Anaconda3/envs/watermark-env/Lib/site-packages/huggingface_hub/file_download.py:1654) hf_raise_for_status(r)

File c:\Users\schadem\Anaconda3\envs\watermark-env\Lib\site-packages\huggingface_hub\file_download.py:372, in _request_wrapper(method, url, follow_relative_redirects, **params)
    [371](file:///C:/Users/schadem/Anaconda3/envs/watermark-env/Lib/site-packages/huggingface_hub/file_download.py:371) if follow_relative_redirects:
--> [372](file:///C:/Users/schadem/Anaconda3/envs/watermark-env/Lib/site-packages/huggingface_hub/file_download.py:372)     response = _request_wrapper(
    [373](file:///C:/Users/schadem/Anaconda3/envs/watermark-env/Lib/site-packages/huggingface_hub/file_download.py:373)         method=method,
    [374](file:///C:/Users/schadem/Anaconda3/envs/watermark-env/Lib/site-packages/huggingface_hub/file_download.py:374)         url=url,
    [375](file:///C:/Users/schadem/Anaconda3/envs/watermark-env/Lib/site-packages/huggingface_hub/file_download.py:375)         follow_relative_redirects=False,
    [376](file:///C:/Users/schadem/Anaconda3/envs/watermark-env/Lib/site-packages/huggingface_hub/file_download.py:376)         **params,
    [377](file:///C:/Users/schadem/Anaconda3/envs/watermark-env/Lib/site-packages/huggingface_hub/file_download.py:377)     )
    [379](file:///C:/Users/schadem/Anaconda3/envs/watermark-env/Lib/site-packages/huggingface_hub/file_download.py:379)     # If redirection, we redirect only relative paths.
    [380](file:///C:/Users/schadem/Anaconda3/envs/watermark-env/Lib/site-packages/huggingface_hub/file_download.py:380)     # This is useful in case of a renamed repository.

File c:\Users\schadem\Anaconda3\envs\watermark-env\Lib\site-packages\huggingface_hub\file_download.py:396, in _request_wrapper(method, url, follow_relative_redirects, **params)
    [395](file:///C:/Users/schadem/Anaconda3/envs/watermark-env/Lib/site-packages/huggingface_hub/file_download.py:395) response = get_session().request(method=method, url=url, **params)
--> [396](file:///C:/Users/schadem/Anaconda3/envs/watermark-env/Lib/site-packages/huggingface_hub/file_download.py:396) hf_raise_for_status(response)
    [397](file:///C:/Users/schadem/Anaconda3/envs/watermark-env/Lib/site-packages/huggingface_hub/file_download.py:397) return response

File c:\Users\schadem\Anaconda3\envs\watermark-env\Lib\site-packages\huggingface_hub\utils\_errors.py:321, in hf_raise_for_status(response, endpoint_name)
    [318](file:///C:/Users/schadem/Anaconda3/envs/watermark-env/Lib/site-packages/huggingface_hub/utils/_errors.py:318)     message = (
    [319](file:///C:/Users/schadem/Anaconda3/envs/watermark-env/Lib/site-packages/huggingface_hub/utils/_errors.py:319)         f"{response.status_code} Client Error." + "\n\n" + f"Cannot access gated repo for url {response.url}."
    [320](file:///C:/Users/schadem/Anaconda3/envs/watermark-env/Lib/site-packages/huggingface_hub/utils/_errors.py:320)     )
--> [321](file:///C:/Users/schadem/Anaconda3/envs/watermark-env/Lib/site-packages/huggingface_hub/utils/_errors.py:321)     raise GatedRepoError(message, response) from e
    [323](file:///C:/Users/schadem/Anaconda3/envs/watermark-env/Lib/site-packages/huggingface_hub/utils/_errors.py:323) elif error_message == "Access to this resource is disabled.":

GatedRepoError: 403 Client Error. (Request ID: Root=1-666818ee-6abafae6007c6222061fad0c;ec00893a-915c-4ca2-a4c2-07b44ebd3ad4)

Cannot access gated repo for url https://huggingface.co/mistralai/Mixtral-8x7B-Instruct-v0.1/resolve/main/config.json.
Access to model mistralai/Mixtral-8x7B-Instruct-v0.1 is restricted and you are not in the authorized list. Visit https://huggingface.co/mistralai/Mixtral-8x7B-Instruct-v0.1 to ask for access.

The above exception was the direct cause of the following exception:

OSError                                   Traceback (most recent call last)
Cell In[7], [line 1](vscode-notebook-cell:?execution_count=7&line=1)
----> [1](vscode-notebook-cell:?execution_count=7&line=1) at.from_pretrained('mistralai/Mixtral-8x7B-Instruct-v0.1',# 'google-bert/bert-base-uncased',# 
      [2](vscode-notebook-cell:?execution_count=7&line=2)                     proxies={'http':proxystr,
      [3](vscode-notebook-cell:?execution_count=7&line=3)                             'https':proxystr
      [4](vscode-notebook-cell:?execution_count=7&line=4)                             },
      [5](vscode-notebook-cell:?execution_count=7&line=5)                     # use_auth_token=True,
      [6](vscode-notebook-cell:?execution_count=7&line=6)                     token='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'
      [7](vscode-notebook-cell:?execution_count=7&line=7)  )

File c:\Users\schadem\Anaconda3\envs\watermark-env\Lib\site-packages\transformers\models\auto\tokenization_auto.py:837, in AutoTokenizer.from_pretrained(cls, pretrained_model_name_or_path, *inputs, **kwargs)
    [835](file:///C:/Users/schadem/Anaconda3/envs/watermark-env/Lib/site-packages/transformers/models/auto/tokenization_auto.py:835)         config = AutoConfig.for_model(**config_dict)
    [836](file:///C:/Users/schadem/Anaconda3/envs/watermark-env/Lib/site-packages/transformers/models/auto/tokenization_auto.py:836)     else:
--> [837](file:///C:/Users/schadem/Anaconda3/envs/watermark-env/Lib/site-packages/transformers/models/auto/tokenization_auto.py:837)         config = AutoConfig.from_pretrained(
    [838](file:///C:/Users/schadem/Anaconda3/envs/watermark-env/Lib/site-packages/transformers/models/auto/tokenization_auto.py:838)             pretrained_model_name_or_path, trust_remote_code=trust_remote_code, **kwargs
    [839](file:///C:/Users/schadem/Anaconda3/envs/watermark-env/Lib/site-packages/transformers/models/auto/tokenization_auto.py:839)         )
    [840](file:///C:/Users/schadem/Anaconda3/envs/watermark-env/Lib/site-packages/transformers/models/auto/tokenization_auto.py:840) config_tokenizer_class = config.tokenizer_class
    [841](file:///C:/Users/schadem/Anaconda3/envs/watermark-env/Lib/site-packages/transformers/models/auto/tokenization_auto.py:841) if hasattr(config, "auto_map") and "AutoTokenizer" in config.auto_map:

File c:\Users\schadem\Anaconda3\envs\watermark-env\Lib\site-packages\transformers\models\auto\configuration_auto.py:934, in AutoConfig.from_pretrained(cls, pretrained_model_name_or_path, **kwargs)
    [931](file:///C:/Users/schadem/Anaconda3/envs/watermark-env/Lib/site-packages/transformers/models/auto/configuration_auto.py:931) trust_remote_code = kwargs.pop("trust_remote_code", None)
    [932](file:///C:/Users/schadem/Anaconda3/envs/watermark-env/Lib/site-packages/transformers/models/auto/configuration_auto.py:932) code_revision = kwargs.pop("code_revision", None)
--> [934](file:///C:/Users/schadem/Anaconda3/envs/watermark-env/Lib/site-packages/transformers/models/auto/configuration_auto.py:934) config_dict, unused_kwargs = PretrainedConfig.get_config_dict(pretrained_model_name_or_path, **kwargs)
    [935](file:///C:/Users/schadem/Anaconda3/envs/watermark-env/Lib/site-packages/transformers/models/auto/configuration_auto.py:935) has_remote_code = "auto_map" in config_dict and "AutoConfig" in config_dict["auto_map"]
    [936](file:///C:/Users/schadem/Anaconda3/envs/watermark-env/Lib/site-packages/transformers/models/auto/configuration_auto.py:936) has_local_code = "model_type" in config_dict and config_dict["model_type"] in CONFIG_MAPPING

File c:\Users\schadem\Anaconda3\envs\watermark-env\Lib\site-packages\transformers\configuration_utils.py:632, in PretrainedConfig.get_config_dict(cls, pretrained_model_name_or_path, **kwargs)
    [630](file:///C:/Users/schadem/Anaconda3/envs/watermark-env/Lib/site-packages/transformers/configuration_utils.py:630) original_kwargs = copy.deepcopy(kwargs)
    [631](file:///C:/Users/schadem/Anaconda3/envs/watermark-env/Lib/site-packages/transformers/configuration_utils.py:631) # Get config dict associated with the base config file
--> [632](file:///C:/Users/schadem/Anaconda3/envs/watermark-env/Lib/site-packages/transformers/configuration_utils.py:632) config_dict, kwargs = cls._get_config_dict(pretrained_model_name_or_path, **kwargs)
    [633](file:///C:/Users/schadem/Anaconda3/envs/watermark-env/Lib/site-packages/transformers/configuration_utils.py:633) if "_commit_hash" in config_dict:
    [634](file:///C:/Users/schadem/Anaconda3/envs/watermark-env/Lib/site-packages/transformers/configuration_utils.py:634)     original_kwargs["_commit_hash"] = config_dict["_commit_hash"]

File c:\Users\schadem\Anaconda3\envs\watermark-env\Lib\site-packages\transformers\configuration_utils.py:689, in PretrainedConfig._get_config_dict(cls, pretrained_model_name_or_path, **kwargs)
    [685](file:///C:/Users/schadem/Anaconda3/envs/watermark-env/Lib/site-packages/transformers/configuration_utils.py:685) configuration_file = kwargs.pop("_configuration_file", CONFIG_NAME) if gguf_file is None else gguf_file
    [687](file:///C:/Users/schadem/Anaconda3/envs/watermark-env/Lib/site-packages/transformers/configuration_utils.py:687) try:
    [688](file:///C:/Users/schadem/Anaconda3/envs/watermark-env/Lib/site-packages/transformers/configuration_utils.py:688)     # Load from local folder or from cache or download from model Hub and cache
--> [689](file:///C:/Users/schadem/Anaconda3/envs/watermark-env/Lib/site-packages/transformers/configuration_utils.py:689)     resolved_config_file = cached_file(
    [690](file:///C:/Users/schadem/Anaconda3/envs/watermark-env/Lib/site-packages/transformers/configuration_utils.py:690)         pretrained_model_name_or_path,
    [691](file:///C:/Users/schadem/Anaconda3/envs/watermark-env/Lib/site-packages/transformers/configuration_utils.py:691)         configuration_file,
    [692](file:///C:/Users/schadem/Anaconda3/envs/watermark-env/Lib/site-packages/transformers/configuration_utils.py:692)         cache_dir=cache_dir,
    [693](file:///C:/Users/schadem/Anaconda3/envs/watermark-env/Lib/site-packages/transformers/configuration_utils.py:693)         force_download=force_download,
    [694](file:///C:/Users/schadem/Anaconda3/envs/watermark-env/Lib/site-packages/transformers/configuration_utils.py:694)         proxies=proxies,
    [695](file:///C:/Users/schadem/Anaconda3/envs/watermark-env/Lib/site-packages/transformers/configuration_utils.py:695)         resume_download=resume_download,
    [696](file:///C:/Users/schadem/Anaconda3/envs/watermark-env/Lib/site-packages/transformers/configuration_utils.py:696)         local_files_only=local_files_only,
    [697](file:///C:/Users/schadem/Anaconda3/envs/watermark-env/Lib/site-packages/transformers/configuration_utils.py:697)         token=token,
    [698](file:///C:/Users/schadem/Anaconda3/envs/watermark-env/Lib/site-packages/transformers/configuration_utils.py:698)         user_agent=user_agent,
    [699](file:///C:/Users/schadem/Anaconda3/envs/watermark-env/Lib/site-packages/transformers/configuration_utils.py:699)         revision=revision,
    [700](file:///C:/Users/schadem/Anaconda3/envs/watermark-env/Lib/site-packages/transformers/configuration_utils.py:700)         subfolder=subfolder,
    [701](file:///C:/Users/schadem/Anaconda3/envs/watermark-env/Lib/site-packages/transformers/configuration_utils.py:701)         _commit_hash=commit_hash,
    [702](file:///C:/Users/schadem/Anaconda3/envs/watermark-env/Lib/site-packages/transformers/configuration_utils.py:702)     )
    [703](file:///C:/Users/schadem/Anaconda3/envs/watermark-env/Lib/site-packages/transformers/configuration_utils.py:703)     commit_hash = extract_commit_hash(resolved_config_file, commit_hash)
    [704](file:///C:/Users/schadem/Anaconda3/envs/watermark-env/Lib/site-packages/transformers/configuration_utils.py:704) except EnvironmentError:
    [705](file:///C:/Users/schadem/Anaconda3/envs/watermark-env/Lib/site-packages/transformers/configuration_utils.py:705)     # Raise any environment error raise by `cached_file`. It will have a helpful error message adapted to
    [706](file:///C:/Users/schadem/Anaconda3/envs/watermark-env/Lib/site-packages/transformers/configuration_utils.py:706)     # the original exception.

File c:\Users\schadem\Anaconda3\envs\watermark-env\Lib\site-packages\transformers\utils\hub.py:417, in cached_file(path_or_repo_id, filename, cache_dir, force_download, resume_download, proxies, token, revision, local_files_only, subfolder, repo_type, user_agent, _raise_exceptions_for_gated_repo, _raise_exceptions_for_missing_entries, _raise_exceptions_for_connection_errors, _commit_hash, **deprecated_kwargs)
    [415](file:///C:/Users/schadem/Anaconda3/envs/watermark-env/Lib/site-packages/transformers/utils/hub.py:415)     if resolved_file is not None or not _raise_exceptions_for_gated_repo:
    [416](file:///C:/Users/schadem/Anaconda3/envs/watermark-env/Lib/site-packages/transformers/utils/hub.py:416)         return resolved_file
--> [417](file:///C:/Users/schadem/Anaconda3/envs/watermark-env/Lib/site-packages/transformers/utils/hub.py:417)     raise EnvironmentError(
    [418](file:///C:/Users/schadem/Anaconda3/envs/watermark-env/Lib/site-packages/transformers/utils/hub.py:418)         "You are trying to access a gated repo.\nMake sure to have access to it at "
    [419](file:///C:/Users/schadem/Anaconda3/envs/watermark-env/Lib/site-packages/transformers/utils/hub.py:419)         f"https://huggingface.co/{path_or_repo_id}.\n{str(e)}"
    [420](file:///C:/Users/schadem/Anaconda3/envs/watermark-env/Lib/site-packages/transformers/utils/hub.py:420)     ) from e
    [421](file:///C:/Users/schadem/Anaconda3/envs/watermark-env/Lib/site-packages/transformers/utils/hub.py:421) except RepositoryNotFoundError as e:
    [422](file:///C:/Users/schadem/Anaconda3/envs/watermark-env/Lib/site-packages/transformers/utils/hub.py:422)     raise EnvironmentError(
    [423](file:///C:/Users/schadem/Anaconda3/envs/watermark-env/Lib/site-packages/transformers/utils/hub.py:423)         f"{path_or_repo_id} is not a local folder and is not a valid model identifier "
    [424](file:///C:/Users/schadem/Anaconda3/envs/watermark-env/Lib/site-packages/transformers/utils/hub.py:424)         "listed on 'https://huggingface.co/models'\nIf this is a private repository, make sure to pass a token "
    [425](file:///C:/Users/schadem/Anaconda3/envs/watermark-env/Lib/site-packages/transformers/utils/hub.py:425)         "having permission to this repo either by logging in with `huggingface-cli login` or by passing "
    [426](file:///C:/Users/schadem/Anaconda3/envs/watermark-env/Lib/site-packages/transformers/utils/hub.py:426)         "`token=<your_token>`"
    [427](file:///C:/Users/schadem/Anaconda3/envs/watermark-env/Lib/site-packages/transformers/utils/hub.py:427)     ) from e

OSError: You are trying to access a gated repo.
Make sure to have access to it at https://huggingface.co/mistralai/Mixtral-8x7B-Instruct-v0.1.
403 Client Error. (Request ID: Root=1-666818ee-6abafae6007c6222061fad0c;ec00893a-915c-4ca2-a4c2-07b44ebd3ad4)

Cannot access gated repo for url https://huggingface.co/mistralai/Mixtral-8x7B-Instruct-v0.1/resolve/main/config.json.
Access to model mistralai/Mixtral-8x7B-Instruct-v0.1 is restricted and you are not in the authorized list. Visit https://huggingface.co/mistralai/Mixtral-8x7B-Instruct-v0.1 to ask for access.

[amyeroberts]

cc @ArthurZucker

[maitagorri]

We figured out that the download with a write-enabled token does work, but not with a read-enabled one. This might be a bug with huggingface's authentication, rather than AutoTokenizer?

[amyeroberts]

@maitagorri Huh, interesting, thanks for sharing this info. Maybe cc @Wauplin here, the hub master :)

[Wauplin]

We figured out that the download with a write-enabled token does work, but not with a read-enabled one

That's unexpected indeed. @coyotte508 any idea?

[coyotte508]

Hm @maitagorri do you have a request id - or the token name+user? Maybe it's a fine-grained token and not a read token that has the issue?

If it's a fine-grained token - we just deployed a new checkbox to allow access to all gated repos - which should fix your issue:

Otherwise I would be interested in the user+token name so we can investigate (or request id header of the response)

[github-actions[bot]]

This issue has been automatically marked as stale because it has not had recent activity. If you think this still needs to be addressed please comment on this thread.

Please note that issues that do not follow the contributing guidelines are likely to be ignored.