search

Chinese-NLP-book / rasa_chinese_book_code

《Rasa实战：构建开源对话机器人》官方随书代码 | The official source code of Rasa in Action: Building Open Source Conversational AI
https://item.jd.com/13624358.html
317 stars 112 forks source link

如何加载本地下载好的bert-base-chinese? #14

Closed zzzengzhe closed 6 months ago

zzzengzhe commented 6 months ago

你好，我运行rasa train nul时报网络连接huggingface错误，所以我自行下载了bert-base-chinese到本地，但是我不知道如何加载，谢谢。

(rasa3) D:\rasa3\hospital>rasa train nlu D:\Anaconda3\envs\rasa3\lib\site-packages\rasa\core\tracker_store.py:1044: MovedIn20Warning: Deprecated API features detected! These feature(s) are not compatible with SQLAlchemy 2.0. To prevent incompatible upgrades prior to updating applications, ensure requirements files are pinned to "sqlalchemy<2.0". Set environment variable SQLALCHEMY_WARN_20=1 to show all deprecation warnings. Set environment variable SQLALCHEMY_SILENCE_UBER_WARNING=1 to silence this message. (Background on SQLAlchemy 2.0 at: https://sqlalche.me/e/b8d9) Base: DeclarativeMeta = declarative_base() D:\Anaconda3\envs\rasa3\lib\site-packages\rasa\shared\utils\validation.py:134: DeprecationWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html import pkg_resources D:\Anaconda3\envs\rasa3\lib\site-packages\pkg_resources__init__.py:2871: DeprecationWarning: Deprecated call to pkg_resources.declare_namespace('mpl_toolkits'). Implementing implicit namespace packages (as specified in PEP 420) is preferred to pkg_resources.declare_namespace. See https://setuptools.pypa.io/en/latest/references/keywords.html#keyword-namespace-packages declare_namespace(pkg) D:\Anaconda3\envs\rasa3\lib\site-packages\pkg_resources__init__.py:2871: DeprecationWarning: Deprecated call to pkg_resources.declare_namespace('ruamel'). Implementing implicit namespace packages (as specified in PEP 420) is preferred to pkg_resources.declare_namespace. See https://setuptools.pypa.io/en/latest/references/keywords.html#keyword-namespace-packages declare_namespace(pkg) 2024-01-23 15:20:58 INFO rasa.engine.training.hooks - Restored component 'JiebaTokenizer' from cache. Building prefix dict from the default dictionary ... Loading model from cache C:\Users\ZZ\AppData\Local\Temp\jieba.cache Loading model cost 0.556 seconds. Prefix dict has been built successfully. Traceback (most recent call last): File "D:\Anaconda3\envs\rasa3\lib\site-packages\urllib3\connection.py", line 174, in _new_conn conn = connection.create_connection( File "D:\Anaconda3\envs\rasa3\lib\site-packages\urllib3\util\connection.py", line 95, in create_connection raise err File "D:\Anaconda3\envs\rasa3\lib\site-packages\urllib3\util\connection.py", line 85, in create_connection sock.connect(sa) socket.timeout: timed out

During handling of the above exception, another exception occurred:

Traceback (most recent call last): File "D:\Anaconda3\envs\rasa3\lib\site-packages\urllib3\connectionpool.py", line 715, in urlopen httplib_response = self._make_request( File "D:\Anaconda3\envs\rasa3\lib\site-packages\urllib3\connectionpool.py", line 404, in _make_request self._validate_conn(conn) File "D:\Anaconda3\envs\rasa3\lib\site-packages\urllib3\connectionpool.py", line 1058, in _validate_conn conn.connect() File "D:\Anaconda3\envs\rasa3\lib\site-packages\urllib3\connection.py", line 363, in connect self.sock = conn = self._new_conn() File "D:\Anaconda3\envs\rasa3\lib\site-packages\urllib3\connection.py", line 179, in _new_conn raise ConnectTimeoutError( urllib3.exceptions.ConnectTimeoutError: (<urllib3.connection.HTTPSConnection object at 0x000001F4B7251640>, 'Connection to huggingface.co timed out. (connect timeout=10)')

During handling of the above exception, another exception occurred:

Traceback (most recent call last): File "D:\Anaconda3\envs\rasa3\lib\site-packages\requests\adapters.py", line 486, in send resp = conn.urlopen( File "D:\Anaconda3\envs\rasa3\lib\site-packages\urllib3\connectionpool.py", line 799, in urlopen retries = retries.increment( File "D:\Anaconda3\envs\rasa3\lib\site-packages\urllib3\util\retry.py", line 592, in increment raise MaxRetryError(_pool, url, error or ResponseError(cause)) urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='huggingface.co', port=443): Max retries exceeded with url: /bert-base-chinese/resolve/main/pytorch_model.bin (Caused by ConnectTimeoutError(<urllib3.connection.HTTPSConnection object at 0x000001F4B7251640>, 'Connection to huggingface.co timed out. (connect timeout=10)'))

During handling of the above exception, another exception occurred:

Traceback (most recent call last): File "D:\Anaconda3\envs\rasa3\lib\site-packages\rasa\engine\graph.py", line 403, in _load_component self._component: GraphComponent = constructor( # type: ignore[no-redef] File "D:\Anaconda3\envs\rasa3\lib\site-packages\rasa\engine\graph.py", line 221, in load return cls.create(config, model_storage, resource, execution_context) File "D:\Anaconda3\envs\rasa3\lib\site-packages\rasa\nlu\featurizers\dense_featurizer\lm_featurizer.py", line 100, in create return cls(config, execution_context) File "D:\Anaconda3\envs\rasa3\lib\site-packages\rasa\nlu\featurizers\dense_featurizer\lm_featurizer.py", line 67, in init self._load_model_instance() File "D:\Anaconda3\envs\rasa3\lib\site-packages\rasa\nlu\featurizers\dense_featurizer\lm_featurizer.py", line 155, in _load_model_instance self.model = model_class_dict[self.model_name].from_pretrained( File "D:\Anaconda3\envs\rasa3\lib\site-packages\transformers\modeling_tf_utils.py", line 2668, in from_pretrained if has_file(pretrained_model_name_or_path, WEIGHTS_NAME, has_file_kwargs): File "D:\Anaconda3\envs\rasa3\lib\site-packages\transformers\utils\hub.py", line 609, in has_file r = requests.head(url, headers=headers, allow_redirects=False, proxies=proxies, timeout=10) File "D:\Anaconda3\envs\rasa3\lib\site-packages\requests\api.py", line 100, in head return request("head", url, kwargs) File "D:\Anaconda3\envs\rasa3\lib\site-packages\requests\api.py", line 59, in request return session.request(method=method, url=url, kwargs) File "D:\Anaconda3\envs\rasa3\lib\site-packages\requests\sessions.py", line 589, in request resp = self.send(prep, send_kwargs) File "D:\Anaconda3\envs\rasa3\lib\site-packages\requests\sessions.py", line 703, in send r = adapter.send(request, **kwargs) File "D:\Anaconda3\envs\rasa3\lib\site-packages\requests\adapters.py", line 507, in send raise ConnectTimeout(e, request=request) requests.exceptions.ConnectTimeout: HTTPSConnectionPool(host='huggingface.co', port=443): Max retries exceeded with url: /bert-base-chinese/resolve/main/pytorch_model.bin (Caused by ConnectTimeoutError(<urllib3.connection.HTTPSConnection object at 0x000001F4B7251640>, 'Connection to huggingface.co timed out. (connect timeout=10)'))

The above exception was the direct cause of the following exception:

Traceback (most recent call last): File "D:\Anaconda3\envs\rasa3\lib\runpy.py", line 197, in _run_module_as_main return _run_code(code, main_globals, None, File "D:\Anaconda3\envs\rasa3\lib\runpy.py", line 87, in _run_code exec(code, run_globals) File "D:\Anaconda3\envs\rasa3\Scripts\rasa.exe__main.py", line 7, in File "D:\Anaconda3\envs\rasa3\lib\site-packages\rasa__main__.py", line 133, in main cmdline_arguments.func(cmdline_arguments) File "D:\Anaconda3\envs\rasa3\lib\site-packages\rasa\cli\train.py", line 202, in run_nlu_training return train_nlu( File "D:\Anaconda3\envs\rasa3\lib\site-packages\rasa\model_training.py", line 453, in train_nlu return _train_graph( File "D:\Anaconda3\envs\rasa3\lib\site-packages\rasa\model_training.py", line 286, in _train_graph trainer.train( File "D:\Anaconda3\envs\rasa3\lib\site-packages\rasa\engine\training\graph_trainer.py", line 105, in train graph_runner.run(inputs={PLACEHOLDER_IMPORTER: importer}) File "D:\Anaconda3\envs\rasa3\lib\site-packages\rasa\engine\runner\dask.py", line 101, in run dask_result = dask.get(run_graph, run_targets) File "D:\Anaconda3\envs\rasa3\lib\site-packages\dask\local.py", line 557, in get_sync return get_async( File "D:\Anaconda3\envs\rasa3\lib\site-packages\dask\local.py", line 500, in get_async for key, res_info, failed in queue_get(queue).result(): File "D:\Anaconda3\envs\rasa3\lib\concurrent\futures_base.py", line 439, in result return self.get_result() File "D:\Anaconda3\envs\rasa3\lib\concurrent\futures_base.py", line 391, in get_result raise self._exception File "D:\Anaconda3\envs\rasa3\lib\site-packages\dask\local.py", line 542, in submit fut.set_result(fn(*args, *kwargs)) File "D:\Anaconda3\envs\rasa3\lib\site-packages\dask\local.py", line 238, in batch_execute_tasks return [execute_task(a) for a in it] File "D:\Anaconda3\envs\rasa3\lib\site-packages\dask\local.py", line 238, in return [execute_task(a) for a in it] File "D:\Anaconda3\envs\rasa3\lib\site-packages\dask\local.py", line 229, in execute_task result = pack_exception(e, dumps) File "D:\Anaconda3\envs\rasa3\lib\site-packages\dask\local.py", line 224, in execute_task result = _execute_task(task, data) File "D:\Anaconda3\envs\rasa3\lib\site-packages\dask\core.py", line 119, in _execute_task return func((_execute_task(a, cache) for a in args)) File "D:\Anaconda3\envs\rasa3\lib\site-packages\rasa\engine\graph.py", line 483, in call__ self._load_component(**constructor_kwargs) File "D:\Anaconda3\envs\rasa3\lib\site-packages\rasa\engine\graph.py", line 416, in _load_component raise GraphComponentException( rasa.engine.exceptions.GraphComponentException: Error initializing graph component for node run_LanguageModelFeaturizer1.