search

facebookresearch / faiss

A library for efficient similarity search and clustering of dense vectors.
https://faiss.ai
MIT License
30.63k stars 3.57k forks source link

an issue when FAISS is trying to read an index #3032

Closed spsaikumar closed 2 months ago

spsaikumar commented 1 year ago

Summary

Platform

OS: Linux (HPC server)

Faiss version: 1.7.4

Installed from: anaconda

Faiss compilation options:

Running on:

Interface:

Reproduction instructions

![image](https://github.com/facebookresearch/faiss/assets/14955754/00701b06-8489-43c7-b285-0ba952541119) (env_rasa) [pk666xrya@paula01 EU_RASA_system]$ rasa run actions --cors "*" --debug /home/sc.uni-leipzig.de/pk666xrya/miniconda3/envs/env_rasa/lib/python3.9/site-packages/rasa/core/tracker_store.py:1042: MovedIn20Warning: Deprecated API features detected! These feature(s) are not compatible with SQLAlchemy 2.0. To prevent incompatible upgrades prior to updating applications, ensure requirements files are pinned to "sqlalchemy<2.0". Set environment variable SQLALCHEMY_WARN_20=1 to show all deprecation warnings. Set environment variable SQLALCHEMY_SILENCE_UBER_WARNING=1 to silence this message. (Background on SQLAlchemy 2.0 at: https://sqlalche.me/e/b8d9) Base: DeclarativeMeta = declarative_base() /home/sc.uni-leipzig.de/pk666xrya/miniconda3/envs/env_rasa/lib/python3.9/site-packages/rasa/shared/utils/validation.py:134: DeprecationWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html import pkg_resources /home/sc.uni-leipzig.de/pk666xrya/miniconda3/envs/env_rasa/lib/python3.9/site-packages/pkg_resources/__init__.py:2871: DeprecationWarning: Deprecated call to `pkg_resources.declare_namespace('mpl_toolkits')`. Implementing implicit namespace packages (as specified in PEP 420) is preferred to `pkg_resources.declare_namespace`. See https://setuptools.pypa.io/en/latest/references/keywords.html#keyword-namespace-packages declare_namespace(pkg) /home/sc.uni-leipzig.de/pk666xrya/miniconda3/envs/env_rasa/lib/python3.9/site-packages/pkg_resources/__init__.py:2871: DeprecationWarning: Deprecated call to `pkg_resources.declare_namespace('ruamel')`. Implementing implicit namespace packages (as specified in PEP 420) is preferred to `pkg_resources.declare_namespace`. See https://setuptools.pypa.io/en/latest/references/keywords.html#keyword-namespace-packages declare_namespace(pkg) /home/sc.uni-leipzig.de/pk666xrya/miniconda3/envs/env_rasa/lib/python3.9/site-packages/pkg_resources/__init__.py:2871: DeprecationWarning: Deprecated call to `pkg_resources.declare_namespace('ruamel.yaml')`. Implementing implicit namespace packages (as specified in PEP 420) is preferred to `pkg_resources.declare_namespace`. See https://setuptools.pypa.io/en/latest/references/keywords.html#keyword-namespace-packages declare_namespace(pkg) /home/sc.uni-leipzig.de/pk666xrya/miniconda3/envs/env_rasa/lib/python3.9/site-packages/sanic_cors/extension.py:39: DeprecationWarning: distutils Version classes are deprecated. Use packaging.version instead. SANIC_VERSION = LooseVersion(sanic_version) 2023-08-31 10:57:59 INFO rasa_sdk.endpoint - Starting action endpoint server... 2023-08-31 10:58:05 DEBUG h5py._conv - Creating converter from 7 to 5 2023-08-31 10:58:05 DEBUG h5py._conv - Creating converter from 5 to 7 2023-08-31 10:58:05 DEBUG h5py._conv - Creating converter from 7 to 5 2023-08-31 10:58:05 DEBUG h5py._conv - Creating converter from 5 to 7 2023-08-31 10:58:07 INFO numexpr.utils - Note: detected 128 virtual cores but NumExpr set to maximum of 64, check "NUMEXPR_MAX_THREADS" environment variable. 2023-08-31 10:58:07 INFO numexpr.utils - Note: NumExpr detected 128 cores but "NUMEXPR_MAX_THREADS" not set, so enforcing safe limit of 8. 2023-08-31 10:58:07 INFO numexpr.utils - NumExpr defaulting to 8 threads. /home/sc.uni-leipzig.de/pk666xrya/miniconda3/envs/env_rasa/lib/python3.9/site-packages/PyPDF2/__init__.py:21: DeprecationWarning: PyPDF2 is deprecated. Please move to the pypdf library instead. warnings.warn( 2023-08-31 10:59:03 DEBUG urllib3.connectionpool - Starting new HTTPS connection (1): huggingface.co:443 2023-08-31 10:59:03 DEBUG urllib3.connectionpool - https://huggingface.co:443 "HEAD /vennify/t5-base-grammar-correction/resolve/main/config.json HTTP/1.1" 200 0 2023-08-31 10:59:03 DEBUG filelock - Attempting to acquire lock 22404546256608 on /home/sc.uni-leipzig.de/pk666xrya/.cache/huggingface/hub/models--vennify--t5-base-grammar-correction/blobs/9f3a099b2baffcd26693a0ad0ec1089a9e4fc770.lock 2023-08-31 10:59:03 DEBUG filelock - Lock 22404546256608 acquired on /home/sc.uni-leipzig.de/pk666xrya/.cache/huggingface/hub/models--vennify--t5-base-grammar-correction/blobs/9f3a099b2baffcd26693a0ad0ec1089a9e4fc770.lock 2023-08-31 10:59:03 DEBUG urllib3.connectionpool - https://huggingface.co:443 "GET /vennify/t5-base-grammar-correction/resolve/main/config.json HTTP/1.1" 200 1416 Downloading (…)lve/main/config.json: 100%|████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 1.42k/1.42k [00:00<00:00, 822kB/s] 2023-08-31 10:59:03 DEBUG filelock - Attempting to release lock 22404546256608 on /home/sc.uni-leipzig.de/pk666xrya/.cache/huggingface/hub/models--vennify--t5-base-grammar-correction/blobs/9f3a099b2baffcd26693a0ad0ec1089a9e4fc770.lock 2023-08-31 10:59:03 DEBUG filelock - Lock 22404546256608 released on /home/sc.uni-leipzig.de/pk666xrya/.cache/huggingface/hub/models--vennify--t5-base-grammar-correction/blobs/9f3a099b2baffcd26693a0ad0ec1089a9e4fc770.lock 2023-08-31 10:59:04 DEBUG urllib3.connectionpool - https://huggingface.co:443 "HEAD /vennify/t5-base-grammar-correction/resolve/main/model.safetensors HTTP/1.1" 404 0 2023-08-31 10:59:05 DEBUG urllib3.connectionpool - https://huggingface.co:443 "HEAD /vennify/t5-base-grammar-correction/resolve/main/model.safetensors.index.json HTTP/1.1" 404 0 2023-08-31 10:59:05 DEBUG urllib3.connectionpool - https://huggingface.co:443 "HEAD /vennify/t5-base-grammar-correction/resolve/main/pytorch_model.bin HTTP/1.1" 302 0 2023-08-31 10:59:05 DEBUG filelock - Attempting to acquire lock 22404533036224 on /home/sc.uni-leipzig.de/pk666xrya/.cache/huggingface/hub/models--vennify--t5-base-grammar-correction/blobs/10deee9a53b5c6d0f47f102c04d756a208a740cd6e00347715ff732b1ec01715.lock 2023-08-31 10:59:05 DEBUG filelock - Lock 22404533036224 acquired on /home/sc.uni-leipzig.de/pk666xrya/.cache/huggingface/hub/models--vennify--t5-base-grammar-correction/blobs/10deee9a53b5c6d0f47f102c04d756a208a740cd6e00347715ff732b1ec01715.lock 2023-08-31 10:59:05 DEBUG urllib3.connectionpool - Starting new HTTPS connection (1): cdn-lfs.huggingface.co:443 2023-08-31 10:59:05 DEBUG urllib3.connectionpool - https://cdn-lfs.huggingface.co:443 "GET /vennify/t5-base-grammar-correction/10deee9a53b5c6d0f47f102c04d756a208a740cd6e00347715ff732b1ec01715?response-content-disposition=attachment%3B+filename*%3DUTF-8%27%27pytorch_model.bin%3B+filename%3D%22pytorch_model.bin%22%3B&response-content-type=application%2Foctet-stream&Expires=1693731545&Policy=eyJTdGF0ZW1lbnQiOlt7IkNvbmRpdGlvbiI6eyJEYXRlTGVzc1RoYW4iOnsiQVdTOkVwb2NoVGltZSI6MTY5MzczMTU0NX19LCJSZXNvdXJjZSI6Imh0dHBzOi8vY2RuLWxmcy5odWdnaW5nZmFjZS5jby92ZW5uaWZ5L3Q1LWJhc2UtZ3JhbW1hci1jb3JyZWN0aW9uLzEwZGVlZTlhNTNiNWM2ZDBmNDdmMTAyYzA0ZDc1NmEyMDhhNzQwY2Q2ZTAwMzQ3NzE1ZmY3MzJiMWVjMDE3MTU~cmVzcG9uc2UtY29udGVudC1kaXNwb3NpdGlvbj0qJnJlc3BvbnNlLWNvbnRlbnQtdHlwZT0qIn1dfQ__&Signature=gLk-EbAPhpcWSw9JC50irlSwly7juIl5YQyUAGGVVG8RBAqSbGRPcdc1kPfVeDOjVNPKkxUip2iUExXht-EiQelx6MgHEPXwPY9Wux1-rIQzELjo08gh7ZItc6Vqri9MRPKMubopI9oZTmkX7ERJp8upmbVbSTRYufEXTVFNQobfduvuBikUFXCj8beOV37k10dx20QWP1RPxj0EgEC-Z~QsK5u4wseU7~DmVQBJ-hbNKZrzH7G6621SRSEL82T2LVpRRlyA0zG2WSH8s12bhgrbrPmqorcYLh0jBt4VSRpOgJ9RKTxIvP7AWCaCiG7CP17CZz6volttXfOWnRyaeQ__&Key-Pair-Id=KVTP0A1DKRTAX HTTP/1.1" 200 891730879 Downloading pytorch_model.bin: 100%|████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 892M/892M [00:02<00:00, 312MB/s] 2023-08-31 10:59:08 DEBUG filelock - Attempting to release lock 22404533036224 on /home/sc.uni-leipzig.de/pk666xrya/.cache/huggingface/hub/models--vennify--t5-base-grammar-correction/blobs/10deee9a53b5c6d0f47f102c04d756a208a740cd6e00347715ff732b1ec01715.lock 2023-08-31 10:59:08 DEBUG filelock - Lock 22404533036224 released on /home/sc.uni-leipzig.de/pk666xrya/.cache/huggingface/hub/models--vennify--t5-base-grammar-correction/blobs/10deee9a53b5c6d0f47f102c04d756a208a740cd6e00347715ff732b1ec01715.lock 2023-08-31 10:59:14 DEBUG urllib3.connectionpool - https://huggingface.co:443 "HEAD /vennify/t5-base-grammar-correction/resolve/main/generation_config.json HTTP/1.1" 404 0 2023-08-31 10:59:14 DEBUG urllib3.connectionpool - https://huggingface.co:443 "HEAD /vennify/t5-base-grammar-correction/resolve/main/tokenizer_config.json HTTP/1.1" 200 0 2023-08-31 10:59:14 DEBUG filelock - Attempting to acquire lock 22411105198384 on /home/sc.uni-leipzig.de/pk666xrya/.cache/huggingface/hub/models--vennify--t5-base-grammar-correction/blobs/2de6c1b26a1bce0469edb96d44e44dc4016c9882.lock 2023-08-31 10:59:14 DEBUG filelock - Lock 22411105198384 acquired on /home/sc.uni-leipzig.de/pk666xrya/.cache/huggingface/hub/models--vennify--t5-base-grammar-correction/blobs/2de6c1b26a1bce0469edb96d44e44dc4016c9882.lock 2023-08-31 10:59:14 DEBUG urllib3.connectionpool - https://huggingface.co:443 "GET /vennify/t5-base-grammar-correction/resolve/main/tokenizer_config.json HTTP/1.1" 200 1923 Downloading (…)okenizer_config.json: 100%|███████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 1.92k/1.92k [00:00<00:00, 2.75MB/s] 2023-08-31 10:59:14 DEBUG filelock - Attempting to release lock 22411105198384 on /home/sc.uni-leipzig.de/pk666xrya/.cache/huggingface/hub/models--vennify--t5-base-grammar-correction/blobs/2de6c1b26a1bce0469edb96d44e44dc4016c9882.lock 2023-08-31 10:59:14 DEBUG filelock - Lock 22411105198384 released on /home/sc.uni-leipzig.de/pk666xrya/.cache/huggingface/hub/models--vennify--t5-base-grammar-correction/blobs/2de6c1b26a1bce0469edb96d44e44dc4016c9882.lock 2023-08-31 10:59:14 DEBUG urllib3.connectionpool - https://huggingface.co:443 "HEAD /vennify/t5-base-grammar-correction/resolve/main/spiece.model HTTP/1.1" 302 0 2023-08-31 10:59:14 DEBUG filelock - Attempting to acquire lock 22411105198384 on /home/sc.uni-leipzig.de/pk666xrya/.cache/huggingface/hub/models--vennify--t5-base-grammar-correction/blobs/d60acb128cf7b7f2536e8f38a5b18a05535c9e14c7a355904270e15b0945ea86.lock 2023-08-31 10:59:14 DEBUG filelock - Lock 22411105198384 acquired on /home/sc.uni-leipzig.de/pk666xrya/.cache/huggingface/hub/models--vennify--t5-base-grammar-correction/blobs/d60acb128cf7b7f2536e8f38a5b18a05535c9e14c7a355904270e15b0945ea86.lock 2023-08-31 10:59:14 DEBUG urllib3.connectionpool - https://cdn-lfs.huggingface.co:443 "GET /vennify/t5-base-grammar-correction/d60acb128cf7b7f2536e8f38a5b18a05535c9e14c7a355904270e15b0945ea86?response-content-disposition=attachment%3B+filename*%3DUTF-8%27%27spiece.model%3B+filename%3D%22spiece.model%22%3B&Expires=1693731554&Policy=eyJTdGF0ZW1lbnQiOlt7IkNvbmRpdGlvbiI6eyJEYXRlTGVzc1RoYW4iOnsiQVdTOkVwb2NoVGltZSI6MTY5MzczMTU1NH19LCJSZXNvdXJjZSI6Imh0dHBzOi8vY2RuLWxmcy5odWdnaW5nZmFjZS5jby92ZW5uaWZ5L3Q1LWJhc2UtZ3JhbW1hci1jb3JyZWN0aW9uL2Q2MGFjYjEyOGNmN2I3ZjI1MzZlOGYzOGE1YjE4YTA1NTM1YzllMTRjN2EzNTU5MDQyNzBlMTViMDk0NWVhODY~cmVzcG9uc2UtY29udGVudC1kaXNwb3NpdGlvbj0qIn1dfQ__&Signature=wyUXh-XXsZpeqb0NpPJmqlnc85p~mwzvLmwsftOs1pT8gR~8cThlV1iK9Y0J2YtUcidw9yC5WbsE7SW0GgMX3CMKHJVS1~nVurJMvN4-nxOV1NMTcMATMuDAWHT93VKZJEqpy~pm8XnqcXyiQRrfrFL8lhYJmdhQxoShqh-uE2UE2DoLu0roca6mK3Uj0PaNj3CBqRk34m0jU4tgQCPhF7SsOXa56-13u2IMbZNJIMoXhXR~I7tRHDKKHc9zmj91MkM6Gu6SmOV3ghNOVtXzqn4qPI3MKGhftze62ucXPk5NtrmdHyYb2O~YX7tMsdB91qX~PtLwRGz5TFZ~sYpGhA__&Key-Pair-Id=KVTP0A1DKRTAX HTTP/1.1" 200 791656 Downloading spiece.model: 100%|████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 792k/792k [00:00<00:00, 63.1MB/s] 2023-08-31 10:59:14 DEBUG filelock - Attempting to release lock 22411105198384 on /home/sc.uni-leipzig.de/pk666xrya/.cache/huggingface/hub/models--vennify--t5-base-grammar-correction/blobs/d60acb128cf7b7f2536e8f38a5b18a05535c9e14c7a355904270e15b0945ea86.lock 2023-08-31 10:59:14 DEBUG filelock - Lock 22411105198384 released on /home/sc.uni-leipzig.de/pk666xrya/.cache/huggingface/hub/models--vennify--t5-base-grammar-correction/blobs/d60acb128cf7b7f2536e8f38a5b18a05535c9e14c7a355904270e15b0945ea86.lock 2023-08-31 10:59:14 DEBUG urllib3.connectionpool - https://huggingface.co:443 "HEAD /vennify/t5-base-grammar-correction/resolve/main/tokenizer.json HTTP/1.1" 200 0 2023-08-31 10:59:14 DEBUG filelock - Attempting to acquire lock 22404525975536 on /home/sc.uni-leipzig.de/pk666xrya/.cache/huggingface/hub/models--vennify--t5-base-grammar-correction/blobs/a48e26b56fb0ae44078ff92803f080671891af22.lock 2023-08-31 10:59:14 DEBUG filelock - Lock 22404525975536 acquired on /home/sc.uni-leipzig.de/pk666xrya/.cache/huggingface/hub/models--vennify--t5-base-grammar-correction/blobs/a48e26b56fb0ae44078ff92803f080671891af22.lock 2023-08-31 10:59:15 DEBUG urllib3.connectionpool - https://huggingface.co:443 "GET /vennify/t5-base-grammar-correction/resolve/main/tokenizer.json HTTP/1.1" 200 1387438 Downloading (…)/main/tokenizer.json: 100%|███████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 1.39M/1.39M [00:00<00:00, 2.73MB/s] 2023-08-31 10:59:15 DEBUG filelock - Attempting to release lock 22404525975536 on /home/sc.uni-leipzig.de/pk666xrya/.cache/huggingface/hub/models--vennify--t5-base-grammar-correction/blobs/a48e26b56fb0ae44078ff92803f080671891af22.lock 2023-08-31 10:59:15 DEBUG filelock - Lock 22404525975536 released on /home/sc.uni-leipzig.de/pk666xrya/.cache/huggingface/hub/models--vennify--t5-base-grammar-correction/blobs/a48e26b56fb0ae44078ff92803f080671891af22.lock 2023-08-31 10:59:15 DEBUG urllib3.connectionpool - https://huggingface.co:443 "HEAD /vennify/t5-base-grammar-correction/resolve/main/added_tokens.json HTTP/1.1" 404 0 2023-08-31 10:59:16 DEBUG urllib3.connectionpool - https://huggingface.co:443 "HEAD /vennify/t5-base-grammar-correction/resolve/main/special_tokens_map.json HTTP/1.1" 200 0 2023-08-31 10:59:16 DEBUG filelock - Attempting to acquire lock 22404525976640 on /home/sc.uni-leipzig.de/pk666xrya/.cache/huggingface/hub/models--vennify--t5-base-grammar-correction/blobs/881bdbffc06e471924ecea57f962bc5f8e2a9f21.lock 2023-08-31 10:59:16 DEBUG filelock - Lock 22404525976640 acquired on /home/sc.uni-leipzig.de/pk666xrya/.cache/huggingface/hub/models--vennify--t5-base-grammar-correction/blobs/881bdbffc06e471924ecea57f962bc5f8e2a9f21.lock 2023-08-31 10:59:16 DEBUG urllib3.connectionpool - https://huggingface.co:443 "GET /vennify/t5-base-grammar-correction/resolve/main/special_tokens_map.json HTTP/1.1" 200 1786 Downloading (…)cial_tokens_map.json: 100%|███████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 1.79k/1.79k [00:00<00:00, 2.44MB/s] 2023-08-31 10:59:16 DEBUG filelock - Attempting to release lock 22404525976640 on /home/sc.uni-leipzig.de/pk666xrya/.cache/huggingface/hub/models--vennify--t5-base-grammar-correction/blobs/881bdbffc06e471924ecea57f962bc5f8e2a9f21.lock 2023-08-31 10:59:16 DEBUG filelock - Lock 22404525976640 released on /home/sc.uni-leipzig.de/pk666xrya/.cache/huggingface/hub/models--vennify--t5-base-grammar-correction/blobs/881bdbffc06e471924ecea57f962bc5f8e2a9f21.lock 2023-08-31 10:59:16 INFO happytransformer.happy_transformer - Using model: cpu 2023-08-31 10:59:17 DEBUG urllib3.connectionpool - https://huggingface.co:443 "HEAD /oliverguhr/spelling-correction-english-base/resolve/main/config.json HTTP/1.1" 200 0 2023-08-31 10:59:17 DEBUG filelock - Attempting to acquire lock 22404525975536 on /home/sc.uni-leipzig.de/pk666xrya/.cache/huggingface/hub/models--oliverguhr--spelling-correction-english-base/blobs/7b05e087e313b0799b8ea5db86712c25cef02a19.lock 2023-08-31 10:59:17 DEBUG filelock - Lock 22404525975536 acquired on /home/sc.uni-leipzig.de/pk666xrya/.cache/huggingface/hub/models--oliverguhr--spelling-correction-english-base/blobs/7b05e087e313b0799b8ea5db86712c25cef02a19.lock 2023-08-31 10:59:17 DEBUG urllib3.connectionpool - https://huggingface.co:443 "GET /oliverguhr/spelling-correction-english-base/resolve/main/config.json HTTP/1.1" 200 1744 Downloading (…)lve/main/config.json: 100%|███████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 1.74k/1.74k [00:00<00:00, 2.32MB/s] 2023-08-31 10:59:17 DEBUG filelock - Attempting to release lock 22404525975536 on /home/sc.uni-leipzig.de/pk666xrya/.cache/huggingface/hub/models--oliverguhr--spelling-correction-english-base/blobs/7b05e087e313b0799b8ea5db86712c25cef02a19.lock 2023-08-31 10:59:17 DEBUG filelock - Lock 22404525975536 released on /home/sc.uni-leipzig.de/pk666xrya/.cache/huggingface/hub/models--oliverguhr--spelling-correction-english-base/blobs/7b05e087e313b0799b8ea5db86712c25cef02a19.lock 2023-08-31 10:59:17 DEBUG urllib3.connectionpool - https://huggingface.co:443 "HEAD /oliverguhr/spelling-correction-english-base/resolve/main/model.safetensors HTTP/1.1" 302 0 2023-08-31 10:59:17 DEBUG filelock - Attempting to acquire lock 22404522613920 on /home/sc.uni-leipzig.de/pk666xrya/.cache/huggingface/hub/models--oliverguhr--spelling-correction-english-base/blobs/322f77acbba30c2561085c99f3815f99f42fcc48674a6f5d4e785cbc16448b80.lock 2023-08-31 10:59:17 DEBUG filelock - Lock 22404522613920 acquired on /home/sc.uni-leipzig.de/pk666xrya/.cache/huggingface/hub/models--oliverguhr--spelling-correction-english-base/blobs/322f77acbba30c2561085c99f3815f99f42fcc48674a6f5d4e785cbc16448b80.lock 2023-08-31 10:59:18 DEBUG urllib3.connectionpool - https://cdn-lfs.huggingface.co:443 "GET /repos/23/8a/238ab3d293dbd66ea7d936604bcf7d47779a06c466b3942bf5a6b2423ceebb8d/322f77acbba30c2561085c99f3815f99f42fcc48674a6f5d4e785cbc16448b80?response-content-disposition=attachment%3B+filename*%3DUTF-8%27%27model.safetensors%3B+filename%3D%22model.safetensors%22%3B&Expires=1693731557&Policy=eyJTdGF0ZW1lbnQiOlt7IkNvbmRpdGlvbiI6eyJEYXRlTGVzc1RoYW4iOnsiQVdTOkVwb2NoVGltZSI6MTY5MzczMTU1N319LCJSZXNvdXJjZSI6Imh0dHBzOi8vY2RuLWxmcy5odWdnaW5nZmFjZS5jby9yZXBvcy8yMy84YS8yMzhhYjNkMjkzZGJkNjZlYTdkOTM2NjA0YmNmN2Q0Nzc3OWEwNmM0NjZiMzk0MmJmNWE2YjI0MjNjZWViYjhkLzMyMmY3N2FjYmJhMzBjMjU2MTA4NWM5OWYzODE1Zjk5ZjQyZmNjNDg2NzRhNmY1ZDRlNzg1Y2JjMTY0NDhiODA~cmVzcG9uc2UtY29udGVudC1kaXNwb3NpdGlvbj0qIn1dfQ__&Signature=whsOlD88~p8PX7d85jlyD~jQ8Eu-GYZ69SVReAH2soVjm~~6Yk0Wb82A8FmUUINeQJfLe0tqW08tI1twJuQlhlbpzOcX824vRwVXQI-f-XNo9Qbj5hglmHcERXG9ci4ef710YwAaZGYjpz8d7KvTC8GCtFzbR~ZxfpwGH6iGW6oY~hcTXF3i2JfbbVZX9IOalpCzvqYjdXPAWz8DS9rX3QgzKqslUX1NNWYArd~-Ri7Ip0uzSA-3g2raCUWOlJK17u0BhO1klJDiu3VTS~QZ~51aa6yFU4sCe~D6oJ-zvUO5FW32fLBHOj~G5N-WN3FQJ8dOIwUd0Sl2PeLy31x1nQ__&Key-Pair-Id=KVTP0A1DKRTAX HTTP/1.1" 200 557912616 Downloading model.safetensors: 100%|████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 558M/558M [00:01<00:00, 347MB/s] 2023-08-31 10:59:20 DEBUG filelock - Attempting to release lock 22404522613920 on /home/sc.uni-leipzig.de/pk666xrya/.cache/huggingface/hub/models--oliverguhr--spelling-correction-english-base/blobs/322f77acbba30c2561085c99f3815f99f42fcc48674a6f5d4e785cbc16448b80.lock 2023-08-31 10:59:20 DEBUG filelock - Lock 22404522613920 released on /home/sc.uni-leipzig.de/pk666xrya/.cache/huggingface/hub/models--oliverguhr--spelling-correction-english-base/blobs/322f77acbba30c2561085c99f3815f99f42fcc48674a6f5d4e785cbc16448b80.lock 2023-08-31 10:59:27 DEBUG urllib3.connectionpool - https://huggingface.co:443 "HEAD /oliverguhr/spelling-correction-english-base/resolve/main/generation_config.json HTTP/1.1" 404 0 2023-08-31 10:59:27 DEBUG urllib3.connectionpool - https://huggingface.co:443 "HEAD /oliverguhr/spelling-correction-english-base/resolve/main/tokenizer_config.json HTTP/1.1" 200 0 2023-08-31 10:59:27 DEBUG filelock - Attempting to acquire lock 22404533036416 on /home/sc.uni-leipzig.de/pk666xrya/.cache/huggingface/hub/models--oliverguhr--spelling-correction-english-base/blobs/5ac2011fd7226c12cf363cad2015da45d3b6df8c.lock 2023-08-31 10:59:27 DEBUG filelock - Lock 22404533036416 acquired on /home/sc.uni-leipzig.de/pk666xrya/.cache/huggingface/hub/models--oliverguhr--spelling-correction-english-base/blobs/5ac2011fd7226c12cf363cad2015da45d3b6df8c.lock 2023-08-31 10:59:27 DEBUG urllib3.connectionpool - https://huggingface.co:443 "GET /oliverguhr/spelling-correction-english-base/resolve/main/tokenizer_config.json HTTP/1.1" 200 353 Downloading (…)okenizer_config.json: 100%|████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 353/353 [00:00<00:00, 472kB/s] 2023-08-31 10:59:27 DEBUG filelock - Attempting to release lock 22404533036416 on /home/sc.uni-leipzig.de/pk666xrya/.cache/huggingface/hub/models--oliverguhr--spelling-correction-english-base/blobs/5ac2011fd7226c12cf363cad2015da45d3b6df8c.lock 2023-08-31 10:59:27 DEBUG filelock - Lock 22404533036416 released on /home/sc.uni-leipzig.de/pk666xrya/.cache/huggingface/hub/models--oliverguhr--spelling-correction-english-base/blobs/5ac2011fd7226c12cf363cad2015da45d3b6df8c.lock 2023-08-31 10:59:27 DEBUG urllib3.connectionpool - https://huggingface.co:443 "HEAD /oliverguhr/spelling-correction-english-base/resolve/main/vocab.json HTTP/1.1" 200 0 2023-08-31 10:59:27 DEBUG filelock - Attempting to acquire lock 22404522614736 on /home/sc.uni-leipzig.de/pk666xrya/.cache/huggingface/hub/models--oliverguhr--spelling-correction-english-base/blobs/4ebe4bb3f3114daf2e4cc349f24873a1175a35d7.lock 2023-08-31 10:59:27 DEBUG filelock - Lock 22404522614736 acquired on /home/sc.uni-leipzig.de/pk666xrya/.cache/huggingface/hub/models--oliverguhr--spelling-correction-english-base/blobs/4ebe4bb3f3114daf2e4cc349f24873a1175a35d7.lock 2023-08-31 10:59:27 DEBUG urllib3.connectionpool - https://huggingface.co:443 "GET /oliverguhr/spelling-correction-english-base/resolve/main/vocab.json HTTP/1.1" 200 798293 Downloading (…)olve/main/vocab.json: 100%|█████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 798k/798k [00:00<00:00, 45.1MB/s] 2023-08-31 10:59:27 DEBUG filelock - Attempting to release lock 22404522614736 on /home/sc.uni-leipzig.de/pk666xrya/.cache/huggingface/hub/models--oliverguhr--spelling-correction-english-base/blobs/4ebe4bb3f3114daf2e4cc349f24873a1175a35d7.lock 2023-08-31 10:59:27 DEBUG filelock - Lock 22404522614736 released on /home/sc.uni-leipzig.de/pk666xrya/.cache/huggingface/hub/models--oliverguhr--spelling-correction-english-base/blobs/4ebe4bb3f3114daf2e4cc349f24873a1175a35d7.lock 2023-08-31 10:59:28 DEBUG urllib3.connectionpool - https://huggingface.co:443 "HEAD /oliverguhr/spelling-correction-english-base/resolve/main/merges.txt HTTP/1.1" 200 0 2023-08-31 10:59:28 DEBUG filelock - Attempting to acquire lock 22404522614688 on /home/sc.uni-leipzig.de/pk666xrya/.cache/huggingface/hub/models--oliverguhr--spelling-correction-english-base/blobs/6636bda4a1fd7a63653dffb22683b8162c8de956.lock 2023-08-31 10:59:28 DEBUG filelock - Lock 22404522614688 acquired on /home/sc.uni-leipzig.de/pk666xrya/.cache/huggingface/hub/models--oliverguhr--spelling-correction-english-base/blobs/6636bda4a1fd7a63653dffb22683b8162c8de956.lock 2023-08-31 10:59:28 DEBUG urllib3.connectionpool - https://huggingface.co:443 "GET /oliverguhr/spelling-correction-english-base/resolve/main/merges.txt HTTP/1.1" 200 456356 Downloading (…)olve/main/merges.txt: 100%|█████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 456k/456k [00:00<00:00, 1.49MB/s] 2023-08-31 10:59:28 DEBUG filelock - Attempting to release lock 22404522614688 on /home/sc.uni-leipzig.de/pk666xrya/.cache/huggingface/hub/models--oliverguhr--spelling-correction-english-base/blobs/6636bda4a1fd7a63653dffb22683b8162c8de956.lock 2023-08-31 10:59:28 DEBUG filelock - Lock 22404522614688 released on /home/sc.uni-leipzig.de/pk666xrya/.cache/huggingface/hub/models--oliverguhr--spelling-correction-english-base/blobs/6636bda4a1fd7a63653dffb22683b8162c8de956.lock 2023-08-31 10:59:28 DEBUG urllib3.connectionpool - https://huggingface.co:443 "HEAD /oliverguhr/spelling-correction-english-base/resolve/main/tokenizer.json HTTP/1.1" 200 0 2023-08-31 10:59:28 DEBUG filelock - Attempting to acquire lock 22404522614736 on /home/sc.uni-leipzig.de/pk666xrya/.cache/huggingface/hub/models--oliverguhr--spelling-correction-english-base/blobs/53991fd16215ae49c709b8c7ff24bb94f1c76fac.lock 2023-08-31 10:59:28 DEBUG filelock - Lock 22404522614736 acquired on /home/sc.uni-leipzig.de/pk666xrya/.cache/huggingface/hub/models--oliverguhr--spelling-correction-english-base/blobs/53991fd16215ae49c709b8c7ff24bb94f1c76fac.lock 2023-08-31 10:59:28 DEBUG urllib3.connectionpool - https://huggingface.co:443 "GET /oliverguhr/spelling-correction-english-base/resolve/main/tokenizer.json HTTP/1.1" 200 2108690 Downloading (…)/main/tokenizer.json: 100%|███████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 2.11M/2.11M [00:00<00:00, 10.2MB/s] 2023-08-31 10:59:29 DEBUG filelock - Attempting to release lock 22404522614736 on /home/sc.uni-leipzig.de/pk666xrya/.cache/huggingface/hub/models--oliverguhr--spelling-correction-english-base/blobs/53991fd16215ae49c709b8c7ff24bb94f1c76fac.lock 2023-08-31 10:59:29 DEBUG filelock - Lock 22404522614736 released on /home/sc.uni-leipzig.de/pk666xrya/.cache/huggingface/hub/models--oliverguhr--spelling-correction-english-base/blobs/53991fd16215ae49c709b8c7ff24bb94f1c76fac.lock 2023-08-31 10:59:29 DEBUG urllib3.connectionpool - https://huggingface.co:443 "HEAD /oliverguhr/spelling-correction-english-base/resolve/main/added_tokens.json HTTP/1.1" 404 0 2023-08-31 10:59:29 DEBUG urllib3.connectionpool - https://huggingface.co:443 "HEAD /oliverguhr/spelling-correction-english-base/resolve/main/special_tokens_map.json HTTP/1.1" 200 0 2023-08-31 10:59:29 DEBUG filelock - Attempting to acquire lock 22404454612128 on /home/sc.uni-leipzig.de/pk666xrya/.cache/huggingface/hub/models--oliverguhr--spelling-correction-english-base/blobs/2ea7ad0e45a9d1d1591782ba7e29a703d0758831.lock 2023-08-31 10:59:29 DEBUG filelock - Lock 22404454612128 acquired on /home/sc.uni-leipzig.de/pk666xrya/.cache/huggingface/hub/models--oliverguhr--spelling-correction-english-base/blobs/2ea7ad0e45a9d1d1591782ba7e29a703d0758831.lock 2023-08-31 10:59:29 DEBUG urllib3.connectionpool - https://huggingface.co:443 "GET /oliverguhr/spelling-correction-english-base/resolve/main/special_tokens_map.json HTTP/1.1" 200 239 Downloading (…)cial_tokens_map.json: 100%|████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 239/239 [00:00<00:00, 323kB/s] 2023-08-31 10:59:29 DEBUG filelock - Attempting to release lock 22404454612128 on /home/sc.uni-leipzig.de/pk666xrya/.cache/huggingface/hub/models--oliverguhr--spelling-correction-english-base/blobs/2ea7ad0e45a9d1d1591782ba7e29a703d0758831.lock 2023-08-31 10:59:29 DEBUG filelock - Lock 22404454612128 released on /home/sc.uni-leipzig.de/pk666xrya/.cache/huggingface/hub/models--oliverguhr--spelling-correction-english-base/blobs/2ea7ad0e45a9d1d1591782ba7e29a703d0758831.lock 2023-08-31 10:59:29 DEBUG urllib3.connectionpool - https://huggingface.co:443 "HEAD /t5-small/resolve/main/config.json HTTP/1.1" 200 0 2023-08-31 10:59:29 DEBUG filelock - Attempting to acquire lock 22404454612128 on /home/sc.uni-leipzig.de/pk666xrya/.cache/huggingface/hub/models--t5-small/blobs/378f74060b20f6a9a1ea41b03fc0504466206255.lock 2023-08-31 10:59:29 DEBUG filelock - Lock 22404454612128 acquired on /home/sc.uni-leipzig.de/pk666xrya/.cache/huggingface/hub/models--t5-small/blobs/378f74060b20f6a9a1ea41b03fc0504466206255.lock 2023-08-31 10:59:29 DEBUG urllib3.connectionpool - https://huggingface.co:443 "GET /t5-small/resolve/main/config.json HTTP/1.1" 200 1206 Downloading (…)lve/main/config.json: 100%|███████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 1.21k/1.21k [00:00<00:00, 1.58MB/s] 2023-08-31 10:59:29 DEBUG filelock - Attempting to release lock 22404454612128 on /home/sc.uni-leipzig.de/pk666xrya/.cache/huggingface/hub/models--t5-small/blobs/378f74060b20f6a9a1ea41b03fc0504466206255.lock 2023-08-31 10:59:29 DEBUG filelock - Lock 22404454612128 released on /home/sc.uni-leipzig.de/pk666xrya/.cache/huggingface/hub/models--t5-small/blobs/378f74060b20f6a9a1ea41b03fc0504466206255.lock 2023-08-31 10:59:30 DEBUG urllib3.connectionpool - https://huggingface.co:443 "HEAD /t5-small/resolve/main/model.safetensors HTTP/1.1" 302 0 2023-08-31 10:59:30 DEBUG filelock - Attempting to acquire lock 22404522206928 on /home/sc.uni-leipzig.de/pk666xrya/.cache/huggingface/hub/models--t5-small/blobs/bd944e5f1b3ad9b70dd9d00010a517059e19265671076b8b0a4a58d9491842bc.lock 2023-08-31 10:59:30 DEBUG filelock - Lock 22404522206928 acquired on /home/sc.uni-leipzig.de/pk666xrya/.cache/huggingface/hub/models--t5-small/blobs/bd944e5f1b3ad9b70dd9d00010a517059e19265671076b8b0a4a58d9491842bc.lock 2023-08-31 10:59:30 DEBUG urllib3.connectionpool - https://cdn-lfs.huggingface.co:443 "GET /t5-small/bd944e5f1b3ad9b70dd9d00010a517059e19265671076b8b0a4a58d9491842bc?response-content-disposition=attachment%3B+filename*%3DUTF-8%27%27model.safetensors%3B+filename%3D%22model.safetensors%22%3B&Expires=1693731570&Policy=eyJTdGF0ZW1lbnQiOlt7IkNvbmRpdGlvbiI6eyJEYXRlTGVzc1RoYW4iOnsiQVdTOkVwb2NoVGltZSI6MTY5MzczMTU3MH19LCJSZXNvdXJjZSI6Imh0dHBzOi8vY2RuLWxmcy5odWdnaW5nZmFjZS5jby90NS1zbWFsbC9iZDk0NGU1ZjFiM2FkOWI3MGRkOWQwMDAxMGE1MTcwNTllMTkyNjU2NzEwNzZiOGIwYTRhNThkOTQ5MTg0MmJjP3Jlc3BvbnNlLWNvbnRlbnQtZGlzcG9zaXRpb249KiJ9XX0_&Signature=wMIqrDXqv6kKua7~7oNmFPSuU~b~ycFgE-qF1JSbLs14n~r3CnvkeFgvnGOS8ijaHb2EuRc8J8fF86iJSj-zXIt2dA0LZOIBjsuEuNGpMj9IWoL35w-GFlolwmqVf9SLugNDQHoJnEk21Egj4drzvUg6bMdMkZg~5fwJjEV~0jzNCSNVxjqEF5sZa~vww-heiql78nt~-gRoO2AFQLXSYIFqyyTxD6h2LVkOKJT373ZKO-SJL1him8wPtX5r3zr8I1B43PwpBIlQIgmsamm5uzWHj3okC28MGNq2BAtDLaGORCQfIcxAFM79Vl7hkXV2Hjoxv0TD05KfYYSRuvxzcA__&Key-Pair-Id=KVTP0A1DKRTAX HTTP/1.1" 200 242043056 Downloading model.safetensors: 100%|████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 242M/242M [00:00<00:00, 300MB/s] 2023-08-31 10:59:31 DEBUG filelock - Attempting to release lock 22404522206928 on /home/sc.uni-leipzig.de/pk666xrya/.cache/huggingface/hub/models--t5-small/blobs/bd944e5f1b3ad9b70dd9d00010a517059e19265671076b8b0a4a58d9491842bc.lock 2023-08-31 10:59:31 DEBUG filelock - Lock 22404522206928 released on /home/sc.uni-leipzig.de/pk666xrya/.cache/huggingface/hub/models--t5-small/blobs/bd944e5f1b3ad9b70dd9d00010a517059e19265671076b8b0a4a58d9491842bc.lock 2023-08-31 10:59:32 DEBUG urllib3.connectionpool - https://huggingface.co:443 "HEAD /t5-small/resolve/main/generation_config.json HTTP/1.1" 200 0 2023-08-31 10:59:32 DEBUG filelock - Attempting to acquire lock 22404522656288 on /home/sc.uni-leipzig.de/pk666xrya/.cache/huggingface/hub/models--t5-small/blobs/d52815623b46b7db1c4b957b5a83a8ad30b0146a.lock 2023-08-31 10:59:32 DEBUG filelock - Lock 22404522656288 acquired on /home/sc.uni-leipzig.de/pk666xrya/.cache/huggingface/hub/models--t5-small/blobs/d52815623b46b7db1c4b957b5a83a8ad30b0146a.lock 2023-08-31 10:59:32 DEBUG urllib3.connectionpool - https://huggingface.co:443 "GET /t5-small/resolve/main/generation_config.json HTTP/1.1" 200 147 Downloading (…)neration_config.json: 100%|████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 147/147 [00:00<00:00, 118kB/s] 2023-08-31 10:59:32 DEBUG filelock - Attempting to release lock 22404522656288 on /home/sc.uni-leipzig.de/pk666xrya/.cache/huggingface/hub/models--t5-small/blobs/d52815623b46b7db1c4b957b5a83a8ad30b0146a.lock 2023-08-31 10:59:32 DEBUG filelock - Lock 22404522656288 released on /home/sc.uni-leipzig.de/pk666xrya/.cache/huggingface/hub/models--t5-small/blobs/d52815623b46b7db1c4b957b5a83a8ad30b0146a.lock 2023-08-31 10:59:32 DEBUG urllib3.connectionpool - https://huggingface.co:443 "HEAD /t5-small/resolve/main/spiece.model HTTP/1.1" 200 0 2023-08-31 10:59:32 DEBUG filelock - Attempting to acquire lock 22404522526368 on /home/sc.uni-leipzig.de/pk666xrya/.cache/huggingface/hub/models--t5-small/blobs/4e28ff6ebdf584f5372d9de68867399142435d9a.lock 2023-08-31 10:59:32 DEBUG filelock - Lock 22404522526368 acquired on /home/sc.uni-leipzig.de/pk666xrya/.cache/huggingface/hub/models--t5-small/blobs/4e28ff6ebdf584f5372d9de68867399142435d9a.lock 2023-08-31 10:59:32 DEBUG urllib3.connectionpool - https://huggingface.co:443 "GET /t5-small/resolve/main/spiece.model HTTP/1.1" 200 791656 Downloading (…)ve/main/spiece.model: 100%|██████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 792k/792k [00:00<00:00, 176MB/s] 2023-08-31 10:59:32 DEBUG filelock - Attempting to release lock 22404522526368 on /home/sc.uni-leipzig.de/pk666xrya/.cache/huggingface/hub/models--t5-small/blobs/4e28ff6ebdf584f5372d9de68867399142435d9a.lock 2023-08-31 10:59:32 DEBUG filelock - Lock 22404522526368 released on /home/sc.uni-leipzig.de/pk666xrya/.cache/huggingface/hub/models--t5-small/blobs/4e28ff6ebdf584f5372d9de68867399142435d9a.lock 2023-08-31 10:59:32 DEBUG urllib3.connectionpool - https://huggingface.co:443 "HEAD /t5-small/resolve/main/added_tokens.json HTTP/1.1" 404 0 2023-08-31 10:59:32 DEBUG urllib3.connectionpool - https://huggingface.co:443 "HEAD /t5-small/resolve/main/special_tokens_map.json HTTP/1.1" 404 0 2023-08-31 10:59:33 DEBUG urllib3.connectionpool - https://huggingface.co:443 "HEAD /t5-small/resolve/main/tokenizer_config.json HTTP/1.1" 200 0 2023-08-31 10:59:33 DEBUG filelock - Attempting to acquire lock 22404522526368 on /home/sc.uni-leipzig.de/pk666xrya/.cache/huggingface/hub/models--t5-small/blobs/4fd6c49c32ecf41886dba213d40030f063c72b07.lock 2023-08-31 10:59:33 DEBUG filelock - Lock 22404522526368 acquired on /home/sc.uni-leipzig.de/pk666xrya/.cache/huggingface/hub/models--t5-small/blobs/4fd6c49c32ecf41886dba213d40030f063c72b07.lock 2023-08-31 10:59:33 DEBUG urllib3.connectionpool - https://huggingface.co:443 "GET /t5-small/resolve/main/tokenizer_config.json HTTP/1.1" 200 2324 Downloading (…)okenizer_config.json: 100%|███████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 2.32k/2.32k [00:00<00:00, 3.15MB/s] 2023-08-31 10:59:33 DEBUG filelock - Attempting to release lock 22404522526368 on /home/sc.uni-leipzig.de/pk666xrya/.cache/huggingface/hub/models--t5-small/blobs/4fd6c49c32ecf41886dba213d40030f063c72b07.lock 2023-08-31 10:59:33 DEBUG filelock - Lock 22404522526368 released on /home/sc.uni-leipzig.de/pk666xrya/.cache/huggingface/hub/models--t5-small/blobs/4fd6c49c32ecf41886dba213d40030f063c72b07.lock You are using the default legacy behaviour of the . If you see this, DO NOT PANIC! This is expected, and simply means that the `legacy` (previous) behavior will be used so nothing changes for you. If you want to use the new behaviour, set `legacy=True`. This should only be set if you understand what it means, and thouroughly read the reason why this was added as explained in https://github.com/huggingface/transformers/pull/24565 /home/sc.uni-leipzig.de/pk666xrya/miniconda3/envs/env_rasa/lib/python3.9/site-packages/faiss/loader.py:28: DeprecationWarning: distutils Version classes are deprecated. Use packaging.version instead. if LooseVersion(numpy.__version__) >= "1.19": /home/sc.uni-leipzig.de/pk666xrya/miniconda3/envs/env_rasa/lib/python3.9/site-packages/setuptools/_distutils/version.py:345: DeprecationWarning: distutils Version classes are deprecated. Use packaging.version instead. other = LooseVersion(other) 2023-08-31 10:59:33 INFO faiss.loader - Loading faiss with AVX2 support. 2023-08-31 10:59:34 INFO faiss.loader - Successfully loaded faiss with AVX2 support. Traceback (most recent call last): File "/home/sc.uni-leipzig.de/pk666xrya/miniconda3/envs/env_rasa/bin/rasa", line 8, in sys.exit(main()) File "/home/sc.uni-leipzig.de/pk666xrya/miniconda3/envs/env_rasa/lib/python3.9/site-packages/rasa/__main__.py", line 133, in main cmdline_arguments.func(cmdline_arguments) File "/home/sc.uni-leipzig.de/pk666xrya/miniconda3/envs/env_rasa/lib/python3.9/site-packages/rasa/cli/run.py", line 57, in run_actions sdk.main_from_args(args) File "/home/sc.uni-leipzig.de/pk666xrya/miniconda3/envs/env_rasa/lib/python3.9/site-packages/rasa_sdk/__main__.py", line 21, in main_from_args run( File "/home/sc.uni-leipzig.de/pk666xrya/miniconda3/envs/env_rasa/lib/python3.9/site-packages/rasa_sdk/endpoint.py", line 157, in run app = create_app( File "/home/sc.uni-leipzig.de/pk666xrya/miniconda3/envs/env_rasa/lib/python3.9/site-packages/rasa_sdk/endpoint.py", line 85, in create_app executor.register_package(action_package_name) File "/home/sc.uni-leipzig.de/pk666xrya/miniconda3/envs/env_rasa/lib/python3.9/site-packages/rasa_sdk/executor.py", line 263, in register_package self._import_submodules(package) File "/home/sc.uni-leipzig.de/pk666xrya/miniconda3/envs/env_rasa/lib/python3.9/site-packages/rasa_sdk/executor.py", line 226, in _import_submodules self._import_module(full_name) File "/home/sc.uni-leipzig.de/pk666xrya/miniconda3/envs/env_rasa/lib/python3.9/site-packages/rasa_sdk/executor.py", line 240, in _import_module module = importlib.import_module(name) File "/home/sc.uni-leipzig.de/pk666xrya/miniconda3/envs/env_rasa/lib/python3.9/importlib/__init__.py", line 127, in import_module return _bootstrap._gcd_import(name[level:], package, level) File "", line 1030, in _gcd_import File "", line 1007, in _find_and_load File "", line 986, in _find_and_load_unlocked File "", line 680, in _load_unlocked File "", line 850, in exec_module File "", line 228, in _call_with_frames_removed File "/home/sc.uni-leipzig.de/pk666xrya/EU_RASA_system/actions/action_utils.py", line 168, in class Globals: File "/home/sc.uni-leipzig.de/pk666xrya/EU_RASA_system/actions/action_utils.py", line 211, in Globals fallback_qa = openAI_setup() File "/home/sc.uni-leipzig.de/pk666xrya/EU_RASA_system/actions/action_utils.py", line 129, in openAI_setup docsearch = FAISS.load_local(faiss_docstore_path, embeddings) File "/home/sc.uni-leipzig.de/pk666xrya/miniconda3/envs/env_rasa/lib/python3.9/site-packages/langchain/vectorstores/faiss.py", line 692, in load_local index = faiss.read_index( File "/home/sc.uni-leipzig.de/pk666xrya/miniconda3/envs/env_rasa/lib/python3.9/site-packages/faiss/swigfaiss_avx2.py", line 10206, in read_index return _swigfaiss_avx2.read_index(*args) RuntimeError: Error in faiss::Index* faiss::read_index(faiss::IOReader*, int) at /project/faiss/faiss/impl/index_read.cpp:1027: Index type 0x73726576 ("vers") not recognized 2023-08-31 10:59:35 DEBUG urllib3.connectionpool - Starting new HTTPS connection (1): o251570.ingest.sentry.io:443 2023-08-31 10:59:35 DEBUG urllib3.connectionpool - https://o251570.ingest.sentry.io:443 "POST /api/2801673/envelope/ HTTP/1.1" 200 2 ---------------------------------------------------- I am running on HPC server. I am also providing my faiss version list installed in my environment. (env_rasa) [pk666xrya@paula01 EU_RASA_system]$ conda list faiss # packages in environment at /home/sc.uni-leipzig.de/pk666xrya/miniconda3/envs/env_rasa: # # Name Version Build Channel faiss 1.7.4 py39h871a7df_0_cpu conda-forge faiss-cpu 1.7.4 pypi_0 pypi libfaiss 1.7.4 hf47d654_0_cpu conda-forge libfaiss-avx2 1.7.4 h1234567_0_cpu conda-forge
mdouze commented 1 year ago

The relevant error is Index type 0x73726576 ("vers") not recognized please check if you are loading a file that was saved with write_index