THUDM / SwissArmyTransformer

SwissArmyTransformer is a flexible and powerful library to develop your own Transformer variants.
https://THUDM.github.io/SwissArmyTransformer
Apache License 2.0
1.02k stars 98 forks source link

SAT Tokenizer 地址挂了 #118

Open youngstu opened 1 year ago

youngstu commented 1 year ago

[2023-07-06 16:43:31,720] [INFO] [RANK 0] Try to load tokenizer from Huggingface transformers... Explicitly passing a revision is encouraged when loading a model with custom code to ensure no malicious code has been contributed in a newer revision. 'HTTPSConnectionPool(host='cdn-lfs.huggingface.co', port=443): Max retries exceeded with url: /repos/af/61/af61aa6351e76afb5cd67b257f67055118e5057e1f6d9cce1b4c1c566c85cfd9/5e974d9a69c242ce014c88c2b26089270f6198f3c0b700a887666cd3e816f17e?response-content-disposition=attachment%3B+filename%3DUTF-8%27%27ice_text.model%3B+filename%3D%22ice_text.model%22%3B&Expires=1688890299&Policy=eyJTdGF0ZW1lbnQiOlt7IlJlc291cmNlIjoiaHR0cHM6Ly9jZG4tbGZzLmh1Z2dpbmdmYWNlLmNvL3JlcG9zL2FmLzYxL2FmNjFhYTYzNTFlNzZhZmI1Y2Q2N2IyNTdmNjcwNTUxMThlNTA1N2UxZjZkOWNjZTFiNGMxYzU2NmM4NWNmZDkvNWU5NzRkOWE2OWMyNDJjZTAxNGM4OGMyYjI2MDg5MjcwZjYxOThmM2MwYjcwMGE4ODc2NjZjZDNlODE2ZjE3ZT9yZXNwb25zZS1jb250ZW50LWRpc3Bvc2l0aW9uPSoiLCJDb25kaXRpb24iOnsiRGF0ZUxlc3NUaGFuIjp7IkFXUzpFcG9jaFRpbWUiOjE2ODg4OTAyOTl9fX1dfQ&Signature=N9U6q-ipHqFHDD165Efe7x6zNHqWs4wltulReGh8gQDDx75Zsygpg6J486rPYFwQxEVg0ZwJdbXVjNdLpC0Z7frfWvHzOjl97tT76e5yy5mL9SuOTiHDA0ASdsBhf8oj8bbCMACFnOhUnZjSsu1ooKh4KJm9Au7tFgPMUZ5ProbVx9n1m2xTjwXbKR1YRaUSPkZLVMIscAeBz5tDi-DHX3qr8dafubrLlOgZ25kfgTGK-yD9cE7jR3R6vYuRGHGUACISGnCNI76CftJ5QRHz6ZrVdUZQpZt7zZTpdD8cppzcNbtwdvtV6DUurw7Va7JOLZwbpdoidyoN0Y8vehHkXA&Key-Pair-Id=KVTP0A1DKRTAX (Caused by ProxyError('Cannot connect to proxy.', timeout('timed out')))' thrown while requesting GET https://cdn-lfs.huggingface.co/repos/af/61/af61aa6351e76afb5cd67b257f67055118e5057e1f6d9cce1b4c1c566c85cfd9/5e974d9a69c242ce014c88c2b26089270f6198f3c0b700a887666cd3e816f17e?response-content-disposition=attachment%3B+filename%3DUTF-8%27%27ice_text.model%3B+filename%3D%22ice_text.model%22%3B&Expires=1688890299&Policy=eyJTdGF0ZW1lbnQiOlt7IlJlc291cmNlIjoiaHR0cHM6Ly9jZG4tbGZzLmh1Z2dpbmdmYWNlLmNvL3JlcG9zL2FmLzYxL2FmNjFhYTYzNTFlNzZhZmI1Y2Q2N2IyNTdmNjcwNTUxMThlNTA1N2UxZjZkOWNjZTFiNGMxYzU2NmM4NWNmZDkvNWU5NzRkOWE2OWMyNDJjZTAxNGM4OGMyYjI2MDg5MjcwZjYxOThmM2MwYjcwMGE4ODc2NjZjZDNlODE2ZjE3ZT9yZXNwb25zZS1jb250ZW50LWRpc3Bvc2l0aW9uPSoiLCJDb25kaXRpb24iOnsiRGF0ZUxlc3NUaGFuIjp7IkFXUzpFcG9jaFRpbWUiOjE2ODg4OTAyOTl9fX1dfQ&Signature=N9U6q-ipHqFHDD165Efe7x6zNHqWs4wltulReGh8gQDDx75Zsygpg6J486rPYFwQxEVg0ZwJdbXVjNdLpC0Z7frfWvHzOjl97tT76e5yy5mL9SuOTiHDA0ASdsBhf8oj8bbCMACFnOhUnZjSsu1ooKh4KJm9Au7tFgPMUZ5ProbVx9n1m2xTjwXbKR1YRaUSPkZLVMIscAeBz5tDi-DHX3qr8dafubrLlOgZ25kfgTGK-yD9cE7jR3R6vYuRGHGUACISGnCNI76CftJ5QRHz6ZrVdUZQpZt7zZTpdD8cppzcNbtwdvtV6DUurw7Va7JOLZwbpdoidyoN0Y8vehHkXA&Key-Pair-Id=KVTP0A1DKRTAX [2023-07-06 16:43:44,341] [INFO] [RANK 0] Cannot find THUDM/chatglm-6b from Huggingface or sat. Creating a fake tokenizer...

1049451037 commented 1 year ago

tokenizer是huggingface的,请检查机器连接huggingface是否正常