ys7yoo / korner

KoBERT와 CRF로 만든 한국어 개체명인식기 (BERT+CRF based Named Entity Recognition model for Korean)
Apache License 2.0
0 stars 0 forks source link

Missing key: `bert.embeddings.position_ids` #4

Open ys7yoo opened 1 year ago

ys7yoo commented 1 year ago
    model.load_state_dict(convert_keys)
  File "/home/yyoo/crf/lib/python3.8/site-packages/torch/nn/modules/module.py", line 1671, in load_state_dict
    raise RuntimeError('Error(s) in loading state_dict for {}:\n\t{}'.format(
RuntimeError: Error(s) in loading state_dict for KobertCRF:
    Missing key(s) in state_dict: "bert.embeddings.position_ids". 
ys7yoo commented 1 year ago

https://discuss.huggingface.co/t/loading-model-from-pytorch-pretrained-bert-into-transformers-library/6124/3

pip install transformers==4.5.1
ys7yoo commented 1 year ago
Traceback (most recent call last):
  File "example.py", line 7, in <module>
    from model.net import KobertCRF
  File "/home/yyoo/src/korner/model/net.py", line 5, in <module>
    from kobert.pytorch_kobert import get_pytorch_kobert_model
  File "/home/yyoo/src/korner/kobert/pytorch_kobert.py", line 23, in <module>
    from transformers import BertModel, BertConfig
  File "/home/yyoo/crf/lib/python3.8/site-packages/transformers/__init__.py", line 43, in <module>
    from . import dependency_versions_check
  File "/home/yyoo/crf/lib/python3.8/site-packages/transformers/dependency_versions_check.py", line 41, in <module>
    require_version_core(deps[pkg])
  File "/home/yyoo/crf/lib/python3.8/site-packages/transformers/utils/versions.py", line 101, in require_version_core
    return require_version(requirement, hint)
  File "/home/yyoo/crf/lib/python3.8/site-packages/transformers/utils/versions.py", line 92, in require_version
    if want_ver is not None and not ops[op](version.parse(got_ver), version.parse(want_ver)):
  File "/home/yyoo/crf/lib/python3.8/site-packages/packaging/version.py", line 52, in parse
    return Version(version)
  File "/home/yyoo/crf/lib/python3.8/site-packages/packaging/version.py", line 197, in __init__
    raise InvalidVersion(f"Invalid version: '{version}'")
packaging.version.InvalidVersion: Invalid version: '0.10.1,<0.11'
ys7yoo commented 1 year ago

https://github.com/huggingface/transformers/issues/11799

pip install -U tokenizers