search

hitz-zentroa / GoLLIE

Guideline following Large Language Model for Information Extraction
https://hitz-zentroa.github.io/GoLLIE/
Apache License 2.0
263 stars 18 forks source link

AttributeError: 'NoneType' object has no attribute 'device' #19

Open WindChimeRan opened 2 months ago

WindChimeRan commented 2 months ago

I tried to finetune GoLLIE-7b on crossner-ai.

bash bash_scripts/generate_data.sh
bash bash_scripts/GoLLIE-7B_CodeLLaMA.sh

I only trimmed the yaml to below:

train_tasks:
  - crossner.crossner_ai
validation_tasks:
  - crossner.crossner_ai
test_tasks:
  - crossner.crossner_ai

I got this error: 

GoLLIE/src/model/patch_models/modeling_flash_llama.py", line 178, in _update_cos_sin_cache
    or self._cos_cached.device != device
AttributeError: 'NoneType' object has no attribute 'device'

https://github.com/hitz-zentroa/GoLLIE/blob/ca0edffb4d0241415473150b3c4e20ef1f6f182b/src/model/patch_models/modeling_flash_llama.py#L164-L181

I checked the code, and the self._cos_cached is indeed None in the init ...