Open prashantvidja opened 1 year ago
Hi, you should set the device
to -1 in the extend_config.
Like this:
extend_config = dict(
checkpoint_path="<ckpt-path>",
mentions_inventory_path="<inventory-path>",
device=-1,
tokens_per_batch=4000,
)
Hi thanks, it worked.
Could you check the below output? look like showing the wrong result
Some weights of the model checkpoint at allenai/longformer-large-4096 were not used when initializing LongformerForQuestionAnswering: ['lm_head.bias', 'lm_head.dense.weight', 'lm_head.decoder.weight', 'lm_head.layer_norm.weight', 'lm_head.layer_norm.bias', 'lm_head.dense.bias']
- This IS expected if you are initializing LongformerForQuestionAnswering from the checkpoint of a model trained on another task or with another architecture (e.g. initializing a BertForSequenceClassification model from a BertForPreTraining model).
- This IS NOT expected if you are initializing LongformerForQuestionAnswering from the checkpoint of a model that you expect to be exactly identical (initializing a BertForSequenceClassification model from a BertForSequenceClassification model).
Some weights of LongformerForQuestionAnswering were not initialized from the model checkpoint at allenai/longformer-large-4096 and are newly initialized: ['qa_outputs.bias', 'qa_outputs.weight']
You should probably TRAIN this model on a down-stream task to be able to use it for predictions and inference.
/home/ubuntu/miniconda3/envs/extend/lib/python3.8/site-packages/torch/cuda/amp/autocast_mode.py:120: UserWarning: torch.cuda.amp.autocast only affects CUDA ops, but CUDA is not available. Disabling.
warnings.warn("torch.cuda.amp.autocast only affects CUDA ops, but CUDA is not available. Disabling.")
2022-12-21 18:06:36.064 INFO classy.data.dataset.base: Dataset finished: 2 number of elements processed
[('Japan', 'Japan'), ('2-1', None), ('Syria', 'Syria national football team'), ('Friday', None)]
HI @edobobo
Could you please tell us how can we update the wiki data? In our testing, we find out that may be it is not giving results for newer terms.
Thanks
Hi,
Run spacy with the "extend" but got below error.
I think we can't install Cuda without GPU on the machine. Can we solve this without GPU?
Thanks