search

thunlp / PL-Marker

Source code for "Packed Levitated Marker for Entity and Relation Extraction"
MIT License
260 stars 35 forks source link

Can't we find this model? bert_models/scibert-uncased #56

Closed zhang-g-z closed 1 year ago

zhang-g-z commented 1 year ago

CUDA_VISIBLE_DEVICES=0 python3 run_acener.py --model_type bertspanmarker \ --model_name_or_path ../bert_models/scibert-uncased --do_lower_case \ --data_dir scierc \ --learning_rate 2e-5 --num_train_epochs 50 --per_gpu_train_batch_size 8 --per_gpu_eval_batch_size 16 --gradient_accumulation_steps 1 \ --max_seq_length 512 --save_steps 2000 --max_pair_length 256 --max_mention_ori_length 8 \ --do_eval --evaluate_during_training --eval_all_checkpoints \ --fp16 --seed 42 --onedropout --lminit \ --train_file train.json --dev_file dev.json --test_file test.json \ --output_dir sciner_models/sciner-scibert --overwrite_output_dir --output_results

Can't we find this model? --model_name_or_path ../bert_models/scibert-uncased --do_lower_case \

If using https://huggingface.co/allenai/scibert_scivocab_uncased An error will be reported. Anyway, it's not possible to train the model properly，

YeDeming commented 1 year ago

We can download the checkpoint manually.

mkdir -p bert_models/bert-base-uncased
wget -P bert_models/bert-base-uncased https://huggingface.co/bert-base-uncased/resolve/main/pytorch_model.bin
wget -P bert_models/bert-base-uncased https://huggingface.co/bert-base-uncased/resolve/main/vocab.txt
wget -P bert_models/bert-base-uncased https://huggingface.co/bert-base-uncased/resolve/main/config.json

mkdir -p bert_models/roberta-large
wget -P bert_models/roberta-large https://huggingface.co/roberta-large/resolve/main/pytorch_model.bin
wget -P bert_models/roberta-large https://huggingface.co/roberta-large/resolve/main/merges.txt
wget -P bert_models/roberta-large https://huggingface.co/roberta-large/resolve/main/vocab.json
wget -P bert_models/roberta-large https://huggingface.co/roberta-large/resolve/main/config.json

mkdir -p bert_models/albert-xxlarge-v1
wget -P bert_models/albert-xxlarge-v1 https://huggingface.co/albert-xxlarge-v1/resolve/main/pytorch_model.bin
wget -P bert_models/albert-xxlarge-v1 https://huggingface.co/albert-xxlarge-v1/resolve/main/spiece.model
wget -P bert_models/albert-xxlarge-v1 https://huggingface.co/albert-xxlarge-v1/resolve/main/config.json
wget -P bert_models/albert-xxlarge-v1 https://huggingface.co/albert-xxlarge-v1/resolve/main/tokenizer.json

mkdir -p bert_models/scibert_scivocab_uncased
wget -P bert_models/scibert_scivocab_uncased https://huggingface.co/allenai/scibert_scivocab_uncased/resolve/main/pytorch_model.bin
wget -P bert_models/scibert_scivocab_uncased https://huggingface.co/allenai/scibert_scivocab_uncased/resolve/main/vocab.txt
wget -P bert_models/scibert_scivocab_uncased https://huggingface.co/allenai/scibert_scivocab_uncased/resolve/main/config.json