I got the fine-tune command in your repo:
python run.py \
--do_train \
--do_eval \
--model_name_or_path microsoft/unixcoder-base \
--train_filename dataset/train.json \
--dev_filename dataset/dev.json \
--output_dir saved_models \
--max_source_length 350 \
--max_target_length 150 \
--beam_size 3 \
--train_batch_size 32 \
--eval_batch_size 32 \
--learning_rate 5e-5 \
--gradient_accumulation_steps 1 \
--num_train_epochs 30
For now, I want to fine-tune the model with my data, but I don't know whether I must provide the --dev_filename dataset/dev.json
And I want to know what the meaning of this dev file.
Hkh9966
commented
11 months ago
I got the fine-tune command in your repo: python run.py \ --do_train \ --do_eval \ --model_name_or_path microsoft/unixcoder-base \ --train_filename dataset/train.json \ --dev_filename dataset/dev.json \ --output_dir saved_models \ --max_source_length 350 \ --max_target_length 150 \ --beam_size 3 \ --train_batch_size 32 \ --eval_batch_size 32 \ --learning_rate 5e-5 \ --gradient_accumulation_steps 1 \ --num_train_epochs 30 For now, I want to fine-tune the model with my data, but I don't know whether I must provide the --dev_filename dataset/dev.json And I want to know what the meaning of this dev file.