sh run_crf_ner.sh run error #9

Activity

1. liuyukid commented on Oct 16, 2020

   

   liuyukid

   on Oct 16, 2020

   Owner

   More actions

   Maybe you're actually using a Bert model。
2. hhdo commented on Oct 20, 2020

   

   hhdo

   on Oct 20, 2020

   Last edited by hhdo

   Author

   More actions

   Maybe you're actually using a Bert model。

   .sh file like this below.

   #!/bin/bash
   
   DATA_DIR='../datasets/mydataset/'
   MODEL_TYPE='roberta'
   MODEL_NAME_OR_PATH='../pretrained_models/RoBERTa-zh-Large/'
   OUTPUT_DIR='../output/roberta/'
   LABEL='../datasets/cluener/labels.txt'
   
   CUDA_VISIBLE_DEVICES='1' python ../examples/run_crf_ner.py \
   --data_dir $DATA_DIR \
   --model_type $MODEL_TYPE \
   --model_name_or_path $MODEL_NAME_OR_PATH \
   --output_dir $OUTPUT_DIR \
   --labels $LABEL \
   --overwrite_output_dir \
   --do_train \
   --do_eval \
   --evaluate_during_training \
   --adv_training fgm \
   --num_train_epochs 3 \
   --max_seq_length 128 \
   --logging_steps 0.2 \
   --per_gpu_train_batch_size 16 \
   --per_gpu_eval_batch_size 16 \
   --learning_rate 5e-5 \
   --bert_lr 5e-5 \
   --classifier_lr  5e-5 \
   --crf_lr  1e-3 \