search

yhcc / BARTNER

215 stars 22 forks source link

运行train.py在Conll-2003数据集上时遇到value error #19

Open 619797944 opened 1 year ago

619797944 commented 1 year ago

我尝试运行train.py在CoNLL-2003数据集，但是遇到了如下问题： ValueError: setting an array element with a sequence. The requested array has an inhomogeneous shape after 1 dimensions. The detected shape was (2,) + inhomogeneous part. 我在conll-2003的文档中保存数据以如下形式： EU B-ORG rejects O German B-MISC call O to O boycott O British B-MISC lamb O . O

Peter B-PER Blackburn I-PER

BRUSSELS B-LOC 1996-08-22 O ... 请问有人遇到类似的情况吗

619797944 commented 1 year ago

我又尝试了从CoNLL-2003官方网站上下载的txt文件，仍旧会出现同样的问题

619797944 commented 1 year ago

此外，我尝试了降级numpy到1.21.6，以上问题解决了，但是会导致新的runtime error： RuntimeError: An attempt has been made to start a new process before the current process has finished its bootstrapping phase.

    This probably means that you are not using fork to start your
    child processes and you have forgotten to use the proper idiom
    in the main module:

        if __name__ == '__main__':
            freeze_support()
            ...

    The "freeze_support()" line can be omitted if the program
    is not going to be frozen to produce an executable.

在终端中，进度条刚打开，下一轮epoch又立马开始 Epoch 1/30: 0%| | 0/32430 [00:00<?, ?it/s, loss:{0:<6.5f}]before train training epochs started 2023-03-02-02-21-24-569438 Read cache from caches/data_facebook/bart-large_conll2003_word.pt. max_len_a:0.6, max_len:10 ... 不知道是否因为multiprocessing

mufengbei commented 1 year ago

一定要在linux系统下才能跑成功

Chen-14 commented 1 year ago

我尝试运行train.py在CoNLL-2003数据集，但是遇到了如下问题： ValueError: setting an array element with a sequence. The requested array has an inhomogeneous shape after 1 dimensions. The detected shape was (2,) + inhomogeneous part. 我在conll-2003的文档中保存数据以如下形式： EU B-ORG rejects O German B-MISC call O to O boycott O British B-MISC lamb O . O

Peter B-PER Blackburn I-PER

BRUSSELS B-LOC 1996-08-22 O ... 请问有人遇到类似的情况吗

你好请问目前解决了吗，我也遇到了这个问题