alexanderhucheerful / huaweirader_baseline

this is a huaweirader_baseline
9 stars 5 forks source link

train.npy相关 #1

Open wl1320310292 opened 4 years ago

wl1320310292 commented 4 years ago

您好,请问一下,训练所使用的train_demo.npy是如何产生的?是用的fliter_dbz处理得到的吗? 或者说data_eda.ipynb文件中如下面代码中load的train_demo.npy是如何而来的? `#demo不进行任何操作直接返回 def demo_pic(tid): return tid[0] test_number_listx = np.load('/media/workdir/hujh/hujh-new/huaweirader_baseline/data_eda/train_demo.npy') test_number_list = test_number_listx.tolist() with Pool(8) as p:

train_list=list(p.map(demo_pic,train_number_list))

test_list = list(p.map(filter_hard,test_number_list))

train_list = np.array(train_list)

print("fuck") test_list = np.array(test_list)

这样返回的索引就是筛选过后的

index_list = list(filter(lambda x:x!=None,x))

train_savepath = '/media/workdir/hujh/hujh-new/huaweirader_baseline/data_eda/train_demo.npy'

test_savepath = '/media/workdir/hujh/hujh-new/huaweirader_baseline/data_eda/hard_train_demo.npy'

save = np.save(train_savepath,train_list)

save = np.save(test_savepath,test_list)`

alexanderhucheerful commented 4 years ago

demo不进行任何操作直接返回

def demo_pic(tid): return tid[0] with Pool(8) as p:

train_list=list(p.map(demo_pic,train_number_list))

test_list = list(p.map(demo_pic,test_number_list))

train_list = np.array(train_list)

test_list = np.array(test_list)

这样返回的索引就是筛选过后的

index_list = list(filter(lambda x:x!=None,x))

train_savepath = '/media/workdir/hujh/hujh-new/huaweirader_baseline/data_eda/train_demo.npy'

test_savepath = '/media/workdir/hujh/hujh-new/huaweirader_baseline/data_eda/test_demo.npy'

save = np.save(train_savepath,train_list)

save = np.save(test_savepath,test_list)

alexanderhucheerful commented 4 years ago

通过上面这段代码产生的npy

wl1320310292 commented 4 years ago

好的,非常感谢,但还是有一些疑问,就是test_list = list(p.map(demo_pic,test_number_list))里面的test_number_list是调用的哪边的?我看这个test_number_list的来源是 test_number_listx = np.load('/media/workdir/hujh/hujh-new/huaweirader_baseline/data_eda/train_demo.npy') test_number_list = test_number_listx.tolist() 这样似乎又回到了我问的原来的问题。 还有就是能加一下您的联系方式吗?我刚开始学这方面的内容,可能有几个问题请教一下您,非常感谢