lelechen63 / ATVGnet

CVPR 2019
259 stars 54 forks source link

what does lmark_train.pkl include? #11

Open SanYueSpr opened 5 years ago

SanYueSpr commented 5 years ago

In dateset.py,the value of lmark_path and mfcc_path are as follows,their values come from the same pickle file,I'm a little confused about this. Comparing data processing in demo.py,I think lmark in dataset.py corresponds to the return value of generator_demo_example_lips in the demo.py,Was my original understanding wrong?

self.lmark_root_path = '../dataset/landmark1d'
if self.train=='train': _file = open(os.path.join(dataset_dir, "lmark_train.pkl"), "rb") self.train_data = pickle.load(_file)
lmark_path = os.path.join(self.lmark_root_path , self.train_data[index][0] , self.train_data[index][1],self.train_data[index][2], self.train_data[index][2] + '.npy') mfcc_path = os.path.join('../dataset/mfcc/', self.train_data[index][0], self.train_data[index][1], self.train_data[index][2] + '.npy')

lianDaniel commented 5 years ago

For me, I just write a new dataset like original dataset. In this new dataset.py, there is only video list in the *.pkl. And it works for me.

SanYueSpr commented 5 years ago

I'll try,thanks

XinCynthia commented 5 years ago

For me, I just write a new dataset like original dataset. In this new dataset.py, there is only video list in the *.pkl. And it works for me.

Hi, could you share the file flmark_train.pkl for me or teach me how to generate it? Thank you very much!

DWCTOD commented 3 years ago

For me, I just write a new dataset like original dataset. In this new dataset.py, there is only video list in the *.pkl. And it works for me.

你好可以分享一下如何处理数据集吗?我这边没明白到底应该如何去处理,谢谢啦