yiranran / Audio-driven-TalkingFace-HeadPose

Code for "Audio-driven Talking Face Video Generation with Learning-based Personalized Head Pose" (Arxiv 2020) and "Predicting Personalized Head Movement From Short Video and Speech Signal" (TMM 2022)
https://ieeexplore.ieee.org/document/9894719
721 stars 146 forks source link

FileNotFoundError:'./checkpoints/memory_seq_p2p/60_net_G.pth' #27

Open txjlx opened 4 years ago

txjlx commented 4 years ago

Hi,Yiran: Thank you for your good work. I ran into some problems. When i ran the step 5 or test on a target person, program will load ./checkpoints/memory_seq_p2p/60_net_G.pth after initialize network with normal. I checked the folders and did not find such file. If this file generated in run time? or I just miss this file in one step? Look forward for your response. Thank you very much. image image

yiranran commented 4 years ago

In step "v. Fine-tune the gan network" if you specified person_id=31, after finetuning you'll get ./checkpoints/memory_seq_p2p/31/60_net_G.pth When testing the program will load ./checkpoints/memory_seq_p2p/31/60_net_G.pth

dipam7 commented 4 years ago

I got the same error and it was because matlab was not installed. Alternatively, you can check the colab example, it replaces matlab with octave.

Kenny-Li2023 commented 3 years ago

嗨,伊兰: 谢谢您的出色工作。 我遇到了一些问题。 当我运行第5步或在目标人员上进行测试时,程序将在正常初始化网络后加载./checkpoints/memory_seq_p2p/60_net_G.pth。 我检查了文件夹,但没有找到该文件。 该文件是否在运行时生成?或者我只是一步就错过了这个文件? 期待您的回应。 非常感谢你。 图片 图片

Hello, I also encountered the same problem. Have you solved this problem? I look forward to your answer.

Kenny-Li2023 commented 3 years ago

如果您指定person_id = 31,则在步骤“ v。微调gan网络”中,微调后您将获得./checkpoints/memory_seq_p2p/31/60_net_G.pth。 在测试程序时,将加载./checkpoints/memory_seq_p2p/31/ 60_net_G.pth

这个问题就是出在第五步 Fine-tune the gan network中 ,运行“python train_19news_1.py 31 2”时出现FileNotFoundError:'./ checkpoints / memory_seq_p2p / 60_net_G.pth' ,上面有人说是因为没有安装matlab,请问这个怎么解决?

yiranran commented 3 years ago

解决方式就是安装matlab,或者参考colab的例子用octave。

在 2020年12月19日,下午2:09,weijie li notifications@github.com 写道:

 如果您指定person_id = 31,则在步骤“ v。微调gan网络”中,微调后您将获得./checkpoints/memory_seq_p2p/31/60_net_G.pth。 在测试程序时,将加载./checkpoints/memory_seq_p2p/31/ 60_net_G.pth

这个问题就是出在第五步 Fine-tune the gan network中 ,运行“python train_19news_1.py 31 2”时出现FileNotFoundError:'./ checkpoints / memory_seq_p2p / 60_net_G.pth' ,上面有人说是因为没有安装matlab,请问这个怎么解决?

— You are receiving this because you commented. Reply to this email directly, view it on GitHub, or unsubscribe.

Kenny-Li2023 commented 3 years ago

colab的示例

我在colab的示例中也遇到了同样的问题 并且装了octave,不知道怎么解决

Kenny-Li2023 commented 3 years ago

解决方式就是安装matlab,或者参考colab的例子用octave。 在 2020年12月19日,下午2:09,weijie li @.***> 写道:  如果您指定person_id = 31,则在步骤“ v。微调gan网络”中,微调后您将获得./checkpoints/memory_seq_p2p/31/60_net_G.pth。 在测试程序时,将加载./checkpoints/memory_seq_p2p/31/ 60_net_G.pth 这个问题就是出在第五步 Fine-tune the gan network中 ,运行“python train_19news_1.py 31 2”时出现FileNotFoundError:'./ checkpoints / memory_seq_p2p / 60_net_G.pth' ,上面有人说是因为没有安装matlab,请问这个怎么解决? — You are receiving this because you commented. Reply to this email directly, view it on GitHub, or unsubscribe. 我已经安装上matlab并且链接成功了,但是还行显示没有找到这个文件夹,请问该怎么解决

Kenny-Li2023 commented 3 years ago

未安装matlab。或者,您可以检查colab示例,它用八

I have installed matlab and the link is successful, but it still shows that the folder is not found. What should I do?

yiranran commented 3 years ago

there should be some errors during gan fine-tuning step that cause the fail of outputting this pth file. could you provide more error information during running the gam fine-tuning step...

在 2020年12月23日,下午10:53,weijie li notifications@github.com 写道:

 未安装matlab。或者,您可以检查colab示例,它用八

I have installed matlab and the link is successful, but it still shows that the folder is not found. What should I do?

— You are receiving this because you commented. Reply to this email directly, view it on GitHub, or unsubscribe.

Kenny-Li2023 commented 3 years ago

there should be some errors during gan fine-tuning step that cause the fail of outputting this pth file. could you provide more error information during running the gam fine-tuning step... Thank you very much for your reply. I will give you a screenshot of the error in step 5 tomorrow morning, or you can send me your email address and I will send it directly to your email.

Kenny-Li2023 commented 3 years ago

there should be some errors during gan fine-tuning step that cause the fail of outputting this pth file. could you provide more error information during running the gam fine-tuning step... 在 2020年12月23日,下午10:53,weijie li @.***> 写道:  未安装matlab。或者,您可以检查colab示例,它用八 I have installed matlab and the link is successful, but it still shows that the folder is not found. What should I do? — You are receiving this because you commented. Reply to this email directly, view it on GitHub, or unsubscribe.

(audio_face) user02@lthpc:~/liweijie/Audio-driven-TalkingFace-HeadPose-master/render-to-video$ python train_19news_1.py 31 1 19_news/31 31_bmold_win3

                                                                                                         < M A T L A B (R) >
                                                                                               Copyright 1984-2017 The MathWorks, Inc.
                                                                                                R2017b (9.3.0.713579) 64-bit (glnxa64)
                                                                                                          September 14, 2017

For online documentation, see http://www.mathworks.com/support For product information, visit www.mathworks.com.

Elapsed time is 20.569316 seconds. loading models/model-r100-ii/model 0 [23:10:18] src/nnvm/legacy_json_util.cc:209: Loading symbol saved by previous version v1.2.0. Attempting to upgrade... [23:10:18] src/nnvm/legacy_json_util.cc:217: Symbol successfully upgraded! Traceback (most recent call last): File "/home/user02/.conda/envs/audio_face/lib/python3.6/site-packages/mxnet/symbol/symbol.py", line 1623, in simple_bind ctypes.byref(exe_handle))) File "/home/user02/.conda/envs/audio_face/lib/python3.6/site-packages/mxnet/base.py", line 253, in check_call raise MXNetError(py_str(_LIB.MXGetLastError())) mxnet.base.MXNetError: [23:10:18] src/storage/storage.cc:119: Compile with USE_CUDA=1 to enable GPU usage Stack trace: [bt] (0) /home/user02/.conda/envs/audio_face/lib/python3.6/site-packages/mxnet/libmxnet.so(+0x2795cb) [0x7f2d187965cb] [bt] (1) /home/user02/.conda/envs/audio_face/lib/python3.6/site-packages/mxnet/libmxnet.so(+0x2b5d7a5) [0x7f2d1b07a7a5] [bt] (2) /home/user02/.conda/envs/audio_face/lib/python3.6/site-packages/mxnet/libmxnet.so(+0x2b617fd) [0x7f2d1b07e7fd] [bt] (3) /home/user02/.conda/envs/audio_face/lib/python3.6/site-packages/mxnet/libmxnet.so(+0x2b63f12) [0x7f2d1b080f12] [bt] (4) /home/user02/.conda/envs/audio_face/lib/python3.6/site-packages/mxnet/libmxnet.so(mxnet::NDArray::NDArray(mxnet::TShape const&, mxnet::Context, bool, int)+0x5d0) [0x7f2d1a8052b0] [bt] (5) /home/user02/.conda/envs/audio_face/lib/python3.6/site-packages/mxnet/libmxnet.so(mxnet::common::InitZeros(mxnet::NDArrayStorageType, mxnet::TShape const&, mxnet::Context const&, int)+0x5c) [0x7f2d1a8aa49c] [bt] (6) /home/user02/.conda/envs/audio_face/lib/python3.6/site-packages/mxnet/libmxnet.so(mxnet::common::ReshapeOrCreate(std::string const&, mxnet::TShape const&, int, mxnet::NDArrayStorageType, mxnet::Context const&, std::unordered_map<std::string, mxnet::NDArray, std::hash, std::equal_to, std::allocator<std::pair<std::string const, mxnet::NDArray> > >, bool)+0x3a1) [0x7f2d1a8bd9d1] [bt] (7) /home/user02/.conda/envs/audio_face/lib/python3.6/site-packages/mxnet/libmxnet.so(mxnet::exec::GraphExecutor::InitArguments(nnvm::IndexedGraph const&, std::vector<mxnet::TShape, std::allocator > const&, std::vector<int, std::allocator > const&, std::vector<int, std::allocator > const&, std::vector<mxnet::Context, std::allocator > const&, std::vector<mxnet::Context, std::allocator > const&, std::vector<mxnet::Context, std::allocator > const&, std::vector<mxnet::OpReqType, std::allocator > const&, std::unordered_set<std::string, std::hash, std::equal_to, std::allocator > const&, mxnet::Executor const, std::unordered_map<std::string, mxnet::NDArray, std::hash, std::equal_to, std::allocator<std::pair<std::string const, mxnet::NDArray> > >, std::vector<mxnet::NDArray, std::allocator >, std::vector<mxnet::NDArray, std::allocator >, std::vector<mxnet::NDArray, std::allocator >)+0xb10) [0x7f2d1a8c59a0] [bt] (8) /home/user02/.conda/envs/audio_face/lib/python3.6/site-packages/mxnet/libmxnet.so(mxnet::exec::GraphExecutor::Init(nnvm::Symbol, mxnet::Context const&, std::map<std::string, mxnet::Context, std::less, std::allocator<std::pair<std::string const, mxnet::Context> > > const&, std::vector<mxnet::Context, std::allocator > const&, std::vector<mxnet::Context, std::allocator > const&, std::vector<mxnet::Context, std::allocator > const&, std::unordered_map<std::string, mxnet::TShape, std::hash, std::equal_to, std::allocator<std::pair<std::string const, mxnet::TShape> > > const&, std::unordered_map<std::string, int, std::hash, std::equal_to, std::allocator<std::pair<std::string const, int> > > const&, std::unordered_map<std::string, int, std::hash, std::equal_to, std::allocator<std::pair<std::string const, int> > > const&, std::vector<mxnet::OpReqType, std::allocator > const&, std::unordered_set<std::string, std::hash, std::equal_to, std::allocator > const&, std::vector<mxnet::NDArray, std::allocator >, std::vector<mxnet::NDArray, std::allocator >, std::vector<mxnet::NDArray, std::allocator >, std::unordered_map<std::string, mxnet::NDArray, std::hash, std::equal_to, std::allocator<std::pair<std::string const, mxnet::NDArray> > >, mxnet::Executor*, std::unordered_map<nnvm::NodeEntry, mxnet::NDArray, nnvm::NodeEntryHash, nnvm::NodeEntryEqual, std::allocator<std::pair<nnvm::NodeEntry const, mxnet::NDArray> > > const&)+0x6a9) [0x7f2d1a8d3d59]

During handling of the above exception, another exception occurred:

Traceback (most recent call last): File "test_batch.py", line 25, in model = face_model.FaceModel(args) File "/home/user02/liweijie/Audio-driven-TalkingFace-HeadPose-master/render-to-video/arcface/face_model.py", line 51, in init self.model = get_model(ctx, image_size, args.model, 'fc1') File "/home/user02/liweijie/Audio-driven-TalkingFace-HeadPose-master/render-to-video/arcface/face_model.py", line 38, in get_model model.bind(data_shapes=[('data', (1, 3, image_size[0], image_size[1]))]) File "/home/user02/.conda/envs/audio_face/lib/python3.6/site-packages/mxnet/module/module.py", line 429, in bind state_names=self._state_names) File "/home/user02/.conda/envs/audio_face/lib/python3.6/site-packages/mxnet/module/executor_group.py", line 279, in init self.bind_exec(data_shapes, label_shapes, shared_group) File "/home/user02/.conda/envs/audio_face/lib/python3.6/site-packages/mxnet/module/executor_group.py", line 375, in bind_exec shared_group)) File "/home/user02/.conda/envs/audio_face/lib/python3.6/site-packages/mxnet/module/executor_group.py", line 662, in _bind_ith_exec shared_buffer=shared_data_arrays, *input_shapes) File "/home/user02/.conda/envs/audio_face/lib/python3.6/site-packages/mxnet/symbol/symbol.py", line 1629, in simple_bind raise RuntimeError(error_msg) RuntimeError: simple_bind error. Arguments: data: (1, 3, 112, 112) [23:10:18] src/storage/storage.cc:119: Compile with USE_CUDA=1 to enable GPU usage Stack trace: [bt] (0) /home/user02/.conda/envs/audio_face/lib/python3.6/site-packages/mxnet/libmxnet.so(+0x2795cb) [0x7f2d187965cb] [bt] (1) /home/user02/.conda/envs/audio_face/lib/python3.6/site-packages/mxnet/libmxnet.so(+0x2b5d7a5) [0x7f2d1b07a7a5] [bt] (2) /home/user02/.conda/envs/audio_face/lib/python3.6/site-packages/mxnet/libmxnet.so(+0x2b617fd) [0x7f2d1b07e7fd] [bt] (3) /home/user02/.conda/envs/audio_face/lib/python3.6/site-packages/mxnet/libmxnet.so(+0x2b63f12) [0x7f2d1b080f12] [bt] (4) /home/user02/.conda/envs/audio_face/lib/python3.6/site-packages/mxnet/libmxnet.so(mxnet::NDArray::NDArray(mxnet::TShape const&, mxnet::Context, bool, int)+0x5d0) [0x7f2d1a8052b0] [bt] (5) /home/user02/.conda/envs/audio_face/lib/python3.6/site-packages/mxnet/libmxnet.so(mxnet::common::InitZeros(mxnet::NDArrayStorageType, mxnet::TShape const&, mxnet::Context const&, int)+0x5c) [0x7f2d1a8aa49c] [bt] (6) /home/user02/.conda/envs/audio_face/lib/python3.6/site-packages/mxnet/libmxnet.so(mxnet::common::ReshapeOrCreate(std::string const&, mxnet::TShape const&, int, mxnet::NDArrayStorageType, mxnet::Context const&, std::unordered_map<std::string, mxnet::NDArray, std::hash, std::equal_to, std::allocator<std::pair<std::string const, mxnet::NDArray> > >, bool)+0x3a1) [0x7f2d1a8bd9d1] [bt] (7) /home/user02/.conda/envs/audio_face/lib/python3.6/site-packages/mxnet/libmxnet.so(mxnet::exec::GraphExecutor::InitArguments(nnvm::IndexedGraph const&, std::vector<mxnet::TShape, std::allocator > const&, std::vector<int, std::allocator > const&, std::vector<int, std::allocator > const&, std::vector<mxnet::Context, std::allocator > const&, std::vector<mxnet::Context, std::allocator > const&, std::vector<mxnet::Context, std::allocator > const&, std::vector<mxnet::OpReqType, std::allocator > const&, std::unordered_set<std::string, std::hash, std::equal_to, std::allocator > const&, mxnet::Executor const, std::unordered_map<std::string, mxnet::NDArray, std::hash, std::equal_to, std::allocator<std::pair<std::string const, mxnet::NDArray> > >, std::vector<mxnet::NDArray, std::allocator >, std::vector<mxnet::NDArray, std::allocator >, std::vector<mxnet::NDArray, std::allocator >)+0xb10) [0x7f2d1a8c59a0] [bt] (8) /home/user02/.conda/envs/audio_face/lib/python3.6/site-packages/mxnet/libmxnet.so(mxnet::exec::GraphExecutor::Init(nnvm::Symbol, mxnet::Context const&, std::map<std::string, mxnet::Context, std::less, std::allocator<std::pair<std::string const, mxnet::Context> > > const&, std::vector<mxnet::Context, std::allocator > const&, std::vector<mxnet::Context, std::allocator > const&, std::vector<mxnet::Context, std::allocator > const&, std::unordered_map<std::string, mxnet::TShape, std::hash, std::equal_to, std::allocator<std::pair<std::string const, mxnet::TShape> > > const&, std::unordered_map<std::string, int, std::hash, std::equal_to, std::allocator<std::pair<std::string const, int> > > const&, std::unordered_map<std::string, int, std::hash, std::equal_to, std::allocator<std::pair<std::string const, int> > > const&, std::vector<mxnet::OpReqType, std::allocator > const&, std::unordered_set<std::string, std::hash, std::equal_to, std::allocator > const&, std::vector<mxnet::NDArray, std::allocator >, std::vector<mxnet::NDArray, std::allocator >, std::vector<mxnet::NDArray, std::allocator >, std::unordered_map<std::string, mxnet::NDArray, std::hash, std::equal_to, std::allocator<std::pair<std::string const, mxnet::NDArray> > >, mxnet::Executor, std::unordered_map<nnvm::NodeEntry, mxnet::NDArray, nnvm::NodeEntryHash, nnvm::NodeEntryEqual, std::allocator<std::pair<nnvm::NodeEntry const, mxnet::NDArray> > > const&)+0x6a9) [0x7f2d1a8d3d59]

loading models/model-r100-ii/model 0 [23:10:21] src/nnvm/legacy_json_util.cc:209: Loading symbol saved by previous version v1.2.0. Attempting to upgrade... [23:10:21] src/nnvm/legacy_json_util.cc:217: Symbol successfully upgraded! Traceback (most recent call last): File "/home/user02/.conda/envs/audio_face/lib/python3.6/site-packages/mxnet/symbol/symbol.py", line 1623, in simple_bind ctypes.byref(exe_handle))) File "/home/user02/.conda/envs/audio_face/lib/python3.6/site-packages/mxnet/base.py", line 253, in check_call raise MXNetError(py_str(_LIB.MXGetLastError())) mxnet.base.MXNetError: [23:10:22] src/storage/storage.cc:119: Compile with USE_CUDA=1 to enable GPU usage Stack trace: [bt] (0) /home/user02/.conda/envs/audio_face/lib/python3.6/site-packages/mxnet/libmxnet.so(+0x2795cb) [0x7f57d9ff25cb] [bt] (1) /home/user02/.conda/envs/audio_face/lib/python3.6/site-packages/mxnet/libmxnet.so(+0x2b5d7a5) [0x7f57dc8d67a5] [bt] (2) /home/user02/.conda/envs/audio_face/lib/python3.6/site-packages/mxnet/libmxnet.so(+0x2b617fd) [0x7f57dc8da7fd] [bt] (3) /home/user02/.conda/envs/audio_face/lib/python3.6/site-packages/mxnet/libmxnet.so(+0x2b63f12) [0x7f57dc8dcf12] [bt] (4) /home/user02/.conda/envs/audio_face/lib/python3.6/site-packages/mxnet/libmxnet.so(mxnet::NDArray::NDArray(mxnet::TShape const&, mxnet::Context, bool, int)+0x5d0) [0x7f57dc0612b0] [bt] (5) /home/user02/.conda/envs/audio_face/lib/python3.6/site-packages/mxnet/libmxnet.so(mxnet::common::InitZeros(mxnet::NDArrayStorageType, mxnet::TShape const&, mxnet::Context const&, int)+0x5c) [0x7f57dc10649c] [bt] (6) /home/user02/.conda/envs/audio_face/lib/python3.6/site-packages/mxnet/libmxnet.so(mxnet::common::ReshapeOrCreate(std::string const&, mxnet::TShape const&, int, mxnet::NDArrayStorageType, mxnet::Context const&, std::unordered_map<std::string, mxnet::NDArray, std::hash, std::equal_to, std::allocator<std::pair<std::string const, mxnet::NDArray> > >, bool)+0x3a1) [0x7f57dc1199d1] [bt] (7) /home/user02/.conda/envs/audio_face/lib/python3.6/site-packages/mxnet/libmxnet.so(mxnet::exec::GraphExecutor::InitArguments(nnvm::IndexedGraph const&, std::vector<mxnet::TShape, std::allocator > const&, std::vector<int, std::allocator > const&, std::vector<int, std::allocator > const&, std::vector<mxnet::Context, std::allocator > const&, std::vector<mxnet::Context, std::allocator > const&, std::vector<mxnet::Context, std::allocator > const&, std::vector<mxnet::OpReqType, std::allocator > const&, std::unordered_set<std::string, std::hash, std::equal_to, std::allocator > const&, mxnet::Executor const, std::unordered_map<std::string, mxnet::NDArray, std::hash, std::equal_to, std::allocator<std::pair<std::string const, mxnet::NDArray> > >, std::vector<mxnet::NDArray, std::allocator >, std::vector<mxnet::NDArray, std::allocator >, std::vector<mxnet::NDArray, std::allocator >)+0xb10) [0x7f57dc1219a0] [bt] (8) /home/user02/.conda/envs/audio_face/lib/python3.6/site-packages/mxnet/libmxnet.so(mxnet::exec::GraphExecutor::Init(nnvm::Symbol, mxnet::Context const&, std::map<std::string, mxnet::Context, std::less, std::allocator<std::pair<std::string const, mxnet::Context> > > const&, std::vector<mxnet::Context, std::allocator > const&, std::vector<mxnet::Context, std::allocator > const&, std::vector<mxnet::Context, std::allocator > const&, std::unordered_map<std::string, mxnet::TShape, std::hash, std::equal_to, std::allocator<std::pair<std::string const, mxnet::TShape> > > const&, std::unordered_map<std::string, int, std::hash, std::equal_to, std::allocator<std::pair<std::string const, int> > > const&, std::unordered_map<std::string, int, std::hash, std::equal_to, std::allocator<std::pair<std::string const, int> > > const&, std::vector<mxnet::OpReqType, std::allocator > const&, std::unordered_set<std::string, std::hash, std::equal_to, std::allocator > const&, std::vector<mxnet::NDArray, std::allocator >, std::vector<mxnet::NDArray, std::allocator >, std::vector<mxnet::NDArray, std::allocator >, std::unordered_map<std::string, mxnet::NDArray, std::hash, std::equal_to, std::allocator<std::pair<std::string const, mxnet::NDArray> > >, mxnet::Executor*, std::unordered_map<nnvm::NodeEntry, mxnet::NDArray, nnvm::NodeEntryHash, nnvm::NodeEntryEqual, std::allocator<std::pair<nnvm::NodeEntry const, mxnet::NDArray> > > const&)+0x6a9) [0x7f57dc12fd59]

During handling of the above exception, another exception occurred:

Traceback (most recent call last): File "test_batch.py", line 25, in model = face_model.FaceModel(args) File "/home/user02/liweijie/Audio-driven-TalkingFace-HeadPose-master/render-to-video/arcface/face_model.py", line 51, in init self.model = get_model(ctx, image_size, args.model, 'fc1') File "/home/user02/liweijie/Audio-driven-TalkingFace-HeadPose-master/render-to-video/arcface/face_model.py", line 38, in get_model model.bind(data_shapes=[('data', (1, 3, image_size[0], image_size[1]))]) File "/home/user02/.conda/envs/audio_face/lib/python3.6/site-packages/mxnet/module/module.py", line 429, in bind state_names=self._state_names) File "/home/user02/.conda/envs/audio_face/lib/python3.6/site-packages/mxnet/module/executor_group.py", line 279, in init self.bind_exec(data_shapes, label_shapes, shared_group) File "/home/user02/.conda/envs/audio_face/lib/python3.6/site-packages/mxnet/module/executor_group.py", line 375, in bind_exec shared_group)) File "/home/user02/.conda/envs/audio_face/lib/python3.6/site-packages/mxnet/module/executor_group.py", line 662, in _bind_ith_exec shared_buffer=shared_data_arrays, *input_shapes) File "/home/user02/.conda/envs/audio_face/lib/python3.6/site-packages/mxnet/symbol/symbol.py", line 1629, in simple_bind raise RuntimeError(error_msg) RuntimeError: simple_bind error. Arguments: data: (1, 3, 112, 112) [23:10:22] src/storage/storage.cc:119: Compile with USE_CUDA=1 to enable GPU usage Stack trace: [bt] (0) /home/user02/.conda/envs/audio_face/lib/python3.6/site-packages/mxnet/libmxnet.so(+0x2795cb) [0x7f57d9ff25cb] [bt] (1) /home/user02/.conda/envs/audio_face/lib/python3.6/site-packages/mxnet/libmxnet.so(+0x2b5d7a5) [0x7f57dc8d67a5] [bt] (2) /home/user02/.conda/envs/audio_face/lib/python3.6/site-packages/mxnet/libmxnet.so(+0x2b617fd) [0x7f57dc8da7fd] [bt] (3) /home/user02/.conda/envs/audio_face/lib/python3.6/site-packages/mxnet/libmxnet.so(+0x2b63f12) [0x7f57dc8dcf12] [bt] (4) /home/user02/.conda/envs/audio_face/lib/python3.6/site-packages/mxnet/libmxnet.so(mxnet::NDArray::NDArray(mxnet::TShape const&, mxnet::Context, bool, int)+0x5d0) [0x7f57dc0612b0] [bt] (5) /home/user02/.conda/envs/audio_face/lib/python3.6/site-packages/mxnet/libmxnet.so(mxnet::common::InitZeros(mxnet::NDArrayStorageType, mxnet::TShape const&, mxnet::Context const&, int)+0x5c) [0x7f57dc10649c] [bt] (6) /home/user02/.conda/envs/audio_face/lib/python3.6/site-packages/mxnet/libmxnet.so(mxnet::common::ReshapeOrCreate(std::string const&, mxnet::TShape const&, int, mxnet::NDArrayStorageType, mxnet::Context const&, std::unordered_map<std::string, mxnet::NDArray, std::hash, std::equal_to, std::allocator<std::pair<std::string const, mxnet::NDArray> > >, bool)+0x3a1) [0x7f57dc1199d1] [bt] (7) /home/user02/.conda/envs/audio_face/lib/python3.6/site-packages/mxnet/libmxnet.so(mxnet::exec::GraphExecutor::InitArguments(nnvm::IndexedGraph const&, std::vector<mxnet::TShape, std::allocator > const&, std::vector<int, std::allocator > const&, std::vector<int, std::allocator > const&, std::vector<mxnet::Context, std::allocator > const&, std::vector<mxnet::Context, std::allocator > const&, std::vector<mxnet::Context, std::allocator > const&, std::vector<mxnet::OpReqType, std::allocator > const&, std::unordered_set<std::string, std::hash, std::equal_to, std::allocator > const&, mxnet::Executor const, std::unordered_map<std::string, mxnet::NDArray, std::hash, std::equal_to, std::allocator<std::pair<std::string const, mxnet::NDArray> > >, std::vector<mxnet::NDArray, std::allocator >, std::vector<mxnet::NDArray, std::allocator >, std::vector<mxnet::NDArray, std::allocator >)+0xb10) [0x7f57dc1219a0] [bt] (8) /home/user02/.conda/envs/audio_face/lib/python3.6/site-packages/mxnet/libmxnet.so(mxnet::exec::GraphExecutor::Init(nnvm::Symbol, mxnet::Context const&, std::map<std::string, mxnet::Context, std::less, std::allocator<std::pair<std::string const, mxnet::Context> > > const&, std::vector<mxnet::Context, std::allocator > const&, std::vector<mxnet::Context, std::allocator > const&, std::vector<mxnet::Context, std::allocator > const&, std::unordered_map<std::string, mxnet::TShape, std::hash, std::equal_to, std::allocator<std::pair<std::string const, mxnet::TShape> > > const&, std::unordered_map<std::string, int, std::hash, std::equal_to, std::allocator<std::pair<std::string const, int> > > const&, std::unordered_map<std::string, int, std::hash, std::equal_to, std::allocator<std::pair<std::string const, int> > > const&, std::vector<mxnet::OpReqType, std::allocator > const&, std::unordered_set<std::string, std::hash, std::equal_to, std::allocator > const&, std::vector<mxnet::NDArray, std::allocator >, std::vector<mxnet::NDArray, std::allocator >, std::vector<mxnet::NDArray, std::allocator >, std::unordered_map<std::string, mxnet::NDArray, std::hash, std::equal_to, std::allocator<std::pair<std::string const, mxnet::NDArray> > >, mxnet::Executor, std::unordered_map<nnvm::NodeEntry, mxnet::NDArray, nnvm::NodeEntryHash, nnvm::NodeEntryEqual, std::allocator<std::pair<nnvm::NodeEntry const, mxnet::NDArray> > > const&)+0x6a9) [0x7f57dc12fd59]

----------------- Options --------------- Nw: 3
alpha: 0.3
attention: 1
batch_size: 1
beta1: 0.5
checkpoints_dir: ./checkpoints
continue_train: True [default: False] crop_size: 256
dataroot: 31_bmold_win3 [default: None] dataset_mode: aligned_feature_multi
direction: AtoB
display_env: memory_seq_31 [default: main] display_freq: 400
display_id: 0
display_ncols: 4
display_port: 8097
display_server: http://localhost
display_winsize: 256
do_saturate_mask: False
epoch: 0 [default: latest] epoch_count: 1
gan_mode: vanilla
gpu_ids: 1 [default: 0] iden_feat_dim: 512
iden_feat_dir: arcface/iden_feat/
iden_thres: 0.98
init_gain: 0.02
init_type: normal
input_nc: 3
isTrain: True [default: None] lambda_L1: 100.0
lambda_mask: 2.0 [default: 0.1] lambda_mask_smooth: 1e-05
load_iter: 0 [default: 0] load_size: 286
lr: 0.0001 [default: 0.0002] lr_decay_iters: 50
lr_policy: linear
max_dataset_size: inf
mem_size: 30000
model: memory_seq [default: cycle_gan] n_layers_D: 3
name: memory_seq_p2p/31 [default: experiment_name] ndf: 64
netD: basic
netG: unetac_adain_256
ngf: 64
niter: 60 [default: 100] niter_decay: 0 [default: 100] no_dropout: False
no_flip: False
no_html: False
norm: batch
num_threads: 4
output_nc: 3
phase: train
pool_size: 0
preprocess: resize_and_crop
print_freq: 100
resizemethod: lanczos
save_by_iter: False
save_epoch_freq: 5
save_latest_freq: 5000
serial_batches: False
spatial_feat_dim: 512
suffix:
top_k: 256
update_html_freq: 1000
verbose: False
----------------- End ------------------- dataset [AlignedFeatureMultiDataset] was created The number of training images = 298 initialize network with normal initialize network with normal model [MemorySeqModel] was created loading the model from ./checkpoints/memory_seq_p2p/0_net_G.pth loading the model from ./checkpoints/memory_seq_p2p/0_net_D.pth loading the model from ./checkpoints/memory_seq_p2p/0_net_mem.pth ---------- Networks initialized ------------- [Network G] Total number of parameters : 259.056 M [Network D] Total number of parameters : 2.775 M [Network mem] Total number of parameters : 11.952 M

create web directory ./checkpoints/memory_seq_p2p/31/web... Traceback (most recent call last): File "train.py", line 45, in for i, data in enumerate(dataset): # inner loop within one epoch File "/home/user02/liweijie/Audio-driven-TalkingFace-HeadPose-master/render-to-video/data/init.py", line 90, in iter for i, data in enumerate(self.dataloader): File "/home/user02/.conda/envs/audio_face/lib/python3.6/site-packages/torch/utils/data/dataloader.py", line 819, in next return self._process_data(data) File "/home/user02/.conda/envs/audio_face/lib/python3.6/site-packages/torch/utils/data/dataloader.py", line 846, in _process_data data.reraise() File "/home/user02/.conda/envs/audio_face/lib/python3.6/site-packages/torch/_utils.py", line 369, in reraise raise self.exc_type(msg) FileNotFoundError: Caught FileNotFoundError in DataLoader worker process 0. Original Traceback (most recent call last): File "/home/user02/.conda/envs/audio_face/lib/python3.6/site-packages/torch/utils/data/_utils/worker.py", line 178, in _worker_loop data = fetcher.fetch(index) File "/home/user02/.conda/envs/audio_face/lib/python3.6/site-packages/torch/utils/data/_utils/fetch.py", line 44, in fetch data = [self.dataset[idx] for idx in possibly_batched_index] File "/home/user02/.conda/envs/audio_face/lib/python3.6/site-packages/torch/utils/data/_utils/fetch.py", line 44, in data = [self.dataset[idx] for idx in possibly_batched_index] File "/home/user02/liweijie/Audio-driven-TalkingFace-HeadPose-master/render-to-video/data/aligned_feature_multi_dataset.py", line 94, in getitem B_feat = np.load(os.path.join(self.opt.iden_feat_dir,ss[-3],ss[-2],ss[-1][:-4]+'.npy')) File "/home/user02/.conda/envs/audio_face/lib/python3.6/site-packages/numpy/lib/npyio.py", line 422, in load fid = open(os_fspath(file), "rb") FileNotFoundError: [Errno 2] No such file or directory: 'arcface/iden_feat/19_news/31/frame249.npy'

----------------- Options --------------- Nw: 3
alpha: 0.3
aspect_ratio: 1.0
attention: 1
batch_size: 1
blinkframeid: 41
checkpoints_dir: ./checkpoints
crop_size: 256
dataroot: 31_bmold_win3 [default: None] dataset_mode: aligned_feature_multi
direction: AtoB
display_winsize: 256
do_saturate_mask: False
epoch: 60 [default: latest] eval: False
gpu_ids: 1 [default: 0] iden_feat_dim: 512
iden_feat_dir: arcface/iden_feat/
iden_thres: 0.98
imagefolder: images60 [default: images] init_gain: 0.02
init_type: normal
input_nc: 3
isTrain: False [default: None] load_iter: 0 [default: 0] load_size: 256
max_dataset_size: inf
mem_size: 30000
model: memory_seq [default: test] n: 26
n_layers_D: 3
name: memory_seq_p2p/31 [default: experiment_name] ndf: 64
netD: basic
netG: unetac_adain_256
ngf: 64
no_dropout: False
no_flip: False
norm: batch
ntest: inf
num_test: 200 [default: 50] num_threads: 4
output_nc: 3
phase: test
preprocess: resize_and_crop
resizemethod: lanczos
results_dir: ./results/
serial_batches: False
spatial_feat_dim: 512
suffix:
test_batch_list:
test_use_gt: 0
top_k: 256
verbose: False
----------------- End ------------------- dataset [AlignedFeatureMultiDataset] was created initialize network with normal model [MemorySeqModel] was created loading the model from ./checkpoints/memory_seq_p2p/60_net_G.pth Traceback (most recent call last): File "test.py", line 47, in model.setup(opt) # regular setup: load and print networks; create schedulers File "/home/user02/liweijie/Audio-driven-TalkingFace-HeadPose-master/render-to-video/models/base_model.py", line 89, in setup self.load_networks(load_suffix) File "/home/user02/liweijie/Audio-driven-TalkingFace-HeadPose-master/render-to-video/models/base_model.py", line 202, in load_networks state_dict = torch.load(load_path, map_location=str(self.device)) File "/home/user02/.conda/envs/audio_face/lib/python3.6/site-packages/torch/serialization.py", line 381, in load f = open(f, 'rb') FileNotFoundError: [Errno 2] No such file or directory: './checkpoints/memory_seq_p2p/60_net_G.pth' (audio_face) user02@lthpc:~/liweijie/Audio-driven-TalkingFace-HeadPose-master/render-to-video$

The above is the display content of the fifth step.

yiranran commented 3 years ago

Error occurs in preparing arcface feature, i.e. line 66 in train_19news_1.py during running this command "python test_batch.py --imglist trainB/31_bmold_win3.txt --gpu 1"

Please check these output error infos: "loading models/model-r100-ii/model 0 [23:10:18] src/nnvm/legacy_json_util.cc:209 http://legacy_json_util.cc:209/: Loading symbol saved by previous version v1.2.0. Attempting to upgrade... [23:10:18] src/nnvm/legacy_json_util.cc:217 http://legacy_json_util.cc:217/: Symbol successfully upgraded! Traceback (most recent call last): File "/home/user02/.conda/envs/audio_face/lib/python3.6/site-packages/mxnet/symbol/symbol.py", line 1623, in simple_bind ctypes.byref(exe_handle))) File "/home/user02/.conda/envs/audio_face/lib/python3.6/site-packages/mxnet/base.py", line 253, in check_call raise MXNetError(py_str(_LIB.MXGetLastError())) mxnet.base.MXNetError: [23:10:18] src/storage/storage.cc:119 http://storage.cc:119/: Compile with USE_CUDA=1 to enable GPU usage”

It seems the installed mxnet package was not correctly installed. https://stackoverflow.com/questions/46937610/compile-with-use-cuda-1-to-enable-gpu-usage-message-with-mxnet-on-aws-deep-lea https://stackoverflow.com/questions/46937610/compile-with-use-cuda-1-to-enable-gpu-usage-message-with-mxnet-on-aws-deep-lea Have you pip installed mxnet-cu80?

在 2020年12月24日,上午10:27,weijie li notifications@github.com 写道:

there should be some errors during gan fine-tuning step that cause the fail of outputting this pth file. could you provide more error information during running the gam fine-tuning step... … <x-msg://3/#> 在 2020年12月23日,下午10:53,weijie li @.***> 写道:  未安装matlab。或者,您可以检查colab示例,它用八 I have installed matlab and the link is successful, but it still shows that the folder is not found. What should I do? — You are receiving this because you commented. Reply to this email directly, view it on GitHub, or unsubscribe.

(audio_face) user02@lthpc:~/liweijie/Audio-driven-TalkingFace-HeadPose-master/render-to-video$ python train_19news_1.py 31 1 19_news/31 31_bmold_win3

                                                                                                     < M A T L A B (R) >
                                                                                           Copyright 1984-2017 The MathWorks, Inc.
                                                                                            R2017b (9.3.0.713579) 64-bit (glnxa64)
                                                                                                      September 14, 2017

For online documentation, see http://www.mathworks.com/support http://www.mathworks.com/support For product information, visit www.mathworks.com http://www.mathworks.com/.

Elapsed time is 20.569316 seconds. loading models/model-r100-ii/model 0 [23:10:18] src/nnvm/legacy_json_util.cc:209: Loading symbol saved by previous version v1.2.0. Attempting to upgrade... [23:10:18] src/nnvm/legacy_json_util.cc:217: Symbol successfully upgraded! Traceback (most recent call last): File "/home/user02/.conda/envs/audio_face/lib/python3.6/site-packages/mxnet/symbol/symbol.py", line 1623, in simple_bind ctypes.byref(exe_handle))) File "/home/user02/.conda/envs/audio_face/lib/python3.6/site-packages/mxnet/base.py", line 253, in check_call raise MXNetError(py_str(_LIB.MXGetLastError())) mxnet.base.MXNetError: [23:10:18] src/storage/storage.cc:119: Compile with USE_CUDA=1 to enable GPU usage Stack trace: [bt] (0) /home/user02/.conda/envs/audio_face/lib/python3.6/site-packages/mxnet/libmxnet.so(+0x2795cb) [0x7f2d187965cb] [bt] (1) /home/user02/.conda/envs/audio_face/lib/python3.6/site-packages/mxnet/libmxnet.so(+0x2b5d7a5) [0x7f2d1b07a7a5] [bt] (2) /home/user02/.conda/envs/audio_face/lib/python3.6/site-packages/mxnet/libmxnet.so(+0x2b617fd) [0x7f2d1b07e7fd] [bt] (3) /home/user02/.conda/envs/audio_face/lib/python3.6/site-packages/mxnet/libmxnet.so(+0x2b63f12) [0x7f2d1b080f12] [bt] (4) /home/user02/.conda/envs/audio_face/lib/python3.6/site-packages/mxnet/libmxnet.so(mxnet::NDArray::NDArray(mxnet::TShape const&, mxnet::Context, bool, int)+0x5d0) [0x7f2d1a8052b0] [bt] (5) /home/user02/.conda/envs/audio_face/lib/python3.6/site-packages/mxnet/libmxnet.so(mxnet::common::InitZeros(mxnet::NDArrayStorageType, mxnet::TShape const&, mxnet::Context const&, int)+0x5c) [0x7f2d1a8aa49c] [bt] (6) /home/user02/.conda/envs/audio_face/lib/python3.6/site-packages/mxnet/libmxnet.so(mxnet::common::ReshapeOrCreate(std::string const&, mxnet::TShape const&, int, mxnet::NDArrayStorageType, mxnet::Context const&, std::unordered_map<std::string, mxnet::NDArray, std::hashstd::string, std::equal_tostd::string, std::allocator<std::pair<std::string const, mxnet::NDArray> > >, bool)+0x3a1) [0x7f2d1a8bd9d1] [bt] (7) /home/user02/.conda/envs/audio_face/lib/python3.6/site-packages/mxnet/libmxnet.so(mxnet::exec::GraphExecutor::InitArguments(nnvm::IndexedGraph const&, std::vector<mxnet::TShape, std::allocatormxnet::TShape > const&, std::vector<int, std::allocator > const&, std::vector<int, std::allocator > const&, std::vector<mxnet::Context, std::allocatormxnet::Context > const&, std::vector<mxnet::Context, std::allocatormxnet::Context > const&, std::vector<mxnet::Context, std::allocatormxnet::Context > const&, std::vector<mxnet::OpReqType, std::allocatormxnet::OpReqType > const&, std::unordered_set<std::string, std::hashstd::string, std::equal_tostd::string, std::allocatorstd::string > const&, mxnet::Executor const, std::unordered_map<std::string, mxnet::NDArray, std::hashstd::string, std::equal_tostd::string, std::allocator<std::pair<std::string const, mxnet::NDArray> > >, std::vector<mxnet::NDArray, std::allocatormxnet::NDArray >, std::vector<mxnet::NDArray, std::allocatormxnet::NDArray >, std::vector<mxnet::NDArray, std::allocatormxnet::NDArray >)+0xb10) [0x7f2d1a8c59a0] [bt] (8) /home/user02/.conda/envs/audio_face/lib/python3.6/site-packages/mxnet/libmxnet.so(mxnet::exec::GraphExecutor::Init(nnvm::Symbol, mxnet::Context const&, std::map<std::string, mxnet::Context, std::lessstd::string, std::allocator<std::pair<std::string const, mxnet::Context> > > const&, std::vector<mxnet::Context, std::allocatormxnet::Context > const&, std::vector<mxnet::Context, std::allocatormxnet::Context > const&, std::vector<mxnet::Context, std::allocatormxnet::Context > const&, std::unordered_map<std::string, mxnet::TShape, std::hashstd::string, std::equal_tostd::string, std::allocator<std::pair<std::string const, mxnet::TShape> > > const&, std::unordered_map<std::string, int, std::hashstd::string, std::equal_tostd::string, std::allocator<std::pair<std::string const, int> > > const&, std::unordered_map<std::string, int, std::hashstd::string, std::equal_tostd::string, std::allocator<std::pair<std::string const, int> > > const&, std::vector<mxnet::OpReqType, std::allocatormxnet::OpReqType > const&, std::unordered_set<std::string, std::hashstd::string, std::equal_tostd::string, std::allocatorstd::string > const&, std::vector<mxnet::NDArray, std::allocatormxnet::NDArray >, std::vector<mxnet::NDArray, std::allocatormxnet::NDArray >, std::vector<mxnet::NDArray, std::allocatormxnet::NDArray >, std::unordered_map<std::string, mxnet::NDArray, std::hashstd::string, std::equal_tostd::string, std::allocator<std::pair<std::string const, mxnet::NDArray> > >, mxnet::Executor*, std::unordered_map<nnvm::NodeEntry, mxnet::NDArray, nnvm::NodeEntryHash, nnvm::NodeEntryEqual, std::allocator<std::pair<nnvm::NodeEntry const, mxnet::NDArray> > > const&)+0x6a9) [0x7f2d1a8d3d59]

During handling of the above exception, another exception occurred:

Traceback (most recent call last): File "test_batch.py", line 25, in model = face_model.FaceModel(args) File "/home/user02/liweijie/Audio-driven-TalkingFace-HeadPose-master/render-to-video/arcface/face_model.py", line 51, in init self.model = get_model(ctx, image_size, args.model, 'fc1') File "/home/user02/liweijie/Audio-driven-TalkingFace-HeadPose-master/render-to-video/arcface/face_model.py", line 38, in get_model model.bind(data_shapes=[('data', (1, 3, image_size[0], image_size[1]))]) File "/home/user02/.conda/envs/audio_face/lib/python3.6/site-packages/mxnet/module/module.py", line 429, in bind state_names=self._state_names) File "/home/user02/.conda/envs/audio_face/lib/python3.6/site-packages/mxnet/module/executor_group.py", line 279, in init self.bind_exec(data_shapes, label_shapes, shared_group) File "/home/user02/.conda/envs/audio_face/lib/python3.6/site-packages/mxnet/module/executor_group.py", line 375, in bind_exec shared_group)) File "/home/user02/.conda/envs/audio_face/lib/python3.6/site-packages/mxnet/module/executor_group.py", line 662, in _bind_ith_exec shared_buffer=shared_data_arrays, *input_shapes) File "/home/user02/.conda/envs/audio_face/lib/python3.6/site-packages/mxnet/symbol/symbol.py", line 1629, in simple_bind raise RuntimeError(error_msg) RuntimeError: simple_bind error. Arguments: data: (1, 3, 112, 112) [23:10:18] src/storage/storage.cc:119: Compile with USE_CUDA=1 to enable GPU usage Stack trace: [bt] (0) /home/user02/.conda/envs/audio_face/lib/python3.6/site-packages/mxnet/libmxnet.so(+0x2795cb) [0x7f2d187965cb] [bt] (1) /home/user02/.conda/envs/audio_face/lib/python3.6/site-packages/mxnet/libmxnet.so(+0x2b5d7a5) [0x7f2d1b07a7a5] [bt] (2) /home/user02/.conda/envs/audio_face/lib/python3.6/site-packages/mxnet/libmxnet.so(+0x2b617fd) [0x7f2d1b07e7fd] [bt] (3) /home/user02/.conda/envs/audio_face/lib/python3.6/site-packages/mxnet/libmxnet.so(+0x2b63f12) [0x7f2d1b080f12] [bt] (4) /home/user02/.conda/envs/audio_face/lib/python3.6/site-packages/mxnet/libmxnet.so(mxnet::NDArray::NDArray(mxnet::TShape const&, mxnet::Context, bool, int)+0x5d0) [0x7f2d1a8052b0] [bt] (5) /home/user02/.conda/envs/audio_face/lib/python3.6/site-packages/mxnet/libmxnet.so(mxnet::common::InitZeros(mxnet::NDArrayStorageType, mxnet::TShape const&, mxnet::Context const&, int)+0x5c) [0x7f2d1a8aa49c] [bt] (6) /home/user02/.conda/envs/audio_face/lib/python3.6/site-packages/mxnet/libmxnet.so(mxnet::common::ReshapeOrCreate(std::string const&, mxnet::TShape const&, int, mxnet::NDArrayStorageType, mxnet::Context const&, std::unordered_map<std::string, mxnet::NDArray, std::hashstd::string, std::equal_tostd::string, std::allocator<std::pair<std::string const, mxnet::NDArray> > >, bool)+0x3a1) [0x7f2d1a8bd9d1] [bt] (7) /home/user02/.conda/envs/audio_face/lib/python3.6/site-packages/mxnet/libmxnet.so(mxnet::exec::GraphExecutor::InitArguments(nnvm::IndexedGraph const&, std::vector<mxnet::TShape, std::allocatormxnet::TShape > const&, std::vector<int, std::allocator > const&, std::vector<int, std::allocator > const&, std::vector<mxnet::Context, std::allocatormxnet::Context > const&, std::vector<mxnet::Context, std::allocatormxnet::Context > const&, std::vector<mxnet::Context, std::allocatormxnet::Context > const&, std::vector<mxnet::OpReqType, std::allocatormxnet::OpReqType > const&, std::unordered_set<std::string, std::hashstd::string, std::equal_tostd::string, std::allocatorstd::string > const&, mxnet::Executor const, std::unordered_map<std::string, mxnet::NDArray, std::hashstd::string, std::equal_tostd::string, std::allocator<std::pair<std::string const, mxnet::NDArray> > >, std::vector<mxnet::NDArray, std::allocatormxnet::NDArray >, std::vector<mxnet::NDArray, std::allocatormxnet::NDArray >, std::vector<mxnet::NDArray, std::allocatormxnet::NDArray >)+0xb10) [0x7f2d1a8c59a0] [bt] (8) /home/user02/.conda/envs/audio_face/lib/python3.6/site-packages/mxnet/libmxnet.so(mxnet::exec::GraphExecutor::Init(nnvm::Symbol, mxnet::Context const&, std::map<std::string, mxnet::Context, std::lessstd::string, std::allocator<std::pair<std::string const, mxnet::Context> > > const&, std::vector<mxnet::Context, std::allocatormxnet::Context > const&, std::vector<mxnet::Context, std::allocatormxnet::Context > const&, std::vector<mxnet::Context, std::allocatormxnet::Context > const&, std::unordered_map<std::string, mxnet::TShape, std::hashstd::string, std::equal_tostd::string, std::allocator<std::pair<std::string const, mxnet::TShape> > > const&, std::unordered_map<std::string, int, std::hashstd::string, std::equal_tostd::string, std::allocator<std::pair<std::string const, int> > > const&, std::unordered_map<std::string, int, std::hashstd::string, std::equal_tostd::string, std::allocator<std::pair<std::string const, int> > > const&, std::vector<mxnet::OpReqType, std::allocatormxnet::OpReqType > const&, std::unordered_set<std::string, std::hashstd::string, std::equal_tostd::string, std::allocatorstd::string > const&, std::vector<mxnet::NDArray, std::allocatormxnet::NDArray >, std::vector<mxnet::NDArray, std::allocatormxnet::NDArray >, std::vector<mxnet::NDArray, std::allocatormxnet::NDArray >, std::unordered_map<std::string, mxnet::NDArray, std::hashstd::string, std::equal_tostd::string, std::allocator<std::pair<std::string const, mxnet::NDArray> > >, mxnet::Executor, std::unordered_map<nnvm::NodeEntry, mxnet::NDArray, nnvm::NodeEntryHash, nnvm::NodeEntryEqual, std::allocator<std::pair<nnvm::NodeEntry const, mxnet::NDArray> > > const&)+0x6a9) [0x7f2d1a8d3d59]

loading models/model-r100-ii/model 0 [23:10:21] src/nnvm/legacy_json_util.cc:209: Loading symbol saved by previous version v1.2.0. Attempting to upgrade... [23:10:21] src/nnvm/legacy_json_util.cc:217: Symbol successfully upgraded! Traceback (most recent call last): File "/home/user02/.conda/envs/audio_face/lib/python3.6/site-packages/mxnet/symbol/symbol.py", line 1623, in simple_bind ctypes.byref(exe_handle))) File "/home/user02/.conda/envs/audio_face/lib/python3.6/site-packages/mxnet/base.py", line 253, in check_call raise MXNetError(py_str(_LIB.MXGetLastError())) mxnet.base.MXNetError: [23:10:22] src/storage/storage.cc:119: Compile with USE_CUDA=1 to enable GPU usage Stack trace: [bt] (0) /home/user02/.conda/envs/audio_face/lib/python3.6/site-packages/mxnet/libmxnet.so(+0x2795cb) [0x7f57d9ff25cb] [bt] (1) /home/user02/.conda/envs/audio_face/lib/python3.6/site-packages/mxnet/libmxnet.so(+0x2b5d7a5) [0x7f57dc8d67a5] [bt] (2) /home/user02/.conda/envs/audio_face/lib/python3.6/site-packages/mxnet/libmxnet.so(+0x2b617fd) [0x7f57dc8da7fd] [bt] (3) /home/user02/.conda/envs/audio_face/lib/python3.6/site-packages/mxnet/libmxnet.so(+0x2b63f12) [0x7f57dc8dcf12] [bt] (4) /home/user02/.conda/envs/audio_face/lib/python3.6/site-packages/mxnet/libmxnet.so(mxnet::NDArray::NDArray(mxnet::TShape const&, mxnet::Context, bool, int)+0x5d0) [0x7f57dc0612b0] [bt] (5) /home/user02/.conda/envs/audio_face/lib/python3.6/site-packages/mxnet/libmxnet.so(mxnet::common::InitZeros(mxnet::NDArrayStorageType, mxnet::TShape const&, mxnet::Context const&, int)+0x5c) [0x7f57dc10649c] [bt] (6) /home/user02/.conda/envs/audio_face/lib/python3.6/site-packages/mxnet/libmxnet.so(mxnet::common::ReshapeOrCreate(std::string const&, mxnet::TShape const&, int, mxnet::NDArrayStorageType, mxnet::Context const&, std::unordered_map<std::string, mxnet::NDArray, std::hashstd::string, std::equal_tostd::string, std::allocator<std::pair<std::string const, mxnet::NDArray> > >, bool)+0x3a1) [0x7f57dc1199d1] [bt] (7) /home/user02/.conda/envs/audio_face/lib/python3.6/site-packages/mxnet/libmxnet.so(mxnet::exec::GraphExecutor::InitArguments(nnvm::IndexedGraph const&, std::vector<mxnet::TShape, std::allocatormxnet::TShape > const&, std::vector<int, std::allocator > const&, std::vector<int, std::allocator > const&, std::vector<mxnet::Context, std::allocatormxnet::Context > const&, std::vector<mxnet::Context, std::allocatormxnet::Context > const&, std::vector<mxnet::Context, std::allocatormxnet::Context > const&, std::vector<mxnet::OpReqType, std::allocatormxnet::OpReqType > const&, std::unordered_set<std::string, std::hashstd::string, std::equal_tostd::string, std::allocatorstd::string > const&, mxnet::Executor const, std::unordered_map<std::string, mxnet::NDArray, std::hashstd::string, std::equal_tostd::string, std::allocator<std::pair<std::string const, mxnet::NDArray> > >, std::vector<mxnet::NDArray, std::allocatormxnet::NDArray >, std::vector<mxnet::NDArray, std::allocatormxnet::NDArray >, std::vector<mxnet::NDArray, std::allocatormxnet::NDArray >)+0xb10) [0x7f57dc1219a0] [bt] (8) /home/user02/.conda/envs/audio_face/lib/python3.6/site-packages/mxnet/libmxnet.so(mxnet::exec::GraphExecutor::Init(nnvm::Symbol, mxnet::Context const&, std::map<std::string, mxnet::Context, std::lessstd::string, std::allocator<std::pair<std::string const, mxnet::Context> > > const&, std::vector<mxnet::Context, std::allocatormxnet::Context > const&, std::vector<mxnet::Context, std::allocatormxnet::Context > const&, std::vector<mxnet::Context, std::allocatormxnet::Context > const&, std::unordered_map<std::string, mxnet::TShape, std::hashstd::string, std::equal_tostd::string, std::allocator<std::pair<std::string const, mxnet::TShape> > > const&, std::unordered_map<std::string, int, std::hashstd::string, std::equal_tostd::string, std::allocator<std::pair<std::string const, int> > > const&, std::unordered_map<std::string, int, std::hashstd::string, std::equal_tostd::string, std::allocator<std::pair<std::string const, int> > > const&, std::vector<mxnet::OpReqType, std::allocatormxnet::OpReqType > const&, std::unordered_set<std::string, std::hashstd::string, std::equal_tostd::string, std::allocatorstd::string > const&, std::vector<mxnet::NDArray, std::allocatormxnet::NDArray >, std::vector<mxnet::NDArray, std::allocatormxnet::NDArray >, std::vector<mxnet::NDArray, std::allocatormxnet::NDArray >, std::unordered_map<std::string, mxnet::NDArray, std::hashstd::string, std::equal_tostd::string, std::allocator<std::pair<std::string const, mxnet::NDArray> > >, mxnet::Executor*, std::unordered_map<nnvm::NodeEntry, mxnet::NDArray, nnvm::NodeEntryHash, nnvm::NodeEntryEqual, std::allocator<std::pair<nnvm::NodeEntry const, mxnet::NDArray> > > const&)+0x6a9) [0x7f57dc12fd59]

During handling of the above exception, another exception occurred:

Traceback (most recent call last): File "test_batch.py", line 25, in model = face_model.FaceModel(args) File "/home/user02/liweijie/Audio-driven-TalkingFace-HeadPose-master/render-to-video/arcface/face_model.py", line 51, in init self.model = get_model(ctx, image_size, args.model, 'fc1') File "/home/user02/liweijie/Audio-driven-TalkingFace-HeadPose-master/render-to-video/arcface/face_model.py", line 38, in get_model model.bind(data_shapes=[('data', (1, 3, image_size[0], image_size[1]))]) File "/home/user02/.conda/envs/audio_face/lib/python3.6/site-packages/mxnet/module/module.py", line 429, in bind state_names=self._state_names) File "/home/user02/.conda/envs/audio_face/lib/python3.6/site-packages/mxnet/module/executor_group.py", line 279, in init self.bind_exec(data_shapes, label_shapes, shared_group) File "/home/user02/.conda/envs/audio_face/lib/python3.6/site-packages/mxnet/module/executor_group.py", line 375, in bind_exec shared_group)) File "/home/user02/.conda/envs/audio_face/lib/python3.6/site-packages/mxnet/module/executor_group.py", line 662, in _bind_ith_exec shared_buffer=shared_data_arrays, *input_shapes) File "/home/user02/.conda/envs/audio_face/lib/python3.6/site-packages/mxnet/symbol/symbol.py", line 1629, in simple_bind raise RuntimeError(error_msg) RuntimeError: simple_bind error. Arguments: data: (1, 3, 112, 112) [23:10:22] src/storage/storage.cc:119: Compile with USE_CUDA=1 to enable GPU usage Stack trace: [bt] (0) /home/user02/.conda/envs/audio_face/lib/python3.6/site-packages/mxnet/libmxnet.so(+0x2795cb) [0x7f57d9ff25cb] [bt] (1) /home/user02/.conda/envs/audio_face/lib/python3.6/site-packages/mxnet/libmxnet.so(+0x2b5d7a5) [0x7f57dc8d67a5] [bt] (2) /home/user02/.conda/envs/audio_face/lib/python3.6/site-packages/mxnet/libmxnet.so(+0x2b617fd) [0x7f57dc8da7fd] [bt] (3) /home/user02/.conda/envs/audio_face/lib/python3.6/site-packages/mxnet/libmxnet.so(+0x2b63f12) [0x7f57dc8dcf12] [bt] (4) /home/user02/.conda/envs/audio_face/lib/python3.6/site-packages/mxnet/libmxnet.so(mxnet::NDArray::NDArray(mxnet::TShape const&, mxnet::Context, bool, int)+0x5d0) [0x7f57dc0612b0] [bt] (5) /home/user02/.conda/envs/audio_face/lib/python3.6/site-packages/mxnet/libmxnet.so(mxnet::common::InitZeros(mxnet::NDArrayStorageType, mxnet::TShape const&, mxnet::Context const&, int)+0x5c) [0x7f57dc10649c] [bt] (6) /home/user02/.conda/envs/audio_face/lib/python3.6/site-packages/mxnet/libmxnet.so(mxnet::common::ReshapeOrCreate(std::string const&, mxnet::TShape const&, int, mxnet::NDArrayStorageType, mxnet::Context const&, std::unordered_map<std::string, mxnet::NDArray, std::hashstd::string, std::equal_tostd::string, std::allocator<std::pair<std::string const, mxnet::NDArray> > >, bool)+0x3a1) [0x7f57dc1199d1] [bt] (7) /home/user02/.conda/envs/audio_face/lib/python3.6/site-packages/mxnet/libmxnet.so(mxnet::exec::GraphExecutor::InitArguments(nnvm::IndexedGraph const&, std::vector<mxnet::TShape, std::allocatormxnet::TShape > const&, std::vector<int, std::allocator > const&, std::vector<int, std::allocator > const&, std::vector<mxnet::Context, std::allocatormxnet::Context > const&, std::vector<mxnet::Context, std::allocatormxnet::Context > const&, std::vector<mxnet::Context, std::allocatormxnet::Context > const&, std::vector<mxnet::OpReqType, std::allocatormxnet::OpReqType > const&, std::unordered_set<std::string, std::hashstd::string, std::equal_tostd::string, std::allocatorstd::string > const&, mxnet::Executor const, std::unordered_map<std::string, mxnet::NDArray, std::hashstd::string, std::equal_tostd::string, std::allocator<std::pair<std::string const, mxnet::NDArray> > >, std::vector<mxnet::NDArray, std::allocatormxnet::NDArray >, std::vector<mxnet::NDArray, std::allocatormxnet::NDArray >, std::vector<mxnet::NDArray, std::allocatormxnet::NDArray >)+0xb10) [0x7f57dc1219a0] [bt] (8) /home/user02/.conda/envs/audio_face/lib/python3.6/site-packages/mxnet/libmxnet.so(mxnet::exec::GraphExecutor::Init(nnvm::Symbol, mxnet::Context const&, std::map<std::string, mxnet::Context, std::lessstd::string, std::allocator<std::pair<std::string const, mxnet::Context> > > const&, std::vector<mxnet::Context, std::allocatormxnet::Context > const&, std::vector<mxnet::Context, std::allocatormxnet::Context > const&, std::vector<mxnet::Context, std::allocatormxnet::Context > const&, std::unordered_map<std::string, mxnet::TShape, std::hashstd::string, std::equal_tostd::string, std::allocator<std::pair<std::string const, mxnet::TShape> > > const&, std::unordered_map<std::string, int, std::hashstd::string, std::equal_tostd::string, std::allocator<std::pair<std::string const, int> > > const&, std::unordered_map<std::string, int, std::hashstd::string, std::equal_tostd::string, std::allocator<std::pair<std::string const, int> > > const&, std::vector<mxnet::OpReqType, std::allocatormxnet::OpReqType > const&, std::unordered_set<std::string, std::hashstd::string, std::equal_tostd::string, std::allocatorstd::string > const&, std::vector<mxnet::NDArray, std::allocatormxnet::NDArray >, std::vector<mxnet::NDArray, std::allocatormxnet::NDArray >, std::vector<mxnet::NDArray, std::allocatormxnet::NDArray >, std::unordered_map<std::string, mxnet::NDArray, std::hashstd::string, std::equal_tostd::string, std::allocator<std::pair<std::string const, mxnet::NDArray> > >, mxnet::Executor, std::unordered_map<nnvm::NodeEntry, mxnet::NDArray, nnvm::NodeEntryHash, nnvm::NodeEntryEqual, std::allocator<std::pair<nnvm::NodeEntry const, mxnet::NDArray> > > const&)+0x6a9) [0x7f57dc12fd59]

----------------- Options --------------- Nw: 3 alpha: 0.3 attention: 1 batch_size: 1 beta1: 0.5 checkpoints_dir: ./checkpoints continue_train: True [default: False] crop_size: 256 dataroot: 31_bmold_win3 [default: None] dataset_mode: aligned_feature_multi direction: AtoB display_env: memory_seq_31 [default: main] display_freq: 400 display_id: 0 display_ncols: 4 display_port: 8097 display_server: http://localhost http://localhost/ display_winsize: 256 do_saturate_mask: False epoch: 0 [default: latest] epoch_count: 1 gan_mode: vanilla gpu_ids: 1 [default: 0] iden_feat_dim: 512 iden_feat_dir: arcface/iden_feat/ iden_thres: 0.98 init_gain: 0.02 init_type: normal input_nc: 3 isTrain: True [default: None] lambda_L1: 100.0 lambda_mask: 2.0 [default: 0.1] lambda_mask_smooth: 1e-05 load_iter: 0 [default: 0] load_size: 286 lr: 0.0001 [default: 0.0002] lr_decay_iters: 50 lr_policy: linear max_dataset_size: inf mem_size: 30000 model: memory_seq [default: cycle_gan] n_layers_D: 3 name: memory_seq_p2p/31 [default: experiment_name] ndf: 64 netD: basic netG: unetac_adain_256 ngf: 64 niter: 60 [default: 100] niter_decay: 0 [default: 100] no_dropout: False no_flip: False no_html: False norm: batch num_threads: 4 output_nc: 3 phase: train pool_size: 0 preprocess: resize_and_crop print_freq: 100 resizemethod: lanczos save_by_iter: False save_epoch_freq: 5 save_latest_freq: 5000 serial_batches: False spatial_feat_dim: 512 suffix: top_k: 256 update_html_freq: 1000 verbose: False ----------------- End ------------------- dataset [AlignedFeatureMultiDataset] was created The number of training images = 298 initialize network with normal initialize network with normal model [MemorySeqModel] was created loading the model from ./checkpoints/memory_seq_p2p/0_net_G.pth loading the model from ./checkpoints/memory_seq_p2p/0_net_D.pth loading the model from ./checkpoints/memory_seq_p2p/0_net_mem.pth ---------- Networks initialized ------------- [Network G] Total number of parameters : 259.056 M [Network D] Total number of parameters : 2.775 M [Network mem] Total number of parameters : 11.952 M

create web directory ./checkpoints/memory_seq_p2p/31/web... Traceback (most recent call last): File "train.py", line 45, in for i, data in enumerate(dataset): # inner loop within one epoch File "/home/user02/liweijie/Audio-driven-TalkingFace-HeadPose-master/render-to-video/data/init.py", line 90, in iter for i, data in enumerate(self.dataloader): File "/home/user02/.conda/envs/audio_face/lib/python3.6/site-packages/torch/utils/data/dataloader.py", line 819, in next return self._process_data(data) File "/home/user02/.conda/envs/audio_face/lib/python3.6/site-packages/torch/utils/data/dataloader.py", line 846, in _process_data data.reraise() File "/home/user02/.conda/envs/audio_face/lib/python3.6/site-packages/torch/_utils.py", line 369, in reraise raise self.exc_type(msg) FileNotFoundError: Caught FileNotFoundError in DataLoader worker process 0. Original Traceback (most recent call last): File "/home/user02/.conda/envs/audio_face/lib/python3.6/site-packages/torch/utils/data/_utils/worker.py", line 178, in _worker_loop data = fetcher.fetch(index) File "/home/user02/.conda/envs/audio_face/lib/python3.6/site-packages/torch/utils/data/_utils/fetch.py", line 44, in fetch data = [self.dataset[idx] for idx in possibly_batched_index] File "/home/user02/.conda/envs/audio_face/lib/python3.6/site-packages/torch/utils/data/_utils/fetch.py", line 44, in data = [self.dataset[idx] for idx in possibly_batched_index] File "/home/user02/liweijie/Audio-driven-TalkingFace-HeadPose-master/render-to-video/data/aligned_feature_multi_dataset.py", line 94, in getitem B_feat = np.load(os.path.join(self.opt.iden_feat_dir,ss[-3],ss[-2],ss[-1][:-4]+'.npy')) File "/home/user02/.conda/envs/audio_face/lib/python3.6/site-packages/numpy/lib/npyio.py", line 422, in load fid = open(os_fspath(file), "rb") FileNotFoundError: [Errno 2] No such file or directory: 'arcface/iden_feat/19_news/31/frame249.npy'

----------------- Options --------------- Nw: 3 alpha: 0.3 aspect_ratio: 1.0 attention: 1 batch_size: 1 blinkframeid: 41 checkpoints_dir: ./checkpoints crop_size: 256 dataroot: 31_bmold_win3 [default: None] dataset_mode: aligned_feature_multi direction: AtoB display_winsize: 256 do_saturate_mask: False epoch: 60 [default: latest] eval: False gpu_ids: 1 [default: 0] iden_feat_dim: 512 iden_feat_dir: arcface/iden_feat/ iden_thres: 0.98 imagefolder: images60 [default: images] init_gain: 0.02 init_type: normal input_nc: 3 isTrain: False [default: None] load_iter: 0 [default: 0] load_size: 256 max_dataset_size: inf mem_size: 30000 model: memory_seq [default: test] n: 26 n_layers_D: 3 name: memory_seq_p2p/31 [default: experiment_name] ndf: 64 netD: basic netG: unetac_adain_256 ngf: 64 no_dropout: False no_flip: False norm: batch ntest: inf num_test: 200 [default: 50] num_threads: 4 output_nc: 3 phase: test preprocess: resize_and_crop resizemethod: lanczos results_dir: ./results/ serial_batches: False spatial_feat_dim: 512 suffix: test_batch_list: test_use_gt: 0 top_k: 256 verbose: False ----------------- End ------------------- dataset [AlignedFeatureMultiDataset] was created initialize network with normal model [MemorySeqModel] was created loading the model from ./checkpoints/memory_seq_p2p/60_net_G.pth Traceback (most recent call last): File "test.py", line 47, in model.setup(opt) # regular setup: load and print networks; create schedulers File "/home/user02/liweijie/Audio-driven-TalkingFace-HeadPose-master/render-to-video/models/base_model.py", line 89, in setup self.load_networks(load_suffix) File "/home/user02/liweijie/Audio-driven-TalkingFace-HeadPose-master/render-to-video/models/base_model.py", line 202, in load_networks state_dict = torch.load(load_path, map_location=str(self.device)) File "/home/user02/.conda/envs/audio_face/lib/python3.6/site-packages/torch/serialization.py", line 381, in load f = open(f, 'rb') FileNotFoundError: [Errno 2] No such file or directory: './checkpoints/memory_seq_p2p/60_net_G.pth' (audio_face) user02@lthpc:~/liweijie/Audio-driven-TalkingFace-HeadPose-master/render-to-video$

The above is the display content of the fifth step.

— You are receiving this because you commented. Reply to this email directly, view it on GitHub https://github.com/yiranran/Audio-driven-TalkingFace-HeadPose/issues/27#issuecomment-750709307, or unsubscribe https://github.com/notifications/unsubscribe-auth/AD76RAAQXRJQMFOCMWHUTVLSWKRJTANCNFSM4PUIISTA.

Kenny-Li2023 commented 3 years ago

Error occurs in preparing arcface feature, i.e. line 66 in train_19news_1.py during running this command "python test_batch.py --imglist trainB/31_bmold_win3.txt --gpu 1" Please check these output error infos: "loading models/model-r100-ii/model 0 [23:10:18] src/nnvm/legacy_json_util.cc:209 http://legacy_json_util.cc:209/: Loading symbol saved by previous version v1.2.0. Attempting to upgrade... [23:10:18] src/nnvm/legacy_json_util.cc:217 http://legacy_json_util.cc:217/: Symbol successfully upgraded! Traceback (most recent call last): File "/home/user02/.conda/envs/audio_face/lib/python3.6/site-packages/mxnet/symbol/symbol.py", line 1623, in simple_bind ctypes.byref(exe_handle))) File "/home/user02/.conda/envs/audio_face/lib/python3.6/site-packages/mxnet/base.py", line 253, in check_call raise MXNetError(py_str(_LIB.MXGetLastError())) mxnet.base.MXNetError: [23:10:18] src/storage/storage.cc:119 http://storage.cc:119/: Compile with USE_CUDA=1 to enable GPU usage” It seems the installed mxnet package was not correctly installed. https://stackoverflow.com/questions/46937610/compile-with-use-cuda-1-to-enable-gpu-usage-message-with-mxnet-on-aws-deep-lea https://stackoverflow.com/questions/46937610/compile-with-use-cuda-1-to-enable-gpu-usage-message-with-mxnet-on-aws-deep-lea Have you pip installed mxnet-cu80? 在 2020年12月24日,上午10:27,weijie li @.> 写道: there should be some errors during gan fine-tuning step that cause the fail of outputting this pth file. could you provide more error information during running the gam fine-tuning step... … <x-msg://3/#> 在 2020年12月23日,下午10:53,weijie li @.> 写道:  未安装matlab。或者,您可以检查colab示例,它用八 I have installed matlab and the link is successful, but it still shows that the folder is not found. What should I do? — You are receiving this because you commented. Reply to this email directly, view it on GitHub, or unsubscribe. (audio_face) @.:~/liweijie/Audio-driven-TalkingFace-HeadPose-master/render-to-video$ python train_19news_1.py 31 1 19_news/31 31_bmold_win3 < M A T L A B (R) > Copyright 1984-2017 The MathWorks, Inc. R2017b (9.3.0.713579) 64-bit (glnxa64) September 14, 2017 For online documentation, see http://www.mathworks.com/support http://www.mathworks.com/support For product information, visit www.mathworks.com http://www.mathworks.com/. Elapsed time is 20.569316 seconds. loading models/model-r100-ii/model 0 [23:10:18] src/nnvm/legacy_json_util.cc:209: Loading symbol saved by previous version v1.2.0. Attempting to upgrade... [23:10:18] src/nnvm/legacy_json_util.cc:217: Symbol successfully upgraded! Traceback (most recent call last): File "/home/user02/.conda/envs/audio_face/lib/python3.6/site-packages/mxnet/symbol/symbol.py", line 1623, in simple_bind ctypes.byref(exe_handle))) File "/home/user02/.conda/envs/audio_face/lib/python3.6/site-packages/mxnet/base.py", line 253, in check_call raise MXNetError(py_str(_LIB.MXGetLastError())) mxnet.base.MXNetError: [23:10:18] src/storage/storage.cc:119: Compile with USE_CUDA=1 to enable GPU usage Stack trace: [bt] (0) /home/user02/.conda/envs/audio_face/lib/python3.6/site-packages/mxnet/libmxnet.so(+0x2795cb) [0x7f2d187965cb] [bt] (1) /home/user02/.conda/envs/audio_face/lib/python3.6/site-packages/mxnet/libmxnet.so(+0x2b5d7a5) [0x7f2d1b07a7a5] [bt] (2) /home/user02/.conda/envs/audio_face/lib/python3.6/site-packages/mxnet/libmxnet.so(+0x2b617fd) [0x7f2d1b07e7fd] [bt] (3) /home/user02/.conda/envs/audio_face/lib/python3.6/site-packages/mxnet/libmxnet.so(+0x2b63f12) [0x7f2d1b080f12] [bt] (4) /home/user02/.conda/envs/audio_face/lib/python3.6/site-packages/mxnet/libmxnet.so(mxnet::NDArray::NDArray(mxnet::TShape const&, mxnet::Context, bool, int)+0x5d0) [0x7f2d1a8052b0] [bt] (5) /home/user02/.conda/envs/audio_face/lib/python3.6/site-packages/mxnet/libmxnet.so(mxnet::common::InitZeros(mxnet::NDArrayStorageType, mxnet::TShape const&, mxnet::Context const&, int)+0x5c) [0x7f2d1a8aa49c] [bt] (6) /home/user02/.conda/envs/audio_face/lib/python3.6/site-packages/mxnet/libmxnet.so(mxnet::common::ReshapeOrCreate(std::string const&, mxnet::TShape const&, int, mxnet::NDArrayStorageType, mxnet::Context const&, std::unordered_map<std::string, mxnet::NDArray, std::hashstd::string, std::equal_tostd::string, std::allocator<std::pair<std::string const, mxnet::NDArray> > >, bool)+0x3a1) [0x7f2d1a8bd9d1] [bt] (7) /home/user02/.conda/envs/audio_face/lib/python3.6/site-packages/mxnet/libmxnet.so(mxnet::exec::GraphExecutor::InitArguments(nnvm::IndexedGraph const&, std::vector<mxnet::TShape, std::allocatormxnet::TShape > const&, std::vector<int, std::allocator > const&, std::vector<int, std::allocator > const&, std::vector<mxnet::Context, std::allocatormxnet::Context > const&, std::vector<mxnet::Context, std::allocatormxnet::Context > const&, std::vector<mxnet::Context, std::allocatormxnet::Context > const&, std::vector<mxnet::OpReqType, std::allocatormxnet::OpReqType > const&, std::unordered_set<std::string, std::hashstd::string, std::equal_tostd::string, std::allocatorstd::string > const&, mxnet::Executor const, std::unordered_map<std::string, mxnet::NDArray, std::hashstd::string, std::equal_tostd::string, std::allocator<std::pair<std::string const, mxnet::NDArray> > >, std::vector<mxnet::NDArray, std::allocatormxnet::NDArray >, std::vector<mxnet::NDArray, std::allocatormxnet::NDArray >, std::vector<mxnet::NDArray, std::allocatormxnet::NDArray >)+0xb10) [0x7f2d1a8c59a0] [bt] (8) /home/user02/.conda/envs/audio_face/lib/python3.6/site-packages/mxnet/libmxnet.so(mxnet::exec::GraphExecutor::Init(nnvm::Symbol, mxnet::Context const&, std::map<std::string, mxnet::Context, std::lessstd::string, std::allocator<std::pair<std::string const, mxnet::Context> > > const&, std::vector<mxnet::Context, std::allocatormxnet::Context > const&, std::vector<mxnet::Context, std::allocatormxnet::Context > const&, std::vector<mxnet::Context, std::allocatormxnet::Context > const&, std::unordered_map<std::string, mxnet::TShape, std::hashstd::string, std::equal_tostd::string, std::allocator<std::pair<std::string const, mxnet::TShape> > > const&, std::unordered_map<std::string, int, std::hashstd::string, std::equal_tostd::string, std::allocator<std::pair<std::string const, int> > > const&, std::unordered_map<std::string, int, std::hashstd::string, std::equal_tostd::string, std::allocator<std::pair<std::string const, int> > > const&, std::vector<mxnet::OpReqType, std::allocatormxnet::OpReqType > const&, std::unordered_set<std::string, std::hashstd::string, std::equal_tostd::string, std::allocatorstd::string > const&, std::vector<mxnet::NDArray, std::allocatormxnet::NDArray >, std::vector<mxnet::NDArray, std::allocatormxnet::NDArray >, std::vector<mxnet::NDArray, std::allocatormxnet::NDArray >, std::unordered_map<std::string, mxnet::NDArray, std::hashstd::string, std::equal_tostd::string, std::allocator<std::pair<std::string const, mxnet::NDArray> > >, mxnet::Executor, std::unordered_map<nnvm::NodeEntry, mxnet::NDArray, nnvm::NodeEntryHash, nnvm::NodeEntryEqual, std::allocator<std::pair<nnvm::NodeEntry const, mxnet::NDArray> > > const&)+0x6a9) [0x7f2d1a8d3d59] During handling of the above exception, another exception occurred: Traceback (most recent call last): File "test_batch.py", line 25, in model = face_model.FaceModel(args) File "/home/user02/liweijie/Audio-driven-TalkingFace-HeadPose-master/render-to-video/arcface/face_model.py", line 51, in init self.model = get_model(ctx, image_size, args.model, 'fc1') File "/home/user02/liweijie/Audio-driven-TalkingFace-HeadPose-master/render-to-video/arcface/face_model.py", line 38, in get_model model.bind(data_shapes=[('data', (1, 3, image_size[0], image_size[1]))]) File "/home/user02/.conda/envs/audio_face/lib/python3.6/site-packages/mxnet/module/module.py", line 429, in bind state_names=self._state_names) File "/home/user02/.conda/envs/audio_face/lib/python3.6/site-packages/mxnet/module/executor_group.py", line 279, in init self.bind_exec(data_shapes, label_shapes, shared_group) File "/home/user02/.conda/envs/audio_face/lib/python3.6/site-packages/mxnet/module/executor_group.py", line 375, in bind_exec shared_group)) File "/home/user02/.conda/envs/audio_face/lib/python3.6/site-packages/mxnet/module/executor_group.py", line 662, in _bind_ith_exec shared_buffer=shared_data_arrays, input_shapes) File "/home/user02/.conda/envs/audio_face/lib/python3.6/site-packages/mxnet/symbol/symbol.py", line 1629, in simple_bind raise RuntimeError(error_msg) RuntimeError: simple_bind error. Arguments: data: (1, 3, 112, 112) [23:10:18] src/storage/storage.cc:119: Compile with USE_CUDA=1 to enable GPU usage Stack trace: [bt] (0) /home/user02/.conda/envs/audio_face/lib/python3.6/site-packages/mxnet/libmxnet.so(+0x2795cb) [0x7f2d187965cb] [bt] (1) /home/user02/.conda/envs/audio_face/lib/python3.6/site-packages/mxnet/libmxnet.so(+0x2b5d7a5) [0x7f2d1b07a7a5] [bt] (2) /home/user02/.conda/envs/audio_face/lib/python3.6/site-packages/mxnet/libmxnet.so(+0x2b617fd) [0x7f2d1b07e7fd] [bt] (3) /home/user02/.conda/envs/audio_face/lib/python3.6/site-packages/mxnet/libmxnet.so(+0x2b63f12) [0x7f2d1b080f12] [bt] (4) /home/user02/.conda/envs/audio_face/lib/python3.6/site-packages/mxnet/libmxnet.so(mxnet::NDArray::NDArray(mxnet::TShape const&, mxnet::Context, bool, int)+0x5d0) [0x7f2d1a8052b0] [bt] (5) /home/user02/.conda/envs/audio_face/lib/python3.6/site-packages/mxnet/libmxnet.so(mxnet::common::InitZeros(mxnet::NDArrayStorageType, mxnet::TShape const&, mxnet::Context const&, int)+0x5c) [0x7f2d1a8aa49c] [bt] (6) /home/user02/.conda/envs/audio_face/lib/python3.6/site-packages/mxnet/libmxnet.so(mxnet::common::ReshapeOrCreate(std::string const&, mxnet::TShape const&, int, mxnet::NDArrayStorageType, mxnet::Context const&, std::unordered_map<std::string, mxnet::NDArray, std::hashstd::string, std::equal_tostd::string, std::allocator<std::pair<std::string const, mxnet::NDArray> > >, bool)+0x3a1) [0x7f2d1a8bd9d1] [bt] (7) /home/user02/.conda/envs/audio_face/lib/python3.6/site-packages/mxnet/libmxnet.so(mxnet::exec::GraphExecutor::InitArguments(nnvm::IndexedGraph const&, std::vector<mxnet::TShape, std::allocatormxnet::TShape > const&, std::vector<int, std::allocator > const&, std::vector<int, std::allocator > const&, std::vector<mxnet::Context, std::allocatormxnet::Context > const&, std::vector<mxnet::Context, std::allocatormxnet::Context > const&, std::vector<mxnet::Context, std::allocatormxnet::Context > const&, std::vector<mxnet::OpReqType, std::allocatormxnet::OpReqType > const&, std::unordered_set<std::string, std::hashstd::string, std::equal_tostd::string, std::allocatorstd::string > const&, mxnet::Executor const, std::unordered_map<std::string, mxnet::NDArray, std::hashstd::string, std::equal_tostd::string, std::allocator<std::pair<std::string const, mxnet::NDArray> > >, std::vector<mxnet::NDArray, std::allocatormxnet::NDArray >, std::vector<mxnet::NDArray, std::allocatormxnet::NDArray >, std::vector<mxnet::NDArray, std::allocatormxnet::NDArray >)+0xb10) [0x7f2d1a8c59a0] [bt] (8) /home/user02/.conda/envs/audio_face/lib/python3.6/site-packages/mxnet/libmxnet.so(mxnet::exec::GraphExecutor::Init(nnvm::Symbol, mxnet::Context const&, std::map<std::string, mxnet::Context, std::lessstd::string, std::allocator<std::pair<std::string const, mxnet::Context> > > const&, std::vector<mxnet::Context, std::allocatormxnet::Context > const&, std::vector<mxnet::Context, std::allocatormxnet::Context > const&, std::vector<mxnet::Context, std::allocatormxnet::Context > const&, std::unordered_map<std::string, mxnet::TShape, std::hashstd::string, std::equal_tostd::string, std::allocator<std::pair<std::string const, mxnet::TShape> > > const&, std::unordered_map<std::string, int, std::hashstd::string, std::equal_tostd::string, std::allocator<std::pair<std::string const, int> > > const&, std::unordered_map<std::string, int, std::hashstd::string, std::equal_tostd::string, std::allocator<std::pair<std::string const, int> > > const&, std::vector<mxnet::OpReqType, std::allocatormxnet::OpReqType > const&, std::unordered_set<std::string, std::hashstd::string, std::equal_tostd::string, std::allocatorstd::string > const&, std::vector<mxnet::NDArray, std::allocatormxnet::NDArray >, std::vector<mxnet::NDArray, std::allocatormxnet::NDArray >, std::vector<mxnet::NDArray, std::allocatormxnet::NDArray >, std::unordered_map<std::string, mxnet::NDArray, std::hashstd::string, std::equal_tostd::string, std::allocator<std::pair<std::string const, mxnet::NDArray> > >, mxnet::Executor, std::unordered_map<nnvm::NodeEntry, mxnet::NDArray, nnvm::NodeEntryHash, nnvm::NodeEntryEqual, std::allocator<std::pair<nnvm::NodeEntry const, mxnet::NDArray> > > const&)+0x6a9) [0x7f2d1a8d3d59] loading models/model-r100-ii/model 0 [23:10:21] src/nnvm/legacy_json_util.cc:209: Loading symbol saved by previous version v1.2.0. Attempting to upgrade... [23:10:21] src/nnvm/legacy_json_util.cc:217: Symbol successfully upgraded! Traceback (most recent call last): File "/home/user02/.conda/envs/audio_face/lib/python3.6/site-packages/mxnet/symbol/symbol.py", line 1623, in simple_bind ctypes.byref(exe_handle))) File "/home/user02/.conda/envs/audio_face/lib/python3.6/site-packages/mxnet/base.py", line 253, in check_call raise MXNetError(py_str(_LIB.MXGetLastError())) mxnet.base.MXNetError: [23:10:22] src/storage/storage.cc:119: Compile with USE_CUDA=1 to enable GPU usage Stack trace: [bt] (0) /home/user02/.conda/envs/audio_face/lib/python3.6/site-packages/mxnet/libmxnet.so(+0x2795cb) [0x7f57d9ff25cb] [bt] (1) /home/user02/.conda/envs/audio_face/lib/python3.6/site-packages/mxnet/libmxnet.so(+0x2b5d7a5) [0x7f57dc8d67a5] [bt] (2) /home/user02/.conda/envs/audio_face/lib/python3.6/site-packages/mxnet/libmxnet.so(+0x2b617fd) [0x7f57dc8da7fd] [bt] (3) /home/user02/.conda/envs/audio_face/lib/python3.6/site-packages/mxnet/libmxnet.so(+0x2b63f12) [0x7f57dc8dcf12] [bt] (4) /home/user02/.conda/envs/audio_face/lib/python3.6/site-packages/mxnet/libmxnet.so(mxnet::NDArray::NDArray(mxnet::TShape const&, mxnet::Context, bool, int)+0x5d0) [0x7f57dc0612b0] [bt] (5) /home/user02/.conda/envs/audio_face/lib/python3.6/site-packages/mxnet/libmxnet.so(mxnet::common::InitZeros(mxnet::NDArrayStorageType, mxnet::TShape const&, mxnet::Context const&, int)+0x5c) [0x7f57dc10649c] [bt] (6) /home/user02/.conda/envs/audio_face/lib/python3.6/site-packages/mxnet/libmxnet.so(mxnet::common::ReshapeOrCreate(std::string const&, mxnet::TShape const&, int, mxnet::NDArrayStorageType, mxnet::Context const&, std::unordered_map<std::string, mxnet::NDArray, std::hashstd::string, std::equal_tostd::string, std::allocator<std::pair<std::string const, mxnet::NDArray> > >, bool)+0x3a1) [0x7f57dc1199d1] [bt] (7) /home/user02/.conda/envs/audio_face/lib/python3.6/site-packages/mxnet/libmxnet.so(mxnet::exec::GraphExecutor::InitArguments(nnvm::IndexedGraph const&, std::vector<mxnet::TShape, std::allocatormxnet::TShape > const&, std::vector<int, std::allocator > const&, std::vector<int, std::allocator > const&, std::vector<mxnet::Context, std::allocatormxnet::Context > const&, std::vector<mxnet::Context, std::allocatormxnet::Context > const&, std::vector<mxnet::Context, std::allocatormxnet::Context > const&, std::vector<mxnet::OpReqType, std::allocatormxnet::OpReqType > const&, std::unordered_set<std::string, std::hashstd::string, std::equal_tostd::string, std::allocatorstd::string > const&, mxnet::Executor const, std::unordered_map<std::string, mxnet::NDArray, std::hashstd::string, std::equal_tostd::string, std::allocator<std::pair<std::string const, mxnet::NDArray> > >, std::vector<mxnet::NDArray, std::allocatormxnet::NDArray >, std::vector<mxnet::NDArray, std::allocatormxnet::NDArray >, std::vector<mxnet::NDArray, std::allocatormxnet::NDArray >)+0xb10) [0x7f57dc1219a0] [bt] (8) /home/user02/.conda/envs/audio_face/lib/python3.6/site-packages/mxnet/libmxnet.so(mxnet::exec::GraphExecutor::Init(nnvm::Symbol, mxnet::Context const&, std::map<std::string, mxnet::Context, std::lessstd::string, std::allocator<std::pair<std::string const, mxnet::Context> > > const&, std::vector<mxnet::Context, std::allocatormxnet::Context > const&, std::vector<mxnet::Context, std::allocatormxnet::Context > const&, std::vector<mxnet::Context, std::allocatormxnet::Context > const&, std::unordered_map<std::string, mxnet::TShape, std::hashstd::string, std::equal_tostd::string, std::allocator<std::pair<std::string const, mxnet::TShape> > > const&, std::unordered_map<std::string, int, std::hashstd::string, std::equal_tostd::string, std::allocator<std::pair<std::string const, int> > > const&, std::unordered_map<std::string, int, std::hashstd::string, std::equal_tostd::string, std::allocator<std::pair<std::string const, int> > > const&, std::vector<mxnet::OpReqType, std::allocatormxnet::OpReqType > const&, std::unordered_set<std::string, std::hashstd::string, std::equal_tostd::string, std::allocatorstd::string > const&, std::vector<mxnet::NDArray, std::allocatormxnet::NDArray >, std::vector<mxnet::NDArray, std::allocatormxnet::NDArray >, std::vector<mxnet::NDArray, std::allocatormxnet::NDArray >, std::unordered_map<std::string, mxnet::NDArray, std::hashstd::string, std::equal_tostd::string, std::allocator<std::pair<std::string const, mxnet::NDArray> > >, mxnet::Executor, std::unordered_map<nnvm::NodeEntry, mxnet::NDArray, nnvm::NodeEntryHash, nnvm::NodeEntryEqual, std::allocator<std::pair<nnvm::NodeEntry const, mxnet::NDArray> > > const&)+0x6a9) [0x7f57dc12fd59] During handling of the above exception, another exception occurred: Traceback (most recent call last): File "test_batch.py", line 25, in model = face_model.FaceModel(args) File "/home/user02/liweijie/Audio-driven-TalkingFace-HeadPose-master/render-to-video/arcface/face_model.py", line 51, in init self.model = get_model(ctx, image_size, args.model, 'fc1') File "/home/user02/liweijie/Audio-driven-TalkingFace-HeadPose-master/render-to-video/arcface/face_model.py", line 38, in get_model model.bind(data_shapes=[('data', (1, 3, image_size[0], image_size[1]))]) File "/home/user02/.conda/envs/audio_face/lib/python3.6/site-packages/mxnet/module/module.py", line 429, in bind state_names=self._state_names) File "/home/user02/.conda/envs/audio_face/lib/python3.6/site-packages/mxnet/module/executor_group.py", line 279, in init self.bind_exec(data_shapes, label_shapes, shared_group) File "/home/user02/.conda/envs/audio_face/lib/python3.6/site-packages/mxnet/module/executor_group.py", line 375, in bind_exec shared_group)) File "/home/user02/.conda/envs/audio_face/lib/python3.6/site-packages/mxnet/module/executor_group.py", line 662, in _bind_ith_exec shared_buffer=shared_data_arrays, input_shapes) File "/home/user02/.conda/envs/audio_face/lib/python3.6/site-packages/mxnet/symbol/symbol.py", line 1629, in simple_bind raise RuntimeError(error_msg) RuntimeError: simple_bind error. Arguments: data: (1, 3, 112, 112) [23:10:22] src/storage/storage.cc:119: Compile with USE_CUDA=1 to enable GPU usage Stack trace: [bt] (0) /home/user02/.conda/envs/audio_face/lib/python3.6/site-packages/mxnet/libmxnet.so(+0x2795cb) [0x7f57d9ff25cb] [bt] (1) /home/user02/.conda/envs/audio_face/lib/python3.6/site-packages/mxnet/libmxnet.so(+0x2b5d7a5) [0x7f57dc8d67a5] [bt] (2) /home/user02/.conda/envs/audio_face/lib/python3.6/site-packages/mxnet/libmxnet.so(+0x2b617fd) [0x7f57dc8da7fd] [bt] (3) /home/user02/.conda/envs/audio_face/lib/python3.6/site-packages/mxnet/libmxnet.so(+0x2b63f12) [0x7f57dc8dcf12] [bt] (4) /home/user02/.conda/envs/audio_face/lib/python3.6/site-packages/mxnet/libmxnet.so(mxnet::NDArray::NDArray(mxnet::TShape const&, mxnet::Context, bool, int)+0x5d0) [0x7f57dc0612b0] [bt] (5) /home/user02/.conda/envs/audio_face/lib/python3.6/site-packages/mxnet/libmxnet.so(mxnet::common::InitZeros(mxnet::NDArrayStorageType, mxnet::TShape const&, mxnet::Context const&, int)+0x5c) [0x7f57dc10649c] [bt] (6) /home/user02/.conda/envs/audio_face/lib/python3.6/site-packages/mxnet/libmxnet.so(mxnet::common::ReshapeOrCreate(std::string const&, mxnet::TShape const&, int, mxnet::NDArrayStorageType, mxnet::Context const&, std::unordered_map<std::string, mxnet::NDArray, std::hashstd::string, std::equal_tostd::string, std::allocator<std::pair<std::string const, mxnet::NDArray> > >, bool)+0x3a1) [0x7f57dc1199d1] [bt] (7) /home/user02/.conda/envs/audio_face/lib/python3.6/site-packages/mxnet/libmxnet.so(mxnet::exec::GraphExecutor::InitArguments(nnvm::IndexedGraph const&, std::vector<mxnet::TShape, std::allocatormxnet::TShape > const&, std::vector<int, std::allocator > const&, std::vector<int, std::allocator > const&, std::vector<mxnet::Context, std::allocatormxnet::Context > const&, std::vector<mxnet::Context, std::allocatormxnet::Context > const&, std::vector<mxnet::Context, std::allocatormxnet::Context > const&, std::vector<mxnet::OpReqType, std::allocatormxnet::OpReqType > const&, std::unordered_set<std::string, std::hashstd::string, std::equal_tostd::string, std::allocatorstd::string > const&, mxnet::Executor const, std::unordered_map<std::string, mxnet::NDArray, std::hashstd::string, std::equal_tostd::string, std::allocator<std::pair<std::string const, mxnet::NDArray> > >, std::vector<mxnet::NDArray, std::allocatormxnet::NDArray >, std::vector<mxnet::NDArray, std::allocatormxnet::NDArray >, std::vector<mxnet::NDArray, std::allocatormxnet::NDArray >)+0xb10) [0x7f57dc1219a0] [bt] (8) /home/user02/.conda/envs/audio_face/lib/python3.6/site-packages/mxnet/libmxnet.so(mxnet::exec::GraphExecutor::Init(nnvm::Symbol, mxnet::Context const&, std::map<std::string, mxnet::Context, std::lessstd::string, std::allocator<std::pair<std::string const, mxnet::Context> > > const&, std::vector<mxnet::Context, std::allocatormxnet::Context > const&, std::vector<mxnet::Context, std::allocatormxnet::Context > const&, std::vector<mxnet::Context, std::allocatormxnet::Context > const&, std::unordered_map<std::string, mxnet::TShape, std::hashstd::string, std::equal_tostd::string, std::allocator<std::pair<std::string const, mxnet::TShape> > > const&, std::unordered_map<std::string, int, std::hashstd::string, std::equal_tostd::string, std::allocator<std::pair<std::string const, int> > > const&, std::unordered_map<std::string, int, std::hashstd::string, std::equal_tostd::string, std::allocator<std::pair<std::string const, int> > > const&, std::vector<mxnet::OpReqType, std::allocatormxnet::OpReqType > const&, std::unordered_set<std::string, std::hashstd::string, std::equal_tostd::string, std::allocatorstd::string > const&, std::vector<mxnet::NDArray, std::allocatormxnet::NDArray >, std::vector<mxnet::NDArray, std::allocatormxnet::NDArray >, std::vector<mxnet::NDArray, std::allocatormxnet::NDArray >, std::unordered_map<std::string, mxnet::NDArray, std::hashstd::string, std::equal_tostd::string, std::allocator<std::pair<std::string const, mxnet::NDArray> > >, mxnet::Executor, std::unordered_map<nnvm::NodeEntry, mxnet::NDArray, nnvm::NodeEntryHash, nnvm::NodeEntryEqual, std::allocator<std::pair<nnvm::NodeEntry const, mxnet::NDArray> > > const&)+0x6a9) [0x7f57dc12fd59] ----------------- Options --------------- Nw: 3 alpha: 0.3 attention: 1 batch_size: 1 beta1: 0.5 checkpoints_dir: ./checkpoints continue_train: True [default: False] crop_size: 256 dataroot: 31_bmold_win3 [default: None] dataset_mode: aligned_feature_multi direction: AtoB display_env: memory_seq_31 [default: main] display_freq: 400 display_id: 0 display_ncols: 4 display_port: 8097 display_server: http://localhost http://localhost/ display_winsize: 256 do_saturate_mask: False epoch: 0 [default: latest] epoch_count: 1 gan_mode: vanilla gpu_ids: 1 [default: 0] iden_feat_dim: 512 iden_feat_dir: arcface/iden_feat/ iden_thres: 0.98 init_gain: 0.02 init_type: normal input_nc: 3 isTrain: True [default: None] lambda_L1: 100.0 lambda_mask: 2.0 [default: 0.1] lambda_mask_smooth: 1e-05 load_iter: 0 [default: 0] load_size: 286 lr: 0.0001 [default: 0.0002] lr_decay_iters: 50 lr_policy: linear max_dataset_size: inf mem_size: 30000 model: memory_seq [default: cycle_gan] n_layers_D: 3 name: memory_seq_p2p/31 [default: experiment_name] ndf: 64 netD: basic netG: unetac_adain_256 ngf: 64 niter: 60 [default: 100] niter_decay: 0 [default: 100] no_dropout: False no_flip: False no_html: False norm: batch num_threads: 4 output_nc: 3 phase: train pool_size: 0 preprocess: resize_and_crop print_freq: 100 resizemethod: lanczos save_by_iter: False save_epoch_freq: 5 save_latest_freq: 5000 serial_batches: False spatial_feat_dim: 512 suffix: top_k: 256 update_html_freq: 1000 verbose: False ----------------- End ------------------- dataset [AlignedFeatureMultiDataset] was created The number of training images = 298 initialize network with normal initialize network with normal model [MemorySeqModel] was created loading the model from ./checkpoints/memory_seq_p2p/0_net_G.pth loading the model from ./checkpoints/memory_seq_p2p/0_net_D.pth loading the model from ./checkpoints/memory_seq_p2p/0_net_mem.pth ---------- Networks initialized ------------- [Network G] Total number of parameters : 259.056 M [Network D] Total number of parameters : 2.775 M [Network mem] Total number of parameters : 11.952 M create web directory ./checkpoints/memory_seq_p2p/31/web... Traceback (most recent call last): File "train.py", line 45, in for i, data in enumerate(dataset): # inner loop within one epoch File "/home/user02/liweijie/Audio-driven-TalkingFace-HeadPose-master/render-to-video/data/init.py", line 90, in iter for i, data in enumerate(self.dataloader): File "/home/user02/.conda/envs/audio_face/lib/python3.6/site-packages/torch/utils/data/dataloader.py", line 819, in next return self._process_data(data) File "/home/user02/.conda/envs/audio_face/lib/python3.6/site-packages/torch/utils/data/dataloader.py", line 846, in _process_data data.reraise() File "/home/user02/.conda/envs/audio_face/lib/python3.6/site-packages/torch/_utils.py", line 369, in reraise raise self.exc_type(msg) FileNotFoundError: Caught FileNotFoundError in DataLoader worker process 0. Original Traceback (most recent call last): File "/home/user02/.conda/envs/audio_face/lib/python3.6/site-packages/torch/utils/data/_utils/worker.py", line 178, in _worker_loop data = fetcher.fetch(index) File "/home/user02/.conda/envs/audio_face/lib/python3.6/site-packages/torch/utils/data/_utils/fetch.py", line 44, in fetch data = [self.dataset[idx] for idx in possibly_batched_index] File "/home/user02/.conda/envs/audio_face/lib/python3.6/site-packages/torch/utils/data/_utils/fetch.py", line 44, in data = [self.dataset[idx] for idx in possibly_batched_index] File "/home/user02/liweijie/Audio-driven-TalkingFace-HeadPose-master/render-to-video/data/aligned_feature_multi_dataset.py", line 94, in getitem B_feat = np.load(os.path.join(self.opt.iden_feat_dir,ss[-3],ss[-2],ss[-1][:-4]+'.npy')) File "/home/user02/.conda/envs/audio_face/lib/python3.6/site-packages/numpy/lib/npyio.py", line 422, in load fid = open(os_fspath(file), "rb") FileNotFoundError: [Errno 2] No such file or directory: 'arcface/iden_feat/19_news/31/frame249.npy' ----------------- Options --------------- Nw: 3 alpha: 0.3 aspect_ratio: 1.0 attention: 1 batch_size: 1 blinkframeid: 41 checkpoints_dir: ./checkpoints crop_size: 256 dataroot: 31_bmold_win3 [default: None] dataset_mode: aligned_feature_multi direction: AtoB display_winsize: 256 do_saturate_mask: False epoch: 60 [default: latest] eval: False gpu_ids: 1 [default: 0] iden_feat_dim: 512 iden_feat_dir: arcface/iden_feat/ iden_thres: 0.98 imagefolder: images60 [default: images] init_gain: 0.02 init_type: normal input_nc: 3 isTrain: False [default: None] load_iter: 0 [default: 0] load_size: 256 max_dataset_size: inf mem_size: 30000 model: memory_seq [default: test] n: 26 n_layers_D: 3 name: memory_seq_p2p/31 [default: experiment_name] ndf: 64 netD: basic netG: unetac_adain_256 ngf: 64 no_dropout: False no_flip: False norm: batch ntest: inf num_test: 200 [default: 50] num_threads: 4 output_nc: 3 phase: test preprocess: resize_and_crop resizemethod: lanczos results_dir: ./results/ serial_batches: False spatial_feat_dim: 512 suffix: test_batch_list: test_use_gt: 0 top_k: 256 verbose: False ----------------- End ------------------- dataset [AlignedFeatureMultiDataset] was created initialize network with normal model [MemorySeqModel] was created loading the model from ./checkpoints/memory_seq_p2p/60_net_G.pth Traceback (most recent call last): File "test.py", line 47, in model.setup(opt) # regular setup: load and print networks; create schedulers File "/home/user02/liweijie/Audio-driven-TalkingFace-HeadPose-master/render-to-video/models/base_model.py", line 89, in setup self.load_networks(load_suffix) File "/home/user02/liweijie/Audio-driven-TalkingFace-HeadPose-master/render-to-video/models/base_model.py", line 202, in load_networks state_dict = torch.load(load_path, map_location=str(self.device)) File "/home/user02/.conda/envs/audio_face/lib/python3.6/site-packages/torch/serialization.py", line 381, in load f = open(f, 'rb') FileNotFoundError: [Errno 2] No such file or directory: './checkpoints/memory_seq_p2p/60_net_G.pth' (audio_face) @.:~/liweijie/Audio-driven-TalkingFace-HeadPose-master/render-to-video$ The above is the display content of the fifth step. — You are receiving this because you commented. Reply to this email directly, view it on GitHub <#27 (comment)>, or unsubscribe https://github.com/notifications/unsubscribe-auth/AD76RAAQXRJQMFOCMWHUTVLSWKRJTANCNFSM4PUIISTA.

I should have not installed mxnet-gpu, but the program has stopped here after I installed it. As shown below: image

Kenny-Li2023 commented 3 years ago

Error occurs in preparing arcface feature, i.e. line 66 in train_19news_1.py during running this command "python test_batch.py --imglist trainB/31_bmold_win3.txt --gpu 1" Please check these output error infos: "loading models/model-r100-ii/model 0 [23:10:18] src/nnvm/legacy_json_util.cc:209 http://legacy_json_util.cc:209/: Loading symbol saved by previous version v1.2.0. Attempting to upgrade... [23:10:18] src/nnvm/legacy_json_util.cc:217 http://legacy_json_util.cc:217/: Symbol successfully upgraded! Traceback (most recent call last): File "/home/user02/.conda/envs/audio_face/lib/python3.6/site-packages/mxnet/symbol/symbol.py", line 1623, in simple_bind ctypes.byref(exe_handle))) File "/home/user02/.conda/envs/audio_face/lib/python3.6/site-packages/mxnet/base.py", line 253, in check_call raise MXNetError(py_str(_LIB.MXGetLastError())) mxnet.base.MXNetError: [23:10:18] src/storage/storage.cc:119 http://storage.cc:119/: Compile with USE_CUDA=1 to enable GPU usage” It seems the installed mxnet package was not correctly installed. https://stackoverflow.com/questions/46937610/compile-with-use-cuda-1-to-enable-gpu-usage-message-with-mxnet-on-aws-deep-lea https://stackoverflow.com/questions/46937610/compile-with-use-cuda-1-to-enable-gpu-usage-message-with-mxnet-on-aws-deep-lea Have you pip installed mxnet-cu80? 在 2020年12月24日,上午10:27,weijie li @.> 写道: there should be some errors during gan fine-tuning step that cause the fail of outputting this pth file. could you provide more error information during running the gam fine-tuning step... … <x-msg://3/#> 在 2020年12月23日,下午10:53,weijie li @.> 写道:  未安装matlab。或者,您可以检查colab示例,它用八 I have installed matlab and the link is successful, but it still shows that the folder is not found. What should I do? — You are receiving this because you commented. Reply to this email directly, view it on GitHub, or unsubscribe. (audio_face) @.:~/liweijie/Audio-driven-TalkingFace-HeadPose-master/render-to-video$ python train_19news_1.py 31 1 19_news/31 31_bmold_win3 < M A T L A B (R) > Copyright 1984-2017 The MathWorks, Inc. R2017b (9.3.0.713579) 64-bit (glnxa64) September 14, 2017 For online documentation, see http://www.mathworks.com/support http://www.mathworks.com/support For product information, visit www.mathworks.com http://www.mathworks.com/. Elapsed time is 20.569316 seconds. loading models/model-r100-ii/model 0 [23:10:18] src/nnvm/legacy_json_util.cc:209: Loading symbol saved by previous version v1.2.0. Attempting to upgrade... [23:10:18] src/nnvm/legacy_json_util.cc:217: Symbol successfully upgraded! Traceback (most recent call last): File "/home/user02/.conda/envs/audio_face/lib/python3.6/site-packages/mxnet/symbol/symbol.py", line 1623, in simple_bind ctypes.byref(exe_handle))) File "/home/user02/.conda/envs/audio_face/lib/python3.6/site-packages/mxnet/base.py", line 253, in check_call raise MXNetError(py_str(_LIB.MXGetLastError())) mxnet.base.MXNetError: [23:10:18] src/storage/storage.cc:119: Compile with USE_CUDA=1 to enable GPU usage Stack trace: [bt] (0) /home/user02/.conda/envs/audio_face/lib/python3.6/site-packages/mxnet/libmxnet.so(+0x2795cb) [0x7f2d187965cb] [bt] (1) /home/user02/.conda/envs/audio_face/lib/python3.6/site-packages/mxnet/libmxnet.so(+0x2b5d7a5) [0x7f2d1b07a7a5] [bt] (2) /home/user02/.conda/envs/audio_face/lib/python3.6/site-packages/mxnet/libmxnet.so(+0x2b617fd) [0x7f2d1b07e7fd] [bt] (3) /home/user02/.conda/envs/audio_face/lib/python3.6/site-packages/mxnet/libmxnet.so(+0x2b63f12) [0x7f2d1b080f12] [bt] (4) /home/user02/.conda/envs/audio_face/lib/python3.6/site-packages/mxnet/libmxnet.so(mxnet::NDArray::NDArray(mxnet::TShape const&, mxnet::Context, bool, int)+0x5d0) [0x7f2d1a8052b0] [bt] (5) /home/user02/.conda/envs/audio_face/lib/python3.6/site-packages/mxnet/libmxnet.so(mxnet::common::InitZeros(mxnet::NDArrayStorageType, mxnet::TShape const&, mxnet::Context const&, int)+0x5c) [0x7f2d1a8aa49c] [bt] (6) /home/user02/.conda/envs/audio_face/lib/python3.6/site-packages/mxnet/libmxnet.so(mxnet::common::ReshapeOrCreate(std::string const&, mxnet::TShape const&, int, mxnet::NDArrayStorageType, mxnet::Context const&, std::unordered_map<std::string, mxnet::NDArray, std::hashstd::string, std::equal_tostd::string, std::allocator<std::pair<std::string const, mxnet::NDArray> > >, bool)+0x3a1) [0x7f2d1a8bd9d1] [bt] (7) /home/user02/.conda/envs/audio_face/lib/python3.6/site-packages/mxnet/libmxnet.so(mxnet::exec::GraphExecutor::InitArguments(nnvm::IndexedGraph const&, std::vector<mxnet::TShape, std::allocatormxnet::TShape > const&, std::vector<int, std::allocator > const&, std::vector<int, std::allocator > const&, std::vector<mxnet::Context, std::allocatormxnet::Context > const&, std::vector<mxnet::Context, std::allocatormxnet::Context > const&, std::vector<mxnet::Context, std::allocatormxnet::Context > const&, std::vector<mxnet::OpReqType, std::allocatormxnet::OpReqType > const&, std::unordered_set<std::string, std::hashstd::string, std::equal_tostd::string, std::allocatorstd::string > const&, mxnet::Executor const, std::unordered_map<std::string, mxnet::NDArray, std::hashstd::string, std::equal_tostd::string, std::allocator<std::pair<std::string const, mxnet::NDArray> > >, std::vector<mxnet::NDArray, std::allocatormxnet::NDArray >, std::vector<mxnet::NDArray, std::allocatormxnet::NDArray >, std::vector<mxnet::NDArray, std::allocatormxnet::NDArray >)+0xb10) [0x7f2d1a8c59a0] [bt] (8) /home/user02/.conda/envs/audio_face/lib/python3.6/site-packages/mxnet/libmxnet.so(mxnet::exec::GraphExecutor::Init(nnvm::Symbol, mxnet::Context const&, std::map<std::string, mxnet::Context, std::lessstd::string, std::allocator<std::pair<std::string const, mxnet::Context> > > const&, std::vector<mxnet::Context, std::allocatormxnet::Context > const&, std::vector<mxnet::Context, std::allocatormxnet::Context > const&, std::vector<mxnet::Context, std::allocatormxnet::Context > const&, std::unordered_map<std::string, mxnet::TShape, std::hashstd::string, std::equal_tostd::string, std::allocator<std::pair<std::string const, mxnet::TShape> > > const&, std::unordered_map<std::string, int, std::hashstd::string, std::equal_tostd::string, std::allocator<std::pair<std::string const, int> > > const&, std::unordered_map<std::string, int, std::hashstd::string, std::equal_tostd::string, std::allocator<std::pair<std::string const, int> > > const&, std::vector<mxnet::OpReqType, std::allocatormxnet::OpReqType > const&, std::unordered_set<std::string, std::hashstd::string, std::equal_tostd::string, std::allocatorstd::string > const&, std::vector<mxnet::NDArray, std::allocatormxnet::NDArray >, std::vector<mxnet::NDArray, std::allocatormxnet::NDArray >, std::vector<mxnet::NDArray, std::allocatormxnet::NDArray >, std::unordered_map<std::string, mxnet::NDArray, std::hashstd::string, std::equal_tostd::string, std::allocator<std::pair<std::string const, mxnet::NDArray> > >, mxnet::Executor, std::unordered_map<nnvm::NodeEntry, mxnet::NDArray, nnvm::NodeEntryHash, nnvm::NodeEntryEqual, std::allocator<std::pair<nnvm::NodeEntry const, mxnet::NDArray> > > const&)+0x6a9) [0x7f2d1a8d3d59] During handling of the above exception, another exception occurred: Traceback (most recent call last): File "test_batch.py", line 25, in model = face_model.FaceModel(args) File "/home/user02/liweijie/Audio-driven-TalkingFace-HeadPose-master/render-to-video/arcface/face_model.py", line 51, in init self.model = get_model(ctx, image_size, args.model, 'fc1') File "/home/user02/liweijie/Audio-driven-TalkingFace-HeadPose-master/render-to-video/arcface/face_model.py", line 38, in get_model model.bind(data_shapes=[('data', (1, 3, image_size[0], image_size[1]))]) File "/home/user02/.conda/envs/audio_face/lib/python3.6/site-packages/mxnet/module/module.py", line 429, in bind state_names=self._state_names) File "/home/user02/.conda/envs/audio_face/lib/python3.6/site-packages/mxnet/module/executor_group.py", line 279, in init self.bind_exec(data_shapes, label_shapes, shared_group) File "/home/user02/.conda/envs/audio_face/lib/python3.6/site-packages/mxnet/module/executor_group.py", line 375, in bind_exec shared_group)) File "/home/user02/.conda/envs/audio_face/lib/python3.6/site-packages/mxnet/module/executor_group.py", line 662, in _bind_ith_exec shared_buffer=shared_data_arrays, input_shapes) File "/home/user02/.conda/envs/audio_face/lib/python3.6/site-packages/mxnet/symbol/symbol.py", line 1629, in simple_bind raise RuntimeError(error_msg) RuntimeError: simple_bind error. Arguments: data: (1, 3, 112, 112) [23:10:18] src/storage/storage.cc:119: Compile with USE_CUDA=1 to enable GPU usage Stack trace: [bt] (0) /home/user02/.conda/envs/audio_face/lib/python3.6/site-packages/mxnet/libmxnet.so(+0x2795cb) [0x7f2d187965cb] [bt] (1) /home/user02/.conda/envs/audio_face/lib/python3.6/site-packages/mxnet/libmxnet.so(+0x2b5d7a5) [0x7f2d1b07a7a5] [bt] (2) /home/user02/.conda/envs/audio_face/lib/python3.6/site-packages/mxnet/libmxnet.so(+0x2b617fd) [0x7f2d1b07e7fd] [bt] (3) /home/user02/.conda/envs/audio_face/lib/python3.6/site-packages/mxnet/libmxnet.so(+0x2b63f12) [0x7f2d1b080f12] [bt] (4) /home/user02/.conda/envs/audio_face/lib/python3.6/site-packages/mxnet/libmxnet.so(mxnet::NDArray::NDArray(mxnet::TShape const&, mxnet::Context, bool, int)+0x5d0) [0x7f2d1a8052b0] [bt] (5) /home/user02/.conda/envs/audio_face/lib/python3.6/site-packages/mxnet/libmxnet.so(mxnet::common::InitZeros(mxnet::NDArrayStorageType, mxnet::TShape const&, mxnet::Context const&, int)+0x5c) [0x7f2d1a8aa49c] [bt] (6) /home/user02/.conda/envs/audio_face/lib/python3.6/site-packages/mxnet/libmxnet.so(mxnet::common::ReshapeOrCreate(std::string const&, mxnet::TShape const&, int, mxnet::NDArrayStorageType, mxnet::Context const&, std::unordered_map<std::string, mxnet::NDArray, std::hashstd::string, std::equal_tostd::string, std::allocator<std::pair<std::string const, mxnet::NDArray> > >, bool)+0x3a1) [0x7f2d1a8bd9d1] [bt] (7) /home/user02/.conda/envs/audio_face/lib/python3.6/site-packages/mxnet/libmxnet.so(mxnet::exec::GraphExecutor::InitArguments(nnvm::IndexedGraph const&, std::vector<mxnet::TShape, std::allocatormxnet::TShape > const&, std::vector<int, std::allocator > const&, std::vector<int, std::allocator > const&, std::vector<mxnet::Context, std::allocatormxnet::Context > const&, std::vector<mxnet::Context, std::allocatormxnet::Context > const&, std::vector<mxnet::Context, std::allocatormxnet::Context > const&, std::vector<mxnet::OpReqType, std::allocatormxnet::OpReqType > const&, std::unordered_set<std::string, std::hashstd::string, std::equal_tostd::string, std::allocatorstd::string > const&, mxnet::Executor const, std::unordered_map<std::string, mxnet::NDArray, std::hashstd::string, std::equal_tostd::string, std::allocator<std::pair<std::string const, mxnet::NDArray> > >, std::vector<mxnet::NDArray, std::allocatormxnet::NDArray >, std::vector<mxnet::NDArray, std::allocatormxnet::NDArray >, std::vector<mxnet::NDArray, std::allocatormxnet::NDArray >)+0xb10) [0x7f2d1a8c59a0] [bt] (8) /home/user02/.conda/envs/audio_face/lib/python3.6/site-packages/mxnet/libmxnet.so(mxnet::exec::GraphExecutor::Init(nnvm::Symbol, mxnet::Context const&, std::map<std::string, mxnet::Context, std::lessstd::string, std::allocator<std::pair<std::string const, mxnet::Context> > > const&, std::vector<mxnet::Context, std::allocatormxnet::Context > const&, std::vector<mxnet::Context, std::allocatormxnet::Context > const&, std::vector<mxnet::Context, std::allocatormxnet::Context > const&, std::unordered_map<std::string, mxnet::TShape, std::hashstd::string, std::equal_tostd::string, std::allocator<std::pair<std::string const, mxnet::TShape> > > const&, std::unordered_map<std::string, int, std::hashstd::string, std::equal_tostd::string, std::allocator<std::pair<std::string const, int> > > const&, std::unordered_map<std::string, int, std::hashstd::string, std::equal_tostd::string, std::allocator<std::pair<std::string const, int> > > const&, std::vector<mxnet::OpReqType, std::allocatormxnet::OpReqType > const&, std::unordered_set<std::string, std::hashstd::string, std::equal_tostd::string, std::allocatorstd::string > const&, std::vector<mxnet::NDArray, std::allocatormxnet::NDArray >, std::vector<mxnet::NDArray, std::allocatormxnet::NDArray >, std::vector<mxnet::NDArray, std::allocatormxnet::NDArray >, std::unordered_map<std::string, mxnet::NDArray, std::hashstd::string, std::equal_tostd::string, std::allocator<std::pair<std::string const, mxnet::NDArray> > >, mxnet::Executor, std::unordered_map<nnvm::NodeEntry, mxnet::NDArray, nnvm::NodeEntryHash, nnvm::NodeEntryEqual, std::allocator<std::pair<nnvm::NodeEntry const, mxnet::NDArray> > > const&)+0x6a9) [0x7f2d1a8d3d59] loading models/model-r100-ii/model 0 [23:10:21] src/nnvm/legacy_json_util.cc:209: Loading symbol saved by previous version v1.2.0. Attempting to upgrade... [23:10:21] src/nnvm/legacy_json_util.cc:217: Symbol successfully upgraded! Traceback (most recent call last): File "/home/user02/.conda/envs/audio_face/lib/python3.6/site-packages/mxnet/symbol/symbol.py", line 1623, in simple_bind ctypes.byref(exe_handle))) File "/home/user02/.conda/envs/audio_face/lib/python3.6/site-packages/mxnet/base.py", line 253, in check_call raise MXNetError(py_str(_LIB.MXGetLastError())) mxnet.base.MXNetError: [23:10:22] src/storage/storage.cc:119: Compile with USE_CUDA=1 to enable GPU usage Stack trace: [bt] (0) /home/user02/.conda/envs/audio_face/lib/python3.6/site-packages/mxnet/libmxnet.so(+0x2795cb) [0x7f57d9ff25cb] [bt] (1) /home/user02/.conda/envs/audio_face/lib/python3.6/site-packages/mxnet/libmxnet.so(+0x2b5d7a5) [0x7f57dc8d67a5] [bt] (2) /home/user02/.conda/envs/audio_face/lib/python3.6/site-packages/mxnet/libmxnet.so(+0x2b617fd) [0x7f57dc8da7fd] [bt] (3) /home/user02/.conda/envs/audio_face/lib/python3.6/site-packages/mxnet/libmxnet.so(+0x2b63f12) [0x7f57dc8dcf12] [bt] (4) /home/user02/.conda/envs/audio_face/lib/python3.6/site-packages/mxnet/libmxnet.so(mxnet::NDArray::NDArray(mxnet::TShape const&, mxnet::Context, bool, int)+0x5d0) [0x7f57dc0612b0] [bt] (5) /home/user02/.conda/envs/audio_face/lib/python3.6/site-packages/mxnet/libmxnet.so(mxnet::common::InitZeros(mxnet::NDArrayStorageType, mxnet::TShape const&, mxnet::Context const&, int)+0x5c) [0x7f57dc10649c] [bt] (6) /home/user02/.conda/envs/audio_face/lib/python3.6/site-packages/mxnet/libmxnet.so(mxnet::common::ReshapeOrCreate(std::string const&, mxnet::TShape const&, int, mxnet::NDArrayStorageType, mxnet::Context const&, std::unordered_map<std::string, mxnet::NDArray, std::hashstd::string, std::equal_tostd::string, std::allocator<std::pair<std::string const, mxnet::NDArray> > >, bool)+0x3a1) [0x7f57dc1199d1] [bt] (7) /home/user02/.conda/envs/audio_face/lib/python3.6/site-packages/mxnet/libmxnet.so(mxnet::exec::GraphExecutor::InitArguments(nnvm::IndexedGraph const&, std::vector<mxnet::TShape, std::allocatormxnet::TShape > const&, std::vector<int, std::allocator > const&, std::vector<int, std::allocator > const&, std::vector<mxnet::Context, std::allocatormxnet::Context > const&, std::vector<mxnet::Context, std::allocatormxnet::Context > const&, std::vector<mxnet::Context, std::allocatormxnet::Context > const&, std::vector<mxnet::OpReqType, std::allocatormxnet::OpReqType > const&, std::unordered_set<std::string, std::hashstd::string, std::equal_tostd::string, std::allocatorstd::string > const&, mxnet::Executor const, std::unordered_map<std::string, mxnet::NDArray, std::hashstd::string, std::equal_tostd::string, std::allocator<std::pair<std::string const, mxnet::NDArray> > >, std::vector<mxnet::NDArray, std::allocatormxnet::NDArray >, std::vector<mxnet::NDArray, std::allocatormxnet::NDArray >, std::vector<mxnet::NDArray, std::allocatormxnet::NDArray >)+0xb10) [0x7f57dc1219a0] [bt] (8) /home/user02/.conda/envs/audio_face/lib/python3.6/site-packages/mxnet/libmxnet.so(mxnet::exec::GraphExecutor::Init(nnvm::Symbol, mxnet::Context const&, std::map<std::string, mxnet::Context, std::lessstd::string, std::allocator<std::pair<std::string const, mxnet::Context> > > const&, std::vector<mxnet::Context, std::allocatormxnet::Context > const&, std::vector<mxnet::Context, std::allocatormxnet::Context > const&, std::vector<mxnet::Context, std::allocatormxnet::Context > const&, std::unordered_map<std::string, mxnet::TShape, std::hashstd::string, std::equal_tostd::string, std::allocator<std::pair<std::string const, mxnet::TShape> > > const&, std::unordered_map<std::string, int, std::hashstd::string, std::equal_tostd::string, std::allocator<std::pair<std::string const, int> > > const&, std::unordered_map<std::string, int, std::hashstd::string, std::equal_tostd::string, std::allocator<std::pair<std::string const, int> > > const&, std::vector<mxnet::OpReqType, std::allocatormxnet::OpReqType > const&, std::unordered_set<std::string, std::hashstd::string, std::equal_tostd::string, std::allocatorstd::string > const&, std::vector<mxnet::NDArray, std::allocatormxnet::NDArray >, std::vector<mxnet::NDArray, std::allocatormxnet::NDArray >, std::vector<mxnet::NDArray, std::allocatormxnet::NDArray >, std::unordered_map<std::string, mxnet::NDArray, std::hashstd::string, std::equal_tostd::string, std::allocator<std::pair<std::string const, mxnet::NDArray> > >, mxnet::Executor, std::unordered_map<nnvm::NodeEntry, mxnet::NDArray, nnvm::NodeEntryHash, nnvm::NodeEntryEqual, std::allocator<std::pair<nnvm::NodeEntry const, mxnet::NDArray> > > const&)+0x6a9) [0x7f57dc12fd59] During handling of the above exception, another exception occurred: Traceback (most recent call last): File "test_batch.py", line 25, in model = face_model.FaceModel(args) File "/home/user02/liweijie/Audio-driven-TalkingFace-HeadPose-master/render-to-video/arcface/face_model.py", line 51, in init self.model = get_model(ctx, image_size, args.model, 'fc1') File "/home/user02/liweijie/Audio-driven-TalkingFace-HeadPose-master/render-to-video/arcface/face_model.py", line 38, in get_model model.bind(data_shapes=[('data', (1, 3, image_size[0], image_size[1]))]) File "/home/user02/.conda/envs/audio_face/lib/python3.6/site-packages/mxnet/module/module.py", line 429, in bind state_names=self._state_names) File "/home/user02/.conda/envs/audio_face/lib/python3.6/site-packages/mxnet/module/executor_group.py", line 279, in init self.bind_exec(data_shapes, label_shapes, shared_group) File "/home/user02/.conda/envs/audio_face/lib/python3.6/site-packages/mxnet/module/executor_group.py", line 375, in bind_exec shared_group)) File "/home/user02/.conda/envs/audio_face/lib/python3.6/site-packages/mxnet/module/executor_group.py", line 662, in _bind_ith_exec shared_buffer=shared_data_arrays, input_shapes) File "/home/user02/.conda/envs/audio_face/lib/python3.6/site-packages/mxnet/symbol/symbol.py", line 1629, in simple_bind raise RuntimeError(error_msg) RuntimeError: simple_bind error. Arguments: data: (1, 3, 112, 112) [23:10:22] src/storage/storage.cc:119: Compile with USE_CUDA=1 to enable GPU usage Stack trace: [bt] (0) /home/user02/.conda/envs/audio_face/lib/python3.6/site-packages/mxnet/libmxnet.so(+0x2795cb) [0x7f57d9ff25cb] [bt] (1) /home/user02/.conda/envs/audio_face/lib/python3.6/site-packages/mxnet/libmxnet.so(+0x2b5d7a5) [0x7f57dc8d67a5] [bt] (2) /home/user02/.conda/envs/audio_face/lib/python3.6/site-packages/mxnet/libmxnet.so(+0x2b617fd) [0x7f57dc8da7fd] [bt] (3) /home/user02/.conda/envs/audio_face/lib/python3.6/site-packages/mxnet/libmxnet.so(+0x2b63f12) [0x7f57dc8dcf12] [bt] (4) /home/user02/.conda/envs/audio_face/lib/python3.6/site-packages/mxnet/libmxnet.so(mxnet::NDArray::NDArray(mxnet::TShape const&, mxnet::Context, bool, int)+0x5d0) [0x7f57dc0612b0] [bt] (5) /home/user02/.conda/envs/audio_face/lib/python3.6/site-packages/mxnet/libmxnet.so(mxnet::common::InitZeros(mxnet::NDArrayStorageType, mxnet::TShape const&, mxnet::Context const&, int)+0x5c) [0x7f57dc10649c] [bt] (6) /home/user02/.conda/envs/audio_face/lib/python3.6/site-packages/mxnet/libmxnet.so(mxnet::common::ReshapeOrCreate(std::string const&, mxnet::TShape const&, int, mxnet::NDArrayStorageType, mxnet::Context const&, std::unordered_map<std::string, mxnet::NDArray, std::hashstd::string, std::equal_tostd::string, std::allocator<std::pair<std::string const, mxnet::NDArray> > >, bool)+0x3a1) [0x7f57dc1199d1] [bt] (7) /home/user02/.conda/envs/audio_face/lib/python3.6/site-packages/mxnet/libmxnet.so(mxnet::exec::GraphExecutor::InitArguments(nnvm::IndexedGraph const&, std::vector<mxnet::TShape, std::allocatormxnet::TShape > const&, std::vector<int, std::allocator > const&, std::vector<int, std::allocator > const&, std::vector<mxnet::Context, std::allocatormxnet::Context > const&, std::vector<mxnet::Context, std::allocatormxnet::Context > const&, std::vector<mxnet::Context, std::allocatormxnet::Context > const&, std::vector<mxnet::OpReqType, std::allocatormxnet::OpReqType > const&, std::unordered_set<std::string, std::hashstd::string, std::equal_tostd::string, std::allocatorstd::string > const&, mxnet::Executor const, std::unordered_map<std::string, mxnet::NDArray, std::hashstd::string, std::equal_tostd::string, std::allocator<std::pair<std::string const, mxnet::NDArray> > >, std::vector<mxnet::NDArray, std::allocatormxnet::NDArray >, std::vector<mxnet::NDArray, std::allocatormxnet::NDArray >, std::vector<mxnet::NDArray, std::allocatormxnet::NDArray >)+0xb10) [0x7f57dc1219a0] [bt] (8) /home/user02/.conda/envs/audio_face/lib/python3.6/site-packages/mxnet/libmxnet.so(mxnet::exec::GraphExecutor::Init(nnvm::Symbol, mxnet::Context const&, std::map<std::string, mxnet::Context, std::lessstd::string, std::allocator<std::pair<std::string const, mxnet::Context> > > const&, std::vector<mxnet::Context, std::allocatormxnet::Context > const&, std::vector<mxnet::Context, std::allocatormxnet::Context > const&, std::vector<mxnet::Context, std::allocatormxnet::Context > const&, std::unordered_map<std::string, mxnet::TShape, std::hashstd::string, std::equal_tostd::string, std::allocator<std::pair<std::string const, mxnet::TShape> > > const&, std::unordered_map<std::string, int, std::hashstd::string, std::equal_tostd::string, std::allocator<std::pair<std::string const, int> > > const&, std::unordered_map<std::string, int, std::hashstd::string, std::equal_tostd::string, std::allocator<std::pair<std::string const, int> > > const&, std::vector<mxnet::OpReqType, std::allocatormxnet::OpReqType > const&, std::unordered_set<std::string, std::hashstd::string, std::equal_tostd::string, std::allocatorstd::string > const&, std::vector<mxnet::NDArray, std::allocatormxnet::NDArray >, std::vector<mxnet::NDArray, std::allocatormxnet::NDArray >, std::vector<mxnet::NDArray, std::allocatormxnet::NDArray >, std::unordered_map<std::string, mxnet::NDArray, std::hashstd::string, std::equal_tostd::string, std::allocator<std::pair<std::string const, mxnet::NDArray> > >, mxnet::Executor, std::unordered_map<nnvm::NodeEntry, mxnet::NDArray, nnvm::NodeEntryHash, nnvm::NodeEntryEqual, std::allocator<std::pair<nnvm::NodeEntry const, mxnet::NDArray> > > const&)+0x6a9) [0x7f57dc12fd59] ----------------- Options --------------- Nw: 3 alpha: 0.3 attention: 1 batch_size: 1 beta1: 0.5 checkpoints_dir: ./checkpoints continue_train: True [default: False] crop_size: 256 dataroot: 31_bmold_win3 [default: None] dataset_mode: aligned_feature_multi direction: AtoB display_env: memory_seq_31 [default: main] display_freq: 400 display_id: 0 display_ncols: 4 display_port: 8097 display_server: http://localhost http://localhost/ display_winsize: 256 do_saturate_mask: False epoch: 0 [default: latest] epoch_count: 1 gan_mode: vanilla gpu_ids: 1 [default: 0] iden_feat_dim: 512 iden_feat_dir: arcface/iden_feat/ iden_thres: 0.98 init_gain: 0.02 init_type: normal input_nc: 3 isTrain: True [default: None] lambda_L1: 100.0 lambda_mask: 2.0 [default: 0.1] lambda_mask_smooth: 1e-05 load_iter: 0 [default: 0] load_size: 286 lr: 0.0001 [default: 0.0002] lr_decay_iters: 50 lr_policy: linear max_dataset_size: inf mem_size: 30000 model: memory_seq [default: cycle_gan] n_layers_D: 3 name: memory_seq_p2p/31 [default: experiment_name] ndf: 64 netD: basic netG: unetac_adain_256 ngf: 64 niter: 60 [default: 100] niter_decay: 0 [default: 100] no_dropout: False no_flip: False no_html: False norm: batch num_threads: 4 output_nc: 3 phase: train pool_size: 0 preprocess: resize_and_crop print_freq: 100 resizemethod: lanczos save_by_iter: False save_epoch_freq: 5 save_latest_freq: 5000 serial_batches: False spatial_feat_dim: 512 suffix: top_k: 256 update_html_freq: 1000 verbose: False ----------------- End ------------------- dataset [AlignedFeatureMultiDataset] was created The number of training images = 298 initialize network with normal initialize network with normal model [MemorySeqModel] was created loading the model from ./checkpoints/memory_seq_p2p/0_net_G.pth loading the model from ./checkpoints/memory_seq_p2p/0_net_D.pth loading the model from ./checkpoints/memory_seq_p2p/0_net_mem.pth ---------- Networks initialized ------------- [Network G] Total number of parameters : 259.056 M [Network D] Total number of parameters : 2.775 M [Network mem] Total number of parameters : 11.952 M create web directory ./checkpoints/memory_seq_p2p/31/web... Traceback (most recent call last): File "train.py", line 45, in for i, data in enumerate(dataset): # inner loop within one epoch File "/home/user02/liweijie/Audio-driven-TalkingFace-HeadPose-master/render-to-video/data/init.py", line 90, in iter for i, data in enumerate(self.dataloader): File "/home/user02/.conda/envs/audio_face/lib/python3.6/site-packages/torch/utils/data/dataloader.py", line 819, in next return self._process_data(data) File "/home/user02/.conda/envs/audio_face/lib/python3.6/site-packages/torch/utils/data/dataloader.py", line 846, in _process_data data.reraise() File "/home/user02/.conda/envs/audio_face/lib/python3.6/site-packages/torch/_utils.py", line 369, in reraise raise self.exc_type(msg) FileNotFoundError: Caught FileNotFoundError in DataLoader worker process 0. Original Traceback (most recent call last): File "/home/user02/.conda/envs/audio_face/lib/python3.6/site-packages/torch/utils/data/_utils/worker.py", line 178, in _worker_loop data = fetcher.fetch(index) File "/home/user02/.conda/envs/audio_face/lib/python3.6/site-packages/torch/utils/data/_utils/fetch.py", line 44, in fetch data = [self.dataset[idx] for idx in possibly_batched_index] File "/home/user02/.conda/envs/audio_face/lib/python3.6/site-packages/torch/utils/data/_utils/fetch.py", line 44, in data = [self.dataset[idx] for idx in possibly_batched_index] File "/home/user02/liweijie/Audio-driven-TalkingFace-HeadPose-master/render-to-video/data/aligned_feature_multi_dataset.py", line 94, in getitem B_feat = np.load(os.path.join(self.opt.iden_feat_dir,ss[-3],ss[-2],ss[-1][:-4]+'.npy')) File "/home/user02/.conda/envs/audio_face/lib/python3.6/site-packages/numpy/lib/npyio.py", line 422, in load fid = open(os_fspath(file), "rb") FileNotFoundError: [Errno 2] No such file or directory: 'arcface/iden_feat/19_news/31/frame249.npy' ----------------- Options --------------- Nw: 3 alpha: 0.3 aspect_ratio: 1.0 attention: 1 batch_size: 1 blinkframeid: 41 checkpoints_dir: ./checkpoints crop_size: 256 dataroot: 31_bmold_win3 [default: None] dataset_mode: aligned_feature_multi direction: AtoB display_winsize: 256 do_saturate_mask: False epoch: 60 [default: latest] eval: False gpu_ids: 1 [default: 0] iden_feat_dim: 512 iden_feat_dir: arcface/iden_feat/ iden_thres: 0.98 imagefolder: images60 [default: images] init_gain: 0.02 init_type: normal input_nc: 3 isTrain: False [default: None] load_iter: 0 [default: 0] load_size: 256 max_dataset_size: inf mem_size: 30000 model: memory_seq [default: test] n: 26 n_layers_D: 3 name: memory_seq_p2p/31 [default: experiment_name] ndf: 64 netD: basic netG: unetac_adain_256 ngf: 64 no_dropout: False no_flip: False norm: batch ntest: inf num_test: 200 [default: 50] num_threads: 4 output_nc: 3 phase: test preprocess: resize_and_crop resizemethod: lanczos results_dir: ./results/ serial_batches: False spatial_feat_dim: 512 suffix: test_batch_list: test_use_gt: 0 top_k: 256 verbose: False ----------------- End ------------------- dataset [AlignedFeatureMultiDataset] was created initialize network with normal model [MemorySeqModel] was created loading the model from ./checkpoints/memory_seq_p2p/60_net_G.pth Traceback (most recent call last): File "test.py", line 47, in model.setup(opt) # regular setup: load and print networks; create schedulers File "/home/user02/liweijie/Audio-driven-TalkingFace-HeadPose-master/render-to-video/models/base_model.py", line 89, in setup self.load_networks(load_suffix) File "/home/user02/liweijie/Audio-driven-TalkingFace-HeadPose-master/render-to-video/models/base_model.py", line 202, in load_networks state_dict = torch.load(load_path, map_location=str(self.device)) File "/home/user02/.conda/envs/audio_face/lib/python3.6/site-packages/torch/serialization.py", line 381, in load f = open(f, 'rb') FileNotFoundError: [Errno 2] No such file or directory: './checkpoints/memory_seq_p2p/60_net_G.pth' (audio_face) @.:~/liweijie/Audio-driven-TalkingFace-HeadPose-master/render-to-video$ The above is the display content of the fifth step. — You are receiving this because you commented. Reply to this email directly, view it on GitHub <#27 (comment)>, or unsubscribe https://github.com/notifications/unsubscribe-auth/AD76RAAQXRJQMFOCMWHUTVLSWKRJTANCNFSM4PUIISTA.

This problem still occurs after mxnet is installed.

(audio_face) user02@lthpc:~/liweijie/Audio-driven-TalkingFace-HeadPose-master/render-to-video$ python train_19news_1.py 31 1 19_news/31 31_bmold_win3

                                                                                                         < M A T L A B (R) >
                                                                                               Copyright 1984-2017 The MathWorks, Inc.
                                                                                                R2017b (9.3.0.713579) 64-bit (glnxa64)
                                                                                                          September 14, 2017

For online documentation, see http://www.mathworks.com/support For product information, visit www.mathworks.com.

Elapsed time is 19.919913 seconds. loading models/model-r100-ii/model 0 [16:13:35] src/nnvm/legacy_json_util.cc:209: Loading symbol saved by previous version v1.2.0. Attempting to upgrade... [16:13:35] src/nnvm/legacy_json_util.cc:217: Symbol successfully upgraded! Traceback (most recent call last): File "test_batch.py", line 25, in model = face_model.FaceModel(args) File "/home/user02/liweijie/Audio-driven-TalkingFace-HeadPose-master/render-to-video/arcface/face_model.py", line 60, in init File "/home/user02/liweijie/Audio-driven-TalkingFace-HeadPose-master/render-to-video/arcface/mtcnn_detector.py", line 58, in init File "/home/user02/.conda/envs/audio_face/lib/python3.6/site-packages/mxnet/model.py", line 924, in load symbol, arg_params, aux_params = load_checkpoint(prefix, epoch) File "/home/user02/.conda/envs/audio_face/lib/python3.6/site-packages/mxnet/model.py", line 419, in load_checkpoint symbol = sym.load('%s-symbol.json' % prefix) File "/home/user02/.conda/envs/audio_face/lib/python3.6/site-packages/mxnet/symbol/symbol.py", line 2535, in load check_call(_LIB.MXSymbolCreateFromFile(c_str(fname), ctypes.byref(handle))) File "/home/user02/.conda/envs/audio_face/lib/python3.6/site-packages/mxnet/base.py", line 149, in check_call raise MXNetError(py_str(_LIB.MXGetLastError())) mxnet.base.MXNetError: [16:33:54] src/io/local_filesys.cc:166: Check failed: allow_null LocalFileSystem::Open "/home/user02/liweijie/Audio-driven-TalkingFace-HeadPose-master/render-to-video/arcface/mtcnn-model/det1-symbol.json": No such file or directory

Stack trace returned 10 entries: [bt] (0) /home/user02/.conda/envs/audio_face/lib/python3.6/site-packages/mxnet/libmxnet.so(dmlc::StackTrace[abi:cxx11]()+0x5a) [0x7fde3058ebba] [bt] (1) /home/user02/.conda/envs/audio_face/lib/python3.6/site-packages/mxnet/libmxnet.so(dmlc::io::LocalFileSystem::Open(dmlc::io::URI const&, char const, bool)+0x566) [0x7fde333694c6] [bt] (2) /home/user02/.conda/envs/audio_face/lib/python3.6/site-packages/mxnet/libmxnet.so(dmlc::Stream::Create(char const, char const*, bool)+0x166) [0x7fde3335b0e6] [bt] (3) /home/user02/.conda/envs/audio_face/lib/python3.6/site-packages/mxnet/libmxnet.so(MXSymbolCreateFromFile+0x72) [0x7fde332a3e92] [bt] (4) /home/user02/.conda/envs/audio_face/lib/python3.6/lib-dynload/_ctypes.cpython-36m-x86_64-linux-gnu.so(ffi_call_unix64+0x4c) [0x7fde7493b5b0] [bt] (5) /home/user02/.conda/envs/audio_face/lib/python3.6/lib-dynload/_ctypes.cpython-36m-x86_64-linux-gnu.so(ffi_call+0x1f5) [0x7fde7493ad55] [bt] (6) /home/user02/.conda/envs/audio_face/lib/python3.6/lib-dynload/_ctypes.cpython-36m-x86_64-linux-gnu.so(_ctypes_callproc+0x3dc) [0x7fde7493289c] [bt] (7) /home/user02/.conda/envs/audio_face/lib/python3.6/lib-dynload/_ctypes.cpython-36m-x86_64-linux-gnu.so(+0x9df3) [0x7fde7492adf3] [bt] (8) /home/user02/.conda/envs/audio_face/bin/../lib/libpython3.6m.so.1.0(_PyObject_FastCallDict+0x9e) [0x7fde761fdc1e] [bt] (9) /home/user02/.conda/envs/audio_face/bin/../lib/libpython3.6m.so.1.0(+0x14895b) [0x7fde762da95b]

loading models/model-r100-ii/model 0 [16:33:58] src/nnvm/legacy_json_util.cc:209: Loading symbol saved by previous version v1.2.0. Attempting to upgrade... [16:33:58] src/nnvm/legacy_json_util.cc:217: Symbol successfully upgraded! [16:54:15] src/nnvm/legacy_json_util.cc:209: Loading symbol saved by previous version v0.8.0. Attempting to upgrade... [16:54:15] src/nnvm/legacy_json_util.cc:217: Symbol successfully upgraded! /home/user02/.conda/envs/audio_face/lib/python3.6/site-packages/mxnet/model.py:928: DeprecationWarning: mxnet.model.FeedForward has been deprecated. Please use mxnet.mod.Module instead. **kwargs) [16:54:15] src/nnvm/legacy_json_util.cc:209: Loading symbol saved by previous version v0.8.0. Attempting to upgrade... [16:54:15] src/nnvm/legacy_json_util.cc:217: Symbol successfully upgraded! [16:54:15] src/nnvm/legacy_json_util.cc:209: Loading symbol saved by previous version v0.8.0. Attempting to upgrade... [16:54:15] src/nnvm/legacy_json_util.cc:217: Symbol successfully upgraded! [16:54:15] src/nnvm/legacy_json_util.cc:209: Loading symbol saved by previous version v0.8.0. Attempting to upgrade... [16:54:15] src/nnvm/legacy_json_util.cc:217: Symbol successfully upgraded! imglist len 100 Traceback (most recent call last): File "test_batch.py", line 48, in img = model.get_input(img) File "/home/user02/liweijie/Audio-driven-TalkingFace-HeadPose-master01/render-to-video/arcface/face_model.py", line 67, in get_input ret = self.detector.detect_face(face_img, det_type = self.args.det) File "/home/user02/liweijie/Audio-driven-TalkingFace-HeadPose-master01/render-to-video/arcface/mtcnn_detector.py", line 323, in detectface height, width, = img.shape AttributeError: 'NoneType' object has no attribute 'shape' ----------------- Options --------------- Nw: 3
alpha: 0.3
attention: 1
batch_size: 1
beta1: 0.5
checkpoints_dir: ./checkpoints
continue_train: True [default: False] crop_size: 256
dataroot: 31_bmold_win3 [default: None] dataset_mode: aligned_feature_multi
direction: AtoB
display_env: memory_seq_31 [default: main] display_freq: 400
display_id: 0
display_ncols: 4
display_port: 8097
display_server: http://localhost
display_winsize: 256
do_saturate_mask: False
epoch: 0 [default: latest] epoch_count: 1
gan_mode: vanilla
gpu_ids: 1 [default: 0] iden_feat_dim: 512
iden_feat_dir: arcface/iden_feat/
iden_thres: 0.98
init_gain: 0.02
init_type: normal
input_nc: 3
isTrain: True [default: None] lambda_L1: 100.0
lambda_mask: 2.0 [default: 0.1] lambda_mask_smooth: 1e-05
load_iter: 0 [default: 0] load_size: 286
lr: 0.0001 [default: 0.0002] lr_decay_iters: 50
lr_policy: linear
max_dataset_size: inf
mem_size: 30000
model: memory_seq [default: cycle_gan] n_layers_D: 3
name: memory_seq_p2p/31 [default: experiment_name] ndf: 64
netD: basic
netG: unetac_adain_256
ngf: 64
niter: 60 [default: 100] niter_decay: 0 [default: 100] no_dropout: False
no_flip: False
no_html: False
norm: batch
num_threads: 4
output_nc: 3
phase: train
pool_size: 0
preprocess: resize_and_crop
print_freq: 100
resizemethod: lanczos
save_by_iter: False
save_epoch_freq: 5
save_latest_freq: 5000
serial_batches: False
spatial_feat_dim: 512
suffix:
top_k: 256
update_html_freq: 1000
verbose: False
----------------- End ------------------- dataset [AlignedFeatureMultiDataset] was created The number of training images = 298 initialize network with normal initialize network with normal model [MemorySeqModel] was created loading the model from ./checkpoints/memory_seq_p2p/0_net_G.pth loading the model from ./checkpoints/memory_seq_p2p/0_net_D.pth loading the model from ./checkpoints/memory_seq_p2p/0_net_mem.pth ---------- Networks initialized ------------- [Network G] Total number of parameters : 259.056 M [Network D] Total number of parameters : 2.775 M [Network mem] Total number of parameters : 11.952 M

create web directory ./checkpoints/memory_seq_p2p/31/web... Traceback (most recent call last): File "train.py", line 45, in for i, data in enumerate(dataset): # inner loop within one epoch File "/home/user02/liweijie/Audio-driven-TalkingFace-HeadPose-master01/render-to-video/data/init.py", line 90, in iter for i, data in enumerate(self.dataloader): File "/home/user02/.conda/envs/audio_face/lib/python3.6/site-packages/torch/utils/data/dataloader.py", line 819, in next return self._process_data(data) File "/home/user02/.conda/envs/audio_face/lib/python3.6/site-packages/torch/utils/data/dataloader.py", line 846, in _process_data data.reraise() File "/home/user02/.conda/envs/audio_face/lib/python3.6/site-packages/torch/_utils.py", line 369, in reraise raise self.exc_type(msg) FileNotFoundError: Caught FileNotFoundError in DataLoader worker process 0. Original Traceback (most recent call last): File "/home/user02/.conda/envs/audio_face/lib/python3.6/site-packages/torch/utils/data/_utils/worker.py", line 178, in _worker_loop data = fetcher.fetch(index) File "/home/user02/.conda/envs/audio_face/lib/python3.6/site-packages/torch/utils/data/_utils/fetch.py", line 44, in fetch data = [self.dataset[idx] for idx in possibly_batched_index] File "/home/user02/.conda/envs/audio_face/lib/python3.6/site-packages/torch/utils/data/_utils/fetch.py", line 44, in data = [self.dataset[idx] for idx in possibly_batched_index] File "/home/user02/liweijie/Audio-driven-TalkingFace-HeadPose-master01/render-to-video/data/aligned_feature_multi_dataset.py", line 54, in getitem A = Image.open(AB_path).convert('RGB') File "/home/user02/.conda/envs/audio_face/lib/python3.6/site-packages/PIL/Image.py", line 2530, in open fp = builtins.open(filename, "rb") FileNotFoundError: [Errno 2] No such file or directory: '/home/user02/liweijie/Audio-driven-TalkingFace-HeadPose-master/render-to-video/../Deep3DFaceReconstruction/output/render/19_news/31/bm/frame85_renderold_bm.png'

----------------- Options --------------- Nw: 3
alpha: 0.3
aspect_ratio: 1.0
attention: 1
batch_size: 1
blinkframeid: 41
checkpoints_dir: ./checkpoints
crop_size: 256
dataroot: 31_bmold_win3 [default: None] dataset_mode: aligned_feature_multi
direction: AtoB
display_winsize: 256
do_saturate_mask: False
epoch: 60 [default: latest] eval: False
gpu_ids: 1 [default: 0] iden_feat_dim: 512
iden_feat_dir: arcface/iden_feat/
iden_thres: 0.98
imagefolder: images60 [default: images] init_gain: 0.02
init_type: normal
input_nc: 3
isTrain: False [default: None] load_iter: 0 [default: 0] load_size: 256
max_dataset_size: inf
mem_size: 30000
model: memory_seq [default: test] n: 26
n_layers_D: 3
name: memory_seq_p2p/31 [default: experiment_name] ndf: 64
netD: basic
netG: unetac_adain_256
ngf: 64
no_dropout: False
no_flip: False
norm: batch
ntest: inf
num_test: 200 [default: 50] num_threads: 4
output_nc: 3
phase: test
preprocess: resize_and_crop
resizemethod: lanczos
results_dir: ./results/
serial_batches: False
spatial_feat_dim: 512
suffix:
test_batch_list:
test_use_gt: 0
top_k: 256
verbose: False
----------------- End ------------------- dataset [AlignedFeatureMultiDataset] was created initialize network with normal model [MemorySeqModel] was created loading the model from ./checkpoints/memory_seq_p2p/60_net_G.pth Traceback (most recent call last): File "test.py", line 47, in model.setup(opt) # regular setup: load and print networks; create schedulers File "/home/user02/liweijie/Audio-driven-TalkingFace-HeadPose-master01/render-to-video/models/base_model.py", line 89, in setup self.load_networks(load_suffix) File "/home/user02/liweijie/Audio-driven-TalkingFace-HeadPose-master01/render-to-video/models/base_model.py", line 202, in load_networks state_dict = torch.load(load_path, map_location=str(self.device)) File "/home/user02/.conda/envs/audio_face/lib/python3.6/site-packages/torch/serialization.py", line 381, in load f = open(f, 'rb') FileNotFoundError: [Errno 2] No such file or directory: './checkpoints/memory_seq_p2p/60_net_G.pth' (audio_face) user02@lthpc:~/liweijie/Audio-driven-TalkingFace-HeadPose-master/render-to-video$

Kenny-Li2023 commented 3 years ago

Can you help me?I have not found a way to solve the above question.

qiaomu-miao commented 3 years ago

Can you help me?I have not found a way to solve the above question.

Hello have you solved this problem? I met this problem even after I installed octave

xiaobairui commented 3 years ago

I got the same error and it was because matlab was not installed. Alternatively, you can check the colab example, it replaces matlab with octave.

Excuse me, could you tell me which version of matlab you use?