How to test the texture transfer model?

[confifu]

I want to test only the texture transfer model. It is mentioned that the model needs to be changed. How should I change it? What inputs are needed to test the texture transfer model?

[Zhangjinso]

As far as I can remember, you can do it with some steps.

1. You need to change this line to 'model_file_name = "model." + model_name + "_model_transfer" ' to import the texture transfer model.
2. You also need to change this line to ' filename = 'generator_texture_transfer' if filename is None else filename ' to import generator.
3. You need to change the dataloader and your test_pair.csv to input two reference images according to this line.
4. You need to uncomment this line and modified the region index and 'alpha' (maybe change it to 1).
5. Then you can test it.

[happyday521]

@Zhangjinso Hi, in line 223 of generator_texture_transfer.py, what is the meaning of "if False"? Don't we need to execute indented codes under if？（line 223-265）Thanks！

[Zhangjinso]

Yes. The texture transfer model does not used spatio-aware normalization module for the convenience of training. If you want to get better results, you can retrain the model with this.

[confifu]

Pose transfer results using the pre-trained checkpoint are not as good as shown in the paper. Were different checkpoints used to get the results shown in the paper?

[Zhangjinso]

You can refer to this issue.

[confifu]

What should be self.input_SPL3 ? SPL2_onehot has shape [8, 256, 256]. Do we also need to input one hot vector in input_SPL3 as well? Do we only have to leave the region for which we want the texture transfer?

[confifu]

If anyone wants to do this, To keep the pose same and only transfer texture, I did the following:

• Change the following line https://github.com/Zhangjinso/PISE/blob/f9dfacb16db99420a5a51bf7e0fd2a632466b701/data/base_dataset.py#L136 to return {'P1': P1, 'BP1': BP1, 'P2': P1, 'BP2': BP1,'SPL1': SPL1_onehot, 'SPL2':SPL1_onehot, 'label_P2': SPL1, 'P1_path': P1_name, 'P2_path': P1_name, 'P3' : P2, 'SPL3' : SPL2_onehot}

• To change the part for which you want to transfer texture, edit the following line https://github.com/Zhangjinso/PISE/blob/f9dfacb16db99420a5a51bf7e0fd2a632466b701/model/networks/generator_texture_transfer.py#L186 to codes_vector[0,part,:] = (1-alpha)*codes_vector[0,part,:]+alpha*_codes_vector[0,part,:] set alpha = 1 and part = 0 to 8

[mlyarthur]

After following your instruction for texture transfer model testing, I cannot get the desired result in the paper @eternitjl @Zhangjinso Do you know what step I miss or make a mistake

[ghost]

After following your instruction for texture transfer model testing, I cannot get the desired result in the paper @eternitjl @Zhangjinso Do you know what step I miss or make a mistake

@mlyarthur Hi，have you solved it? I have a similar problem