search

eververas / 3DGazeNet

Official repo of the paper 3DGazeNet: Generalizing Gaze Estimation with Weak-Supervision from Synthetic Views
https://arxiv.org/abs/2212.02997
46 stars 4 forks source link

Clarifications #2

Closed HeChengHui closed 5 months ago

HeChengHui commented 6 months ago

Hello @Vagver, thank you for your work! I have a few questions to clarify.

1) what is the difference between this inference script and this inference script? 2) Do i only need to do preprocessing for images? since it is not mentioned in the demo folder. 3) Is the method implemented by Insightface the same as this?

eververas commented 6 months ago

Hello HeChengHui,

  1. The first inference script you mention is about performing inference on a set of images and store the results, while the second one is in essence a demo which can run directly on videos.
  2. Demo does the preprocessing in the FacePredictor/GazePredictor classes.
  3. The method by insightface is the same.

Let me know if the above are not clear enough.

HeChengHui commented 6 months ago

@Vagver

  1. Is the performance of both implementation the same as well? I see that yours is more recently updated.

I have tried to run the demo inference but there seems to be a mismatched of model? infer_res34_x128_xgz.yaml loads 'data/res18_x128_vert_xgz.pth' but the link provided is res34_x128_vert_xgz. Changing the name in the config causes an error: "Unexpected key(s) in state_dict:"

eververas commented 5 months ago

@HeChengHui

The links provided have been currently tested for the inference.py and test.py scripts in the root dir of the repo. The demo code will be updated soon.

The models provided by insightface have similar performance, but will be updated soon, too.

Echo-jyt commented 3 months ago

@Vagver

  1. Is the performance of both implementation the same as well? I see that yours is more recently updated.

I have tried to run the demo inference but there seems to be a mismatched of model? infer_res34_x128_xgz.yaml loads 'data/res18_x128_vert_xgz.pth' but the link provided is res34_x128_vert_xgz. Changing the name in the config causes an error: "Unexpected key(s) in state_dict:"

Hi, Did you get data/res18_x128_vert_xgz.pth?

HeChengHui commented 3 months ago

@Echo-jyt Nope. I am using the InsughtFace version. Have yet to check this repo for any updates.

Echo-jyt commented 3 months ago

@Echo-jyt Nope. I am using the InsughtFace version. Have yet to check this repo for any updates.

Can InsightFace run directly on video?

HeChengHui commented 3 months ago

@Echo-jyt Dont think so. Frames.

Echo-jyt commented 3 months ago

@Echo-jyt Dont think so. Frames.

OK , fine.Thanks!