Open Hunanbean opened 4 years ago
Thank you for your detailed report @Hunanbean ! and sorry for my late reply.
It seems that the output of OpenFace has changed in newer versions, and I didn't test this. I'll get back to you once I've figured out (and hopefully fixed) the issue.
Sounds great. thanks a bunch!
If I understand correctly, the issue before the edit:
The .csv data generated by openface_2.1.0_zeromg is not compatible with the input_facsfromcsv interpreter. The demo.csv data works perfectly, and captures keyframes. I can also locally stream from OpenFaceOffline to blender directly from a video file, but this method does not capture keyframes
is unrelated to the issue found in the "EDIT" right? In case of the pre-EDIT issue, please check this issue: https://github.com/NumesSanguis/FACSvatar/issues/25
I still have to analyse your "EDIT" issue. Can you tell me your Pandas
version?
Correct, it seems to be an unrelated issue. pandas 1.0.5
Thank you
Got my new Windows 10 PC setup
this method is only capturing keyframes if you start the OpenFace program after you set the Blender plugin to connected and tick insert keyframes. If the Openface program was open before you set the plugin, it seems as though the signal to capture frames does not get through. So, in order to get key frame capture when streaming a video from OpenFace, it seems you must have blender open and set to connected, and insert key frames checked before you open OpenFace at all.
I think it actually does capture the keyframes. It uses the message number to determine the insert location (if I remember correctly). The confusing part is that if you activate Insert key frames
after OpenFace has send 260 messages, you don't see it on the timeline unless you zoom out.
Could you try zooming out and see if the keyframes are indeed inserted at later frames?
Hmm, I guess I can add a toggle to the menu that does either "Insert at current frame" or "Match message number to frame number".
When trying to send a .csv i generated with the same OpenFace through input_facsfromcsv/main.py, errors are as follows
From the Pandas dataframe output, it seems that it is using the uncleaned .csv.
input_facsfromcsv
assumes that everything in a folder that ends with _clean
, has already been processed. So if you put your new .csv in input_facsfromcsv/openface/default_clean/
, it won't work. You need to put it e.g. in a folder input_facsfromcsv/openface/some_folder/myrec.csv
.
Could you try if putting your new .csv in a different named folder solved your issue?
The .csv data generated by openface_2.1.0_zeromg is not compatible with the input_facsfromcsv interpreter. The demo.csv data works perfectly, and captures keyframes. I can also locally stream from OpenFaceOffline to blender directly from a video file, but this method does not capture keyframes
EDIT: this method is only capturing keyframes if you start the OpenFace program after you set the Blender plugin to connected and tick insert keyframes. If the Openface program was open before you set the plugin, it seems as though the signal to capture frames does not get through. So, in order to get key frame capture when streaming a video from OpenFace, it seems you must have blender open and set to connected, and insert key frames checked before you open OpenFace at all.
When trying to send a .csv i generated with the same OpenFace through input_facsfromcsv/main.py, errors are as follows
Thank you, and all who are involved in this project and OpenFace itself, very much for your talent and hard work. This really is an amazing project with top tier performance.