Closed XinandYu closed 1 year ago
Yes, sure. It seems that you haven't followed the instructions. Please read the README and download the smpl_models. Unfortunately, I cannot pack them in the repo or release them/make them automatically downloadable.
Sorry. But according to the instrction, there is only smpl_male. But it seems there is no update in the dataset processing. I can ru n the code on Dec but can't run after I download the new code this month again. Or did I make a mistake?
True using it now, I have pushed an untested fix.
Still the same error, is SMPL_NEUTRAL modal necessary in the interaction step?
Can you replace neutral with male in this file when the SMPL layer is called, line 77? If this work I can push the fix or you can make a pull request and I will accept it
I have a error when i get the result , the mesh out of playground, what can i do ?
From the beginning? I doubt so, I think I center the camera. I have no time these days to fix this but I can help you. Go to this file
and call this method of MeshViewer
inside the for loops that renders each image as mv.set_cam_trans(....trans=current_trans+body.mean())
that way it will move according to the mean of vertices.Access the intiial camera translation as mv.camera_node.translation. Hopefully, in that way it will follow the body.
In general, you have to fix the camera of pyrender to account for following the body.
Please please 🙏🏽 let me know about the fix and I cna incorporate it.
Thanks your reply,.The image occured in between, I use you provided model "teach", after i fix the error,i will tell you as fast as.
Let me know if it works. The high level bug is that I don't move the camera when the motion is happening so if you try long sequences with changes in translation eg 10 actions it is normal to happen. The fix I proposed moves the camera between actions or frames to follow the center of the body
my commond is python interact_teach.py folder=/home/beibeigh/Reserach/Projects/Projects_context/teach/path/to/experiment/teach output=/home/beibeigh/Reserach/Projects/Projects_context/teach/path/to/experiment/teach/test texts='["jump with left foot", "walk forward","sit down"]' durs='[2,2,2]', the mesh still go out
There should be something wrong with the camera or your update doesn't work. The key is to change the camera so that follows the mesh . The camera is pyrender camera inside meshviewer, I won't be able to push a fix until Tuesday Wednesday if you can wait. Otherwise this is the "bug". I suggest try tweaking the camera and see the result. If that doesn't work and urgently need it to work you can save generated I'm obj and visualize them with some code or interface it is easier for you to tweak
Can you replace neutral with male in this file when the SMPL layer is called, line 77? If this work I can push the fix or you can make a pull request and I will accept it
I have change the code,but I got the below error. Any help~
Global seed set to 1234
[24/03/23 15:23:50][main][INFO] - Loading model
[24/03/23 15:23:51][torch.distributed.nn.jit.instantiator][INFO] - Created a temporary directory at /tmp/tmpkc3t5dup
[24/03/23 15:23:51][torch.distributed.nn.jit.instantiator][INFO] - Writing /tmp/tmpkc3t5dup/_remote_module_non_scriptable.py
[24/03/23 15:23:52][main][INFO] - Model 'teach' loaded
[24/03/23 15:23:54][main][INFO] - Model weights restored
Global seed set to 0
Error executing job with overrides: ['folder=experiment/teach', 'output=output/teach', 'texts=[jump with left foot, walk forwards, sit down]', 'durs=[1.0, 1.0, 1.0]']
Traceback (most recent call last):
File "/group/20000/weidongyang/pose-estimation/teach/interact_teach.py", line 108, in
Pff, opengl errors are always tricky, hmm, try these:
os.environ['PYOPENGL_PLATFORM'] = 'egl'
os.environ['DISPLAY'] = ':0.0'
and os.environ['PYOPENGL_PLATFORM'] = 'egl'
os.environ['PYOPENGL_PLATFORM'] = 'osmesa'
Try each one separately and rerun your script and let me know. But this error is not on my side unfortunately 😞
set os.environ['PYOPENGL_PLATFORM'] = 'osmesa' is ok for me~
Hi, I notice you have fixed some codes. So I downloaded the latest code and found something wrong.![截图 2023-02-17 08-38-04](https://user-images.githubusercontent.com/117316302/219580634-277ea9d4-bee7-4e42-a128-652e06beda40.png)
Could you please have a look at this problem?