Closed jliuliu closed 1 year ago
Can you try giving it a list of texts? like texts=['some action description']
.
The model is inside .hydra config if you download as I describe in my instructions.
ps: I assume you want to correct root for foot [?], also you really want to save the sample in you /
directory and not your ./
?
Hi, Thanks for your reply, follow your instructions:
git clone https://github.com/athn-nik/teach.git
, but I not found .hydra in working dirhydra: run: dir: . output_subdir: null
seed: 1234
folder: ??? # the fps used during training texts: ??? output: ??? durs:
- 1
- 1.5
- 2
- 3
- 4
- 5 train_fps: 30 last_ckpt_path: \$ {get_last_checkpoint:\${folder}} samples: 1 logger_level: INFO slerp_ws: 8
# joints / vertices / smpl repr_type: 'smpl'
# Composing nested config with default defaults:
- data: null
- machine: server
- trainer: null
- pose2joints: null
- sampler: all_conseq
- /path@path
- override hydra/job_logging: custom
- override hydra/hydra_logging: custom
- self
data.batch_size: 1
Ah, I see now. You must follow the detailed instructions in the README to be able to run it. You need a checkpoint and a configuration. Please look here. After downloading the teach checkpoints and configuration you must put them in a folder that looks like:
experiment
│
└───.hydra
│ | config.yaml
| | overrides.yaml
| | hydra.yaml
|
└───checkpoints
│ last.ckpt
In the website there are the Joint Independent and TEACH checkpoints.
Thanks, I solved above problem, but I met new problem like this:
Traceback (most recent call last):
File "/teach/interact_teach.py", line 109, in
data
|-- amass
| -- your-processed-amass-data
|
|-- babel
| -- babel-teach
| `...
| -- babel-smplh-30fps-male
| ...
|
|-- smpl_models
| -- smplh
| --SMPLH_MALE.pkl
| -- smpl **(NEW)**
| -- SMPL_NEUTRAL.pkl **(NEW)**
I add smpl/SMPL_NEUTRAL.pkl, because /teach/teach/render/mesh_viz.py, line 79: smpl = get_body_model(path=f'{get_original_cwd()}/data/smpl_models',model_type='smpl', gender='neutral', batch_size=1, device='cpu')
So, I suspect a mismatch between generate vertices and smpl model .
Hmm, I see that you are using conda and not virtualenv and also python3.9. Let's try top debug this, but it is always better to follow the official instructions so I can handle it on my machine also. I am using SMPLH_MALE, no need to actually use smplh because the visualization function takes the vertices directly. Can you try printing the shape of mesh_rec
, and also make sure that you have pull my latest changes.
Seems inactive for quite a while @jliuliu . Let me know if I should take action or close this
it's ok, thanks very much
cmd: python interact_teach.py folder=/teach output=/teach texts='jump with left root' durs='[2]'
Error executing job with overrides: ['folder=/teach', 'output=/teach', 'texts=jump with left root', 'durs=[2]'] Traceback (most recent call last): File "/teach/interact_teach.py", line 35, in _interact return interact(cfg) File "/teach/interact_teach.py", line 58, in interact model = instantiate(cfg.model, omegaconf.errors.ConfigAttributeError: Key 'model' is not in struct full_key: model object_type=dict
Set the environment variable HYDRA_FULL_ERROR=1 for a complete stack trace.
It seems that key "model" is not includeed in the configure file configs/interact_teach.yaml