issues
search
vimalabs
/
VIMA
Official Algorithm Implementation of ICML'23 Paper "VIMA: General Robot Manipulation with Multimodal Prompts"
MIT License
778
stars
87
forks
source link
issues
Newest
Newest
Most commented
Recently updated
Oldest
Least commented
Least recently updated
LVLM Implementation
#58
GasolSun36
opened
2 months ago
0
How is the current inference frequency? Did someone try it on real world experiment?
#57
DeeDive
opened
5 months ago
0
Metrics related to evaluating the models.
#56
KangriX
opened
7 months ago
0
Dev
#55
Abhinav-Kotta
closed
7 months ago
0
Invalid GLX version: major 1, minor 2
#54
KangriX
closed
6 months ago
1
Implementation details of the loss scaling algorithm
#53
jiajingk
opened
8 months ago
1
How to eval the baseline？
#52
clawnotfound
opened
8 months ago
1
Action dim not match
#51
Chris-Chow
opened
9 months ago
2
Asking for better explanation
#50
Zero-coder
opened
11 months ago
2
Update requirements.txt
#49
Zero-coder
opened
11 months ago
0
Update example.py for better smoothing Installation
#48
Zero-coder
opened
11 months ago
0
ImportError: cannot import name 'checkpoint' from 'transformers.models.t5.modeling_t5'
#47
Dylan-LDR
opened
11 months ago
15
The order of object token is always same
#46
shure-dev
opened
11 months ago
0
Franka in Isaac-sim
#45
peter05010402
opened
1 year ago
1
The inference process of the VIMA strongly relies on the images in the prompts and objects in the environment
#44
shure-dev
opened
1 year ago
1
Behavior cloning
#43
ramon349
closed
1 year ago
2
Exception: Model "t5-base" on the Hub doesn't have a tokenizer
#42
2000222
closed
11 months ago
4
RuntimeError: Failed to reset environment after 10 retries
#41
zhaoyangninglilith
opened
1 year ago
3
Question: how to specific state or restore the state of the environment?
#40
LongXinKou
closed
10 months ago
0
Request for Guidance on Implementing imitation_loss
#39
nisshimura
closed
1 year ago
3
Some questions about the input observation
#38
wxz1996
closed
1 year ago
1
Update README.md add a specific example to evaluate
#37
erwincoumans
closed
1 year ago
1
Request for Training Code and Clarification on Parallelization & Batch Size
#36
nisshimura
closed
1 year ago
1
Question of the object encoding and training details
#35
JisuHann
closed
1 year ago
1
[Test] The test result is not consistent with that reported in paper.
#34
aopolin-lv
closed
1 year ago
11
[Evaluation] How to get the result reported in the paper
#33
aopolin-lv
closed
1 year ago
0
the physical meaning of the parameter 'actions'
#32
kaixin-bai
closed
1 year ago
1
About Success Rate calculating details
#31
Deaddawn
closed
1 year ago
2
Problems about using --device=cuda
#30
Deaddawn
closed
1 year ago
4
Questions about prompt and Mask-RCNN
#29
oxFFFF-Q
closed
1 year ago
1
How can we calculate the loss for vima?
#28
Mano176
closed
1 year ago
1
How do you tokenize the pose actions?
#27
amitkparekh
closed
1 year ago
2
Questions about VIMA Data Loading, RCNN Models, and Real-World Applications
#26
oxFFFF-Q
closed
1 year ago
2
Script/command for training?
#25
asmith26
closed
1 year ago
2
As the input are images of single objects, so how does the model know the relative position and distance between objects
#24
zhufq00
closed
1 year ago
1
The inputs are single objects but h
#23
zhufq00
closed
1 year ago
1
Update README.md
#22
eltociear
closed
1 year ago
0
An error is reported when running the demo, and other models also fail to load
#21
liuqinglong110
closed
1 year ago
1
Model "t5-base" on the Hub doesn't have a tokenizer
#20
lqiang2003cn
closed
1 year ago
7
How to construct dataset for training?
#19
oydontbecrazy
closed
1 year ago
5
Clarification Required on ckpt_path Parameter for Running Demo
#18
oxFFFF-Q
closed
1 year ago
0
how to solve this import error?
#17
torressliu
closed
1 year ago
1
Questions about the training and evaluation pipelines
#16
Ji4chenLi
closed
1 year ago
3
The detail of traning and evaluating process can be shared? How can I get a success rate?
#15
shure-dev
closed
1 year ago
2
ModuleNotFoundError: No module named 'vima_bench'
#14
YUHANG-Ma
closed
1 year ago
1
Can you release the Mask-RCNN model used for segmentation?
#13
amitkparekh
closed
1 year ago
1
Training Algorithm
#12
ciccio42
closed
1 year ago
5
The choice of the actiion decoder
#11
SiyuanHuang95
closed
1 year ago
3
could you release the code of real robot experiment?
#10
Bailey-24
closed
1 year ago
1
Training hyperparameters besides Table 6
#9
SiyuanHuang95
closed
1 year ago
9
Next