WangYixuan12 / d3fields

[CoRL 24 Oral] D^3Fields: Dynamic 3D Descriptor Fields for Zero-Shot Generalizable Rearrangement
https://robopil.github.io/d3fields/
MIT License
129 stars 10 forks source link

Question about D^3 Fields' Semantic Representation Capabilities #8

Open QinengWang-Aiden opened 2 weeks ago

QinengWang-Aiden commented 2 weeks ago

I want to express my appreciation for this impressive work!

I have a specific question regarding the semantic representation capabilities of D^3 fields:

Can D^3 fields represent multiple semantic attributes at a single position? I'm particularly interested in scenarios involving multiple object properties, such as physical attributes and visual attributes.

To illustrate my question with a concrete example "shoe alignment task with three shoes":

In this scenario:

I would greatly appreciate any insights from you!

WangYixuan12 commented 2 weeks ago

Hi Qineng, thank you for your questions and interest in our work! For your first question - yes it can encode both color and semantic features. For your second question, yes you can do that. However, you may need to modify the correspondence rule yourself.