PerceivingSystems / bedlam_clothing

Other
22 stars 1 forks source link

Inquiry Regarding the clothing simulation #1

Open jdyjjj opened 10 months ago

jdyjjj commented 10 months ago

Dear Author,

I saw your pipeline in your paper as shown in the following picture: image But I couldn't find the code for the process from b to c(clothing simulation) in your code repository. Could you please give me some help with this issue? I would be extremely grateful.

gfgb commented 10 months ago

Hi jdyjjj,

For clothing simulation we used CLO. This is a commercial software and it requires you to buy a license. We rely on commercial software in order to be able to simulate complex outfits (e.g. outfits having multiple colliding layers) in the most realistic way possible; furthermore, the outfits we have were specifically made in CLO by a 3D artist. We share the CLO project files and other clothing data on the BEDLAM website.

This part of the pipeline is highly dependent on the software you use and quite complex to automate for large amounts of motions due to the lack of a comprehensive API for most clothing simulation software, so we rely on pyautogui scripts. Thus we do not share code to run the simulations, and you should look into clothing simulation tools yourself to find the option that best suits your use-case.

If you have the possibility of using CLO, you will need two main ingredients to run a simulation:

We preprocess the motions before running the simulation in CLO. This preprocessing step involves retargeting the skeleton, having the motion starting from A-pose and removing the hands from the body mesh (as they tend to get stuck in the garments and break the simulation easily). We plan on sharing scripts to make this step clearer by the end of January.