Yuliang Xiu
·
Yufei Ye
·
Zhen Liu
·
Dimitris Tzionas
·
Michael J. Black
scripts/env.sh
.# For custom data
bash scripts/run.sh data/human/yuliang results/human/yuliang human_yuliang
# For PuzzleIOI
bash scripts/run.sh data/PuzzleIOI/puzzle_capture/03632/outfit13 results/PuzzleIOI/puzzle_capture/03632/outfit13 03632_outfit13
The results will be saved in the experiment folder results/human/yuliang
, and results/PuzzleIOI/puzzle_capture/03632/outfit13
.
bash scripts/fetch_data.sh
# render the reconstruction results (4 views)
# If the rendering process is stuck, please refer to the changes for PRT computation:
# https://github.com/YuliangXiu/ICON/pull/237/files
python -m render.render_batch_result -headless -out_dir ./results/ -split test
python -m multi_concepts.benchmark -split test
## Acknowledgment
This implementation is built based on [TeCH](https://github.com/huangyangyi/TeCH), [Break-A-Scene](https://github.com/google/break-a-scene), [Grounded SAM](https://github.com/IDEA-Research/Grounded-Segment-Anything), [GPT-4V(ision)](https://openai.com/index/gpt-4v-system-card/), [Stable Diffusion 2-1-base](https://huggingface.co/stabilityai/stable-diffusion-2-1-base), [BOFT-DreamBooth](https://github.com/huggingface/peft/blob/main/examples/boft_dreambooth/train_dreambooth.py), [Stable Dreamfusion](https://github.com/ashawkey/stable-dreamfusion), [ECON](https://github.com/YuliangXiu/ECON).
This project has received funding from the European Union’s Horizon 2020 research and innovation programme under the Marie Skłodowska-Curie grant agreement No.860768 ([CLIPE Project](https://www.clipe-itn.eu))
Kudos to all of our amazing contributors! PuzzleAvatar thrives through open-source. In that spirit, we welcome all kinds of contributions from the community.
<a href="https://github.com/yuliangxiu/PuzzleAvatar/graphs/contributors">
<img src="https://contrib.rocks/image?repo=yuliangxiu/PuzzleAvatar" />
</a>
_Contributor avatars are randomly shuffled._
## License
This code and model are available for non-commercial scientific research purposes as defined in the [LICENSE](LICENSE) file. By downloading and using the code and model you agree to the terms in the [LICENSE](LICENSE).
## Disclosure
MJB has received research gift funds from Adobe, Intel, Nvidia, Meta/Facebook, and Amazon. MJB has financial interests in Amazon and Meshcapade GmbH. While MJB is a co-founder and Chief Scientist at Meshcapade, his research in this project was performed solely at, and funded solely by, the Max Planck Society.
## Contact
For technical questions, please contact yuliang.xiu@tue.mpg.de
For commercial licensing, please contact ps-licensing@tue.mpg.de
## Citation
```bibtex
@article{xiu2024puzzleavatar,
title={PuzzleAvatar: Assembling 3D Avatars from Personal Albums},
author={Xiu, Yuliang and Ye, Yufei and Liu, Zhen and Tzionas, Dimitrios and Black, Michael J},
journal={ACM Transactions on Graphics (TOG)},
year={2024},
publisher={ACM New York, NY, USA}
}
PuzzleAvatar is mainly built upon TeCH, please also kindly cite it
@inproceedings{huang2024tech,
title={{TeCH: Text-guided Reconstruction of Lifelike Clothed Humans}},
author={Huang, Yangyi and Yi, Hongwei and Xiu, Yuliang and Liao, Tingting and Tang, Jiaxiang and Cai, Deng and Thies, Justus},
booktitle={International Conference on 3D Vision (3DV)},
year={2024}
}