search

alibaba-damo-academy / self-supervised-anatomical-embedding-v2

MIT License
50 stars 4 forks source link

Anatomical embedding for 2D and 3D medical data #3

Closed nifla2000 closed 9 months ago

nifla2000 commented 9 months ago

Thanks for this interesting work! I'm in a specific task where I need to obtain matching landmarks between an Ultrasound sweep/frame and a paired CT volume. Would you think this repository can be useful in my problem as you did it only for 3D data? Appreciate your response.

viggin commented 9 months ago

I am not familiar with CT-US matching. If you ask for my suggestion, I think you may refer to the cross-modality matching pipeline in our paper. For example, you can first generate some simulated US images from CT (https://campar.in.tum.de/pub/wein2008ctusfusion/wein2008ctusfusion.pdf) and use the generated CT-US pairs to train an initial CrossSAM model. Then, you may need some non-rigid registration finetuning using specialized similarity metrics and auxiliary organ masks (https://aapm.onlinelibrary.wiley.com/doi/abs/10.1002/mp.16396).