Closed minsu1206 closed 4 months ago
I encountered the same problem when preprocessing the room and kitchen datasets in mipnerf360. I use RTX 3090 24G.
Hi, could you share the OOM (Out of Memory) error logs? That way, I can help figure out what went wrong.
My error logs:
./data/mipnerf360/kitchen/images
100%|████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 278/278 [00:29<00:00, 9.50it/s]
Scales: 100%|████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 7/7 [3:06:22<00:00, 1597.57s/it]
[DinoExtractor] Loading failed. Extracting ...
Using cache found in /home/zhangshuai/.cache/torch/hub/facebookresearch_dino_main
1%|▉ | 1/139 [00:01<02:52, 1.25s/it]
Traceback (most recent call last):
File "quantize_features.py", line 153, in
Hi, I think you can try a bigger stride (like 4) below: https://github.com/buaavrcg/LEGaussians/blob/e2e5e49d7845e34811d0d805aaf637d02b43f6a7/preprocess/dino/dino_dataloader.py#L15 This way, you may get a lower reslution dino feature map, like [N, 384, 55, 83].
Thanks for your quick reply, my problem is solved.
Samer for me. I'll close the issue. Thank you !
Excellent work. I have a few inquiries. Is the preprocessing stage significantly impactful on the ultimate outcomes? How can one replicate the findings as presented in the paper? Could you provide a preprocessed version for release? @Chuan-10
Yes, the preprocessing stage is crucial. The preprocessing instructions can be found in the readme, which is quite clear. To reproduce the paper's results, follow the readme for training and evaluating the model. Although the visualization code for the relevance map is not included, generating the heatmap from the relevancy map in the evaluation output is straightforward. We intend to release a preprocessed version later, but currently, our team is occupied with other tasks. We apologize for the inconvenience. If you have any specific problems, feel free to open an issue to discuss it. We are willing to help you.
Hi
I am using A5000 24GB for preprocessing but I met OOM issue at the first batch (indeed, it's a single image) during preprocessing. I don't think CLIP and DINO used at here are too large model to meet this issue.
How much do I need to do preprocessing ? Or , How could I fix this error ?
Thanks in advance.