search

jiaw-z / CoR-GS

[ECCV'24] CoR-GS: Sparse-View 3D Gaussian Splatting via Co-Regularization
https://jiaw-z.github.io/CoR-GS/
Other
69 stars 5 forks source link

blender 数据集预处理 #24

Open lovejoker1102 opened 2 months ago

lovejoker1102 commented 2 months ago

请问 blender 是要自己先去跑一遍 colmap 稀疏重建之后再跑 colmap_blender这个脚本吗

jiaw-z commented 2 months ago

这个是不用的，colmap_blender.py用的是数据集提供的transforms_train.json，所以先将里面的相机参数转换为colmap格式进行稠密重建

lovejoker1102 commented 2 months ago

是需要先对数据的格式进行处理吗，我用原本的 nerf_synthetic数据集的格式会报错： cameras, images, points3D files do not exist at ../sparse/0/ Check failure stack trace: @ 0x7fc1ec7d31c3 google::LogMessage::Fail() @ 0x7fc1ec7d825b google::LogMessage::SendToLog() @ 0x7fc1ec7d2ebf google::LogMessage::Flush() @ 0x7fc1ec7d36ef google::LogMessageFatal::~LogMessageFatal() @ 0x5610c48a74a7 colmap::Reconstruction::Read() @ 0x5610c47de634 colmap::RunModelConverter() @ 0x5610c47afc42 main @ 0x7fc1ea380083 __libc_start_main @ 0x5610c47b9ede _start Aborted (core dumped) train_img_list is ['r_2.png', 'r_16.png', 'r_26.png', 'r_55.png', 'r_73.png', 'r_76.png', 'r_86.png', 'r_93.png'] cp: cannot stat '../images/r_2.png': No such file or directory cp: cannot stat '../images/r_16.png': No such file or directory cp: cannot stat '../images/r_26.png': No such file or directory cp: cannot stat '../images/r_55.png': No such file or directory cp: cannot stat '../images/r_73.png': No such file or directory cp: cannot stat '../images/r_76.png': No such file or directory cp: cannot stat '../images/r_86.png': No such file or directory cp: cannot stat '../images/r_93.png': No such file or directory cp: cannot stat '../blender2colmap/sparse/cameras.txt': No such file or directory feature load

jiaw-z commented 2 months ago

我进行了数据预处理，目的是用transform提供的pose进行mvs重建提供初始化。首先将train文件夹复制一份并重命名为images，之后的操作可以参考这个代码。

import numpy as np import json import os import imageio import math

H = 800 W = 800

blender2opencv = np.array([[1, 0, 0, 0], [0, -1, 0, 0], [0, 0, -1, 0], [0, 0, 0, 1]]) fnames = list(sorted(os.listdir('images'))) fname2pose = {}

with open('transforms_train.json', 'r') as f: meta = json.load(f)

fx = 0.5 W / np.tan(0.5 meta['camera_angle_x']) # original focal length if 'camera_angle_y' in meta: fy = 0.5 H / np.tan(0.5 meta['camera_angle_y']) # original focal length else: fy = fx if 'cx' in meta: cx, cy = meta['cx'], meta['cy'] else: cx = 0.5 W cy = 0.5 H with open('blender2colmap/sparse/cameras.txt', 'w') as f: f.write(f'1 PINHOLE {W} {H} {fx} {fy} {cx} {cy}')

with open('blender2colmap/sparse/points3D.txt', 'w') as f: f.write('')

GOTA404 commented 1 month ago

按照以上思路，我处理的数据是nerf_synthetic/ficus，预处理过程中出现特征匹配数为0的问题。

按照以上思路，我处理的数据是nerf_synthetic/ficus，预处理过程中出现特征匹配数为0的问题。
I0911 22:18:03.654870 65094 feature_extraction.cc:257] Processed file [1/8]
I0911 22:18:03.654948 65094 feature_extraction.cc:260]   Name:            r_26.png
I0911 22:18:03.654960 65094 feature_extraction.cc:286]   Dimensions:      800 x 800
I0911 22:18:03.654968 65094 feature_extraction.cc:289]   Camera:          #3 - SIMPLE_RADIAL
I0911 22:18:03.654989 65094 feature_extraction.cc:292]   Focal Length:    960.00px
I0911 22:18:03.655023 65094 feature_extraction.cc:296]   Features:        1112
I0911 22:18:03.782374 65094 feature_extraction.cc:257] Processed file [2/8]
I0911 22:18:03.782411 65094 feature_extraction.cc:260]   Name:            r_2.png
I0911 22:18:03.782423 65094 feature_extraction.cc:286]   Dimensions:      800 x 800
I0911 22:18:03.782431 65094 feature_extraction.cc:289]   Camera:          #2 - SIMPLE_RADIAL
I0911 22:18:03.782441 65094 feature_extraction.cc:292]   Focal Length:    960.00px
I0911 22:18:03.782464 65094 feature_extraction.cc:296]   Features:        1282
I0911 22:18:03.804888 65094 feature_extraction.cc:257] Processed file [3/8]
I0911 22:18:03.804924 65094 feature_extraction.cc:260]   Name:            r_55.png
I0911 22:18:03.804934 65094 feature_extraction.cc:286]   Dimensions:      800 x 800
I0911 22:18:03.804944 65094 feature_extraction.cc:289]   Camera:          #4 - SIMPLE_RADIAL
I0911 22:18:03.804952 65094 feature_extraction.cc:292]   Focal Length:    960.00px
I0911 22:18:03.804977 65094 feature_extraction.cc:296]   Features:        1146
I0911 22:18:03.822587 65094 feature_extraction.cc:257] Processed file [4/8]
I0911 22:18:03.822623 65094 feature_extraction.cc:260]   Name:            r_76.png
I0911 22:18:03.822634 65094 feature_extraction.cc:286]   Dimensions:      800 x 800
I0911 22:18:03.822643 65094 feature_extraction.cc:289]   Camera:          #6 - SIMPLE_RADIAL
I0911 22:18:03.822652 65094 feature_extraction.cc:292]   Focal Length:    960.00px
I0911 22:18:03.822675 65094 feature_extraction.cc:296]   Features:        1176
I0911 22:18:03.823763 65094 feature_extraction.cc:257] Processed file [5/8]
I0911 22:18:03.823786 65094 feature_extraction.cc:260]   Name:            r_16.png
I0911 22:18:03.823796 65094 feature_extraction.cc:286]   Dimensions:      800 x 800
I0911 22:18:03.823812 65094 feature_extraction.cc:289]   Camera:          #1 - SIMPLE_RADIAL
I0911 22:18:03.823820 65094 feature_extraction.cc:292]   Focal Length:    960.00px
I0911 22:18:03.823843 65094 feature_extraction.cc:296]   Features:        1200
I0911 22:18:03.984004 65094 feature_extraction.cc:257] Processed file [6/8]
I0911 22:18:03.984071 65094 feature_extraction.cc:260]   Name:            r_93.png
I0911 22:18:03.984082 65094 feature_extraction.cc:286]   Dimensions:      800 x 800
I0911 22:18:03.984090 65094 feature_extraction.cc:289]   Camera:          #8 - SIMPLE_RADIAL
I0911 22:18:03.984100 65094 feature_extraction.cc:292]   Focal Length:    960.00px
I0911 22:18:03.984117 65094 feature_extraction.cc:296]   Features:        1390
I0911 22:18:03.992869 65094 feature_extraction.cc:257] Processed file [7/8]
I0911 22:18:03.992905 65094 feature_extraction.cc:260]   Name:            r_86.png
I0911 22:18:03.992916 65094 feature_extraction.cc:286]   Dimensions:      800 x 800
I0911 22:18:03.992925 65094 feature_extraction.cc:289]   Camera:          #7 - SIMPLE_RADIAL
I0911 22:18:03.992934 65094 feature_extraction.cc:292]   Focal Length:    960.00px
I0911 22:18:03.992964 65094 feature_extraction.cc:296]   Features:        1363
I0911 22:18:04.002305 65094 feature_extraction.cc:257] Processed file [8/8]
I0911 22:18:04.002350 65094 feature_extraction.cc:260]   Name:            r_73.png
I0911 22:18:04.002362 65094 feature_extraction.cc:286]   Dimensions:      800 x 800
I0911 22:18:04.002378 65094 feature_extraction.cc:289]   Camera:          #5 - SIMPLE_RADIAL
I0911 22:18:04.002391 65094 feature_extraction.cc:292]   Focal Length:    960.00px
I0911 22:18:04.002416 65094 feature_extraction.cc:296]   Features:        1387
I0911 22:18:04.004369 64965 timer.cc:91] Elapsed time: 0.031 [minutes]
feature load
I0911 22:18:04.198740 65167 misc.cc:198] 
==============================================================================
Feature matching
==============================================================================
I0911 22:18:04.199151 65168 sift.cc:1451] Creating SIFT GPU feature matcher
I0911 22:18:04.199249 65169 sift.cc:1451] Creating SIFT GPU feature matcher
I0911 22:18:04.199357 65170 sift.cc:1451] Creating SIFT GPU feature matcher
I0911 22:18:04.199465 65172 sift.cc:1451] Creating SIFT GPU feature matcher
I0911 22:18:04.206179 65240 sift.cc:1451] Creating SIFT GPU feature matcher
I0911 22:18:04.206190 65238 sift.cc:1451] Creating SIFT GPU feature matcher
I0911 22:18:04.206271 65241 sift.cc:1451] Creating SIFT GPU feature matcher
I0911 22:18:04.206228 65239 sift.cc:1451] Creating SIFT GPU feature matcher
I0911 22:18:05.409224 65167 pairing.cc:168] Generating exhaustive image pairs...
I0911 22:18:05.409293 65167 pairing.cc:202] Matching block [1/1, 1/1]
I0911 22:18:05.416702 65167 feature_matching.cc:46]  in 0.007s
I0911 22:18:05.416812 65167 timer.cc:91] Elapsed time: 0.020 [minutes]
['r_26.png', 'r_2.png', 'r_55.png', 'r_76.png', 'r_16.png', 'r_93.png', 'r_86.png', 'r_73.png'] 
r_26.png
r_2.png
r_55.png
r_76.png
r_16.png
r_93.png
r_86.png
r_73.png
I0911 22:18:05.599144 65250 misc.cc:198] 
==============================================================================
Loading model
==============================================================================
I0911 22:18:05.606726 65250 incremental_mapper.cc:225] Loading database
I0911 22:18:05.608363 65250 database_cache.cc:65] Loading cameras...
I0911 22:18:05.608444 65250 database_cache.cc:75]  8 in 0.000s
I0911 22:18:05.608472 65250 database_cache.cc:83] Loading matches...
I0911 22:18:05.608510 65250 database_cache.cc:89]  0 in 0.000s
I0911 22:18:05.608529 65250 database_cache.cc:105] Loading images...
I0911 22:18:05.608608 65250 database_cache.cc:155]  8 in 0.000s (connected 0)
I0911 22:18:05.608634 65250 database_cache.cc:166] Building correspondence graph...
I0911 22:18:05.608650 65250 database_cache.cc:195]  in 0.000s (ignored 0)
I0911 22:18:05.608664 65250 timer.cc:91] Elapsed time: 0.000 [minutes]
W0911 22:18:05.608683 65250 incremental_mapper.cc:247] No images with matches found in the database
E0911 22:18:05.608915 65250 incremental_mapper.cc:542] Check failed: LoadDatabase() 
terminate called after throwing an instance of 'std::invalid_argument'
  what():  [incremental_mapper.cc:542] Check failed: LoadDatabase() 
*** Aborted at 1726064285 (unix time) try "date -d @1726064285" if you are using GNU date ***
PC: @     0x7ff9a222f8eb gsignal
*** SIGABRT (@0x3e80000fee2) received by PID 65250 (TID 0x7ff9827b4000) from PID 65250; stack trace: ***
    @     0x7ff9cd7c3730 (unknown)
    @     0x7ff9a222f8eb gsignal
    @     0x7ff9a221a535 abort
    @     0x7ff9a27fe646 (unknown)
    @     0x7ff9a280ff06 (unknown)
    @     0x7ff9a280ff71 std::terminate()
    @     0x7ff9a28101b4 __cxa_throw
    @     0x560d7f31027c (unknown)
    @     0x560d7f36dd19 (unknown)
    @     0x560d7f36e28d (unknown)
    @     0x560d7f35117b (unknown)
    @     0x7ff9a221c09b __libc_start_main
    @     0x560d7f357f9a (unknown)
Aborted (core dumped)
E0911 22:18:05.808089 65316 reconstruction.cc:539] cameras, images, points3D files do not exist at triangulated
terminate called after throwing an instance of 'std::invalid_argument'
  what():  [reconstruction.cc:539] cameras, images, points3D files do not exist at triangulated
*** Aborted at 1726064285 (unix time) try "date -d @1726064285" if you are using GNU date ***
PC: @     0x7f81c55c98eb gsignal
*** SIGABRT (@0x3e80000ff24) received by PID 65316 (TID 0x7f81a5b4e000) from PID 65316; stack trace: ***
    @     0x7f81f0b5d730 (unknown)
    @     0x7f81c55c98eb gsignal
    @     0x7f81c55b4535 abort
    @     0x7f81c5b98646 (unknown)
    @     0x7f81c5ba9f06 (unknown)
    @     0x7f81c5ba9f71 std::terminate()
    @     0x7f81c5baa1b4 __cxa_throw
    @     0x55e0dc56ef2b (unknown)
    @     0x55e0dc5ecb08 (unknown)
    @     0x55e0dc5a817b (unknown)
    @     0x7f81c55b609b __libc_start_main
    @     0x55e0dc5aef9a (unknown)
Aborted (core dumped)
I0911 22:18:06.008960 65382 misc.cc:198] 
==============================================================================
shaonian123daly commented 1 month ago

你好，请问你解决了吗