bennyguo / instant-nsr-pl

Neural Surface reconstruction based on Instant-NGP. Efficient and customizable boilerplate for your research projects. Train NeuS in 10min!
MIT License
851 stars 83 forks source link

Empty extracted obj #130

Open AlgoRhythm-X opened 6 months ago

AlgoRhythm-X commented 6 months ago

I am trying to train with my custom data but the extracted object file is empty (it opens but nothing is there). I was using 23 images when I got these results. First I run the img2poses file: python scripts/imgs2poses.py ./load/bmvs_dog # images are in ./load/bmvs_dog/images output:

`Need to run COLMAP
I0425 18:00:23.786562 29914 misc.cc:198] 
==============================================================================
Feature extraction
==============================================================================
I0425 18:00:24.199863 29918 feature_extraction.cc:255] Processed file [1/23]
I0425 18:00:24.199926 29918 feature_extraction.cc:258]   Name:            000000.png
I0425 18:00:24.199941 29918 feature_extraction.cc:284]   Dimensions:      1600 x 1200
I0425 18:00:24.199954 29918 feature_extraction.cc:287]   Camera:          #1 - SIMPLE_RADIAL
I0425 18:00:24.199970 29918 feature_extraction.cc:290]   Focal Length:    1920.00px
I0425 18:00:24.199992 29918 feature_extraction.cc:303]   Features:        9141
I0425 18:00:24.276440 29918 feature_extraction.cc:255] Processed file [2/23]
I0425 18:00:24.276490 29918 feature_extraction.cc:258]   Name:            000001.png
I0425 18:00:24.276506 29918 feature_extraction.cc:284]   Dimensions:      1600 x 1200
I0425 18:00:24.276520 29918 feature_extraction.cc:287]   Camera:          #1 - SIMPLE_RADIAL
I0425 18:00:24.276533 29918 feature_extraction.cc:290]   Focal Length:    1920.00px
I0425 18:00:24.276556 29918 feature_extraction.cc:303]   Features:        9965
I0425 18:00:24.349610 29918 feature_extraction.cc:255] Processed file [3/23]
I0425 18:00:24.350747 29918 feature_extraction.cc:258]   Name:            000002.png
I0425 18:00:24.350764 29918 feature_extraction.cc:284]   Dimensions:      1600 x 1200
I0425 18:00:24.350772 29918 feature_extraction.cc:287]   Camera:          #1 - SIMPLE_RADIAL
I0425 18:00:24.350781 29918 feature_extraction.cc:290]   Focal Length:    1920.00px
I0425 18:00:24.350801 29918 feature_extraction.cc:303]   Features:        6628
I0425 18:00:24.453512 29918 feature_extraction.cc:255] Processed file [4/23]
I0425 18:00:24.460233 29918 feature_extraction.cc:258]   Name:            000003.png
I0425 18:00:24.460263 29918 feature_extraction.cc:284]   Dimensions:      1600 x 1200
I0425 18:00:24.460271 29918 feature_extraction.cc:287]   Camera:          #1 - SIMPLE_RADIAL
I0425 18:00:24.460280 29918 feature_extraction.cc:290]   Focal Length:    1920.00px
I0425 18:00:24.460299 29918 feature_extraction.cc:303]   Features:        5055
I0425 18:00:24.623417 29918 feature_extraction.cc:255] Processed file [5/23]
I0425 18:00:24.623450 29918 feature_extraction.cc:258]   Name:            000004.png
I0425 18:00:24.623459 29918 feature_extraction.cc:284]   Dimensions:      1600 x 1200
I0425 18:00:24.623463 29918 feature_extraction.cc:287]   Camera:          #1 - SIMPLE_RADIAL
I0425 18:00:24.623468 29918 feature_extraction.cc:290]   Focal Length:    1920.00px
I0425 18:00:24.623483 29918 feature_extraction.cc:303]   Features:        5156
I0425 18:00:24.905103 29918 feature_extraction.cc:255] Processed file [6/23]
I0425 18:00:24.905160 29918 feature_extraction.cc:258]   Name:            000005.png
I0425 18:00:24.905175 29918 feature_extraction.cc:284]   Dimensions:      1600 x 1200
I0425 18:00:24.905187 29918 feature_extraction.cc:287]   Camera:          #1 - SIMPLE_RADIAL
I0425 18:00:24.905200 29918 feature_extraction.cc:290]   Focal Length:    1920.00px
I0425 18:00:24.905227 29918 feature_extraction.cc:303]   Features:        2275
I0425 18:00:24.906174 29918 feature_extraction.cc:255] Processed file [7/23]
I0425 18:00:24.906201 29918 feature_extraction.cc:258]   Name:            000006.png
I0425 18:00:24.906210 29918 feature_extraction.cc:284]   Dimensions:      1600 x 1200
I0425 18:00:24.906239 29918 feature_extraction.cc:287]   Camera:          #1 - SIMPLE_RADIAL
I0425 18:00:24.906248 29918 feature_extraction.cc:290]   Focal Length:    1920.00px
I0425 18:00:24.906261 29918 feature_extraction.cc:303]   Features:        3726
I0425 18:00:24.962646 29918 feature_extraction.cc:255] Processed file [8/23]
I0425 18:00:24.962675 29918 feature_extraction.cc:258]   Name:            000007.png
I0425 18:00:24.962684 29918 feature_extraction.cc:284]   Dimensions:      1600 x 1200
I0425 18:00:24.962692 29918 feature_extraction.cc:287]   Camera:          #1 - SIMPLE_RADIAL
I0425 18:00:24.962700 29918 feature_extraction.cc:290]   Focal Length:    1920.00px
I0425 18:00:24.962713 29918 feature_extraction.cc:303]   Features:        5256
I0425 18:00:25.024228 29918 feature_extraction.cc:255] Processed file [9/23]
I0425 18:00:25.024272 29918 feature_extraction.cc:258]   Name:            000008.png
I0425 18:00:25.024281 29918 feature_extraction.cc:284]   Dimensions:      1600 x 1200
I0425 18:00:25.024288 29918 feature_extraction.cc:287]   Camera:          #1 - SIMPLE_RADIAL
I0425 18:00:25.024297 29918 feature_extraction.cc:290]   Focal Length:    1920.00px
I0425 18:00:25.024310 29918 feature_extraction.cc:303]   Features:        8690
I0425 18:00:25.071779 29918 feature_extraction.cc:255] Processed file [10/23]
I0425 18:00:25.071820 29918 feature_extraction.cc:258]   Name:            000009.png
I0425 18:00:25.071830 29918 feature_extraction.cc:284]   Dimensions:      1600 x 1200
I0425 18:00:25.071837 29918 feature_extraction.cc:287]   Camera:          #1 - SIMPLE_RADIAL
I0425 18:00:25.071846 29918 feature_extraction.cc:290]   Focal Length:    1920.00px
I0425 18:00:25.071859 29918 feature_extraction.cc:303]   Features:        9896
I0425 18:00:25.137094 29918 feature_extraction.cc:255] Processed file [11/23]
I0425 18:00:25.137135 29918 feature_extraction.cc:258]   Name:            000010.png
I0425 18:00:25.137148 29918 feature_extraction.cc:284]   Dimensions:      1600 x 1200
I0425 18:00:25.137158 29918 feature_extraction.cc:287]   Camera:          #1 - SIMPLE_RADIAL
I0425 18:00:25.143236 29918 feature_extraction.cc:290]   Focal Length:    1920.00px
I0425 18:00:25.143272 29918 feature_extraction.cc:303]   Features:        10684
I0425 18:00:25.262234 29918 feature_extraction.cc:255] Processed file [12/23]
I0425 18:00:25.262269 29918 feature_extraction.cc:258]   Name:            000011.png
I0425 18:00:25.262279 29918 feature_extraction.cc:284]   Dimensions:      1600 x 1200
I0425 18:00:25.262285 29918 feature_extraction.cc:287]   Camera:          #1 - SIMPLE_RADIAL
I0425 18:00:25.262295 29918 feature_extraction.cc:290]   Focal Length:    1920.00px
I0425 18:00:25.262307 29918 feature_extraction.cc:303]   Features:        9474
I0425 18:00:25.267258 29918 feature_extraction.cc:255] Processed file [13/23]
I0425 18:00:25.267289 29918 feature_extraction.cc:258]   Name:            000012.png
I0425 18:00:25.267298 29918 feature_extraction.cc:284]   Dimensions:      1600 x 1200
I0425 18:00:25.267305 29918 feature_extraction.cc:287]   Camera:          #1 - SIMPLE_RADIAL
I0425 18:00:25.267320 29918 feature_extraction.cc:290]   Focal Length:    1920.00px
I0425 18:00:25.267333 29918 feature_extraction.cc:303]   Features:        9983
I0425 18:00:25.373262 29918 feature_extraction.cc:255] Processed file [14/23]
I0425 18:00:25.373304 29918 feature_extraction.cc:258]   Name:            000013.png
I0425 18:00:25.373312 29918 feature_extraction.cc:284]   Dimensions:      1600 x 1200
I0425 18:00:25.373317 29918 feature_extraction.cc:287]   Camera:          #1 - SIMPLE_RADIAL
I0425 18:00:25.373327 29918 feature_extraction.cc:290]   Focal Length:    1920.00px
I0425 18:00:25.373342 29918 feature_extraction.cc:303]   Features:        10147
I0425 18:00:25.751847 29918 feature_extraction.cc:255] Processed file [15/23]
I0425 18:00:25.751889 29918 feature_extraction.cc:258]   Name:            000014.png
I0425 18:00:25.751904 29918 feature_extraction.cc:284]   Dimensions:      1600 x 1200
I0425 18:00:25.751917 29918 feature_extraction.cc:287]   Camera:          #1 - SIMPLE_RADIAL
I0425 18:00:25.751930 29918 feature_extraction.cc:290]   Focal Length:    1920.00px
I0425 18:00:25.751952 29918 feature_extraction.cc:303]   Features:        10626
I0425 18:00:25.754889 29918 feature_extraction.cc:255] Processed file [16/23]
I0425 18:00:25.754915 29918 feature_extraction.cc:258]   Name:            000015.png
I0425 18:00:25.754923 29918 feature_extraction.cc:284]   Dimensions:      1600 x 1200
I0425 18:00:25.754930 29918 feature_extraction.cc:287]   Camera:          #1 - SIMPLE_RADIAL
I0425 18:00:25.754938 29918 feature_extraction.cc:290]   Focal Length:    1920.00px
I0425 18:00:25.754948 29918 feature_extraction.cc:303]   Features:        8881
I0425 18:00:25.800624 29918 feature_extraction.cc:255] Processed file [17/23]
I0425 18:00:25.800652 29918 feature_extraction.cc:258]   Name:            000016.png
I0425 18:00:25.800662 29918 feature_extraction.cc:284]   Dimensions:      1600 x 1200
I0425 18:00:25.800668 29918 feature_extraction.cc:287]   Camera:          #1 - SIMPLE_RADIAL
I0425 18:00:25.800678 29918 feature_extraction.cc:290]   Focal Length:    1920.00px
I0425 18:00:25.800688 29918 feature_extraction.cc:303]   Features:        6571
I0425 18:00:25.886762 29918 feature_extraction.cc:255] Processed file [18/23]
I0425 18:00:25.886811 29918 feature_extraction.cc:258]   Name:            000017.png
I0425 18:00:25.886821 29918 feature_extraction.cc:284]   Dimensions:      1600 x 1200
I0425 18:00:25.886827 29918 feature_extraction.cc:287]   Camera:          #1 - SIMPLE_RADIAL
I0425 18:00:25.886834 29918 feature_extraction.cc:290]   Focal Length:    1920.00px
I0425 18:00:25.886845 29918 feature_extraction.cc:303]   Features:        4236
I0425 18:00:25.888120 29918 feature_extraction.cc:255] Processed file [19/23]
I0425 18:00:25.888144 29918 feature_extraction.cc:258]   Name:            000018.png
I0425 18:00:25.888152 29918 feature_extraction.cc:284]   Dimensions:      1600 x 1200
I0425 18:00:25.888159 29918 feature_extraction.cc:287]   Camera:          #1 - SIMPLE_RADIAL
I0425 18:00:25.888166 29918 feature_extraction.cc:290]   Focal Length:    1920.00px
I0425 18:00:25.888176 29918 feature_extraction.cc:303]   Features:        2944
I0425 18:00:26.025004 29918 feature_extraction.cc:255] Processed file [20/23]
I0425 18:00:26.029333 29918 feature_extraction.cc:258]   Name:            000019.png
I0425 18:00:26.029357 29918 feature_extraction.cc:284]   Dimensions:      1600 x 1200
I0425 18:00:26.029366 29918 feature_extraction.cc:287]   Camera:          #1 - SIMPLE_RADIAL
I0425 18:00:26.029376 29918 feature_extraction.cc:290]   Focal Length:    1920.00px
I0425 18:00:26.029390 29918 feature_extraction.cc:303]   Features:        2055
I0425 18:00:26.030042 29918 feature_extraction.cc:255] Processed file [21/23]
I0425 18:00:26.030062 29918 feature_extraction.cc:258]   Name:            000020.png
I0425 18:00:26.030069 29918 feature_extraction.cc:284]   Dimensions:      1600 x 1200
I0425 18:00:26.030077 29918 feature_extraction.cc:287]   Camera:          #1 - SIMPLE_RADIAL
I0425 18:00:26.030086 29918 feature_extraction.cc:290]   Focal Length:    1920.00px
I0425 18:00:26.030097 29918 feature_extraction.cc:303]   Features:        2754
I0425 18:00:26.071935 29918 feature_extraction.cc:255] Processed file [22/23]
I0425 18:00:26.071964 29918 feature_extraction.cc:258]   Name:            000021.png
I0425 18:00:26.071970 29918 feature_extraction.cc:284]   Dimensions:      1600 x 1200
I0425 18:00:26.071976 29918 feature_extraction.cc:287]   Camera:          #1 - SIMPLE_RADIAL
I0425 18:00:26.071982 29918 feature_extraction.cc:290]   Focal Length:    1920.00px
I0425 18:00:26.071993 29918 feature_extraction.cc:303]   Features:        4343
I0425 18:00:26.120632 29918 feature_extraction.cc:255] Processed file [23/23]
I0425 18:00:26.120666 29918 feature_extraction.cc:258]   Name:            000022.png
I0425 18:00:26.120671 29918 feature_extraction.cc:284]   Dimensions:      1600 x 1200
I0425 18:00:26.120676 29918 feature_extraction.cc:287]   Camera:          #1 - SIMPLE_RADIAL
I0425 18:00:26.120682 29918 feature_extraction.cc:290]   Focal Length:    1920.00px
I0425 18:00:26.120692 29918 feature_extraction.cc:303]   Features:        7045
I0425 18:00:26.169898 29914 timer.cc:91] Elapsed time: 0.040 [minutes]
Features extracted
I0425 18:00:26.324311 29931 misc.cc:198] 
==============================================================================
Exhaustive feature matching
==============================================================================
I0425 18:00:26.533618 29931 feature_matching.cc:234] Matching block [1/1, 1/1]
I0425 18:00:33.660600 29931 feature_matching.cc:47]  in 7.127s
I0425 18:00:33.662482 29931 timer.cc:91] Elapsed time: 0.122 [minutes]
Features matched
I0425 18:00:33.747568 29966 incremental_mapper.cc:225] Loading database
I0425 18:00:33.749192 29966 database_cache.cc:65] Loading cameras...
I0425 18:00:33.749248 29966 database_cache.cc:75]  1 in 0.000s
I0425 18:00:33.749264 29966 database_cache.cc:83] Loading matches...
I0425 18:00:33.750439 29966 database_cache.cc:89]  188 in 0.001s
I0425 18:00:33.750459 29966 database_cache.cc:105] Loading images...
I0425 18:00:33.763101 29966 database_cache.cc:155]  23 in 0.013s (connected 23)
I0425 18:00:33.763129 29966 database_cache.cc:166] Building correspondence graph...
I0425 18:00:33.775928 29966 database_cache.cc:203]  in 0.013s (ignored 0)
I0425 18:00:33.775978 29966 timer.cc:91] Elapsed time: 0.000 [minutes]
I0425 18:00:33.778131 29966 incremental_mapper.cc:265] Finding good initial image pair
I0425 18:00:33.795753 29966 incremental_mapper.cc:289] Initializing with image pair #10 and #15
I0425 18:00:33.798981 29966 incremental_mapper.cc:294] Global bundle adjustment
I0425 18:00:34.108727 29966 incremental_mapper.cc:376] Registering image #14 (3)
I0425 18:00:34.108762 29966 incremental_mapper.cc:379] => Image sees 308 / 2127 points
I0425 18:00:34.562849 29966 incremental_mapper.cc:41] Retriangulation and Global bundle adjustment
I0425 18:00:34.635131 29966 incremental_mapper.cc:376] Registering image #11 (4)
I0425 18:00:34.635155 29966 incremental_mapper.cc:379] => Image sees 554 / 2242 points
I0425 18:00:34.799409 29966 incremental_mapper.cc:41] Retriangulation and Global bundle adjustment
I0425 18:00:34.903867 29966 incremental_mapper.cc:376] Registering image #13 (5)
I0425 18:00:34.903893 29966 incremental_mapper.cc:379] => Image sees 765 / 2088 points
I0425 18:00:35.195473 29966 incremental_mapper.cc:41] Retriangulation and Global bundle adjustment
I0425 18:00:35.335340 29966 incremental_mapper.cc:376] Registering image #12 (6)
I0425 18:00:35.335366 29966 incremental_mapper.cc:379] => Image sees 698 / 1422 points
I0425 18:00:35.551343 29966 incremental_mapper.cc:41] Retriangulation and Global bundle adjustment
I0425 18:00:35.718150 29966 incremental_mapper.cc:376] Registering image #1 (7)
I0425 18:00:35.718178 29966 incremental_mapper.cc:379] => Image sees 650 / 1408 points
I0425 18:00:36.168394 29966 incremental_mapper.cc:41] Retriangulation and Global bundle adjustment
I0425 18:00:36.362512 29966 incremental_mapper.cc:376] Registering image #2 (8)
I0425 18:00:36.362540 29966 incremental_mapper.cc:379] => Image sees 729 / 1875 points
I0425 18:00:36.765982 29966 incremental_mapper.cc:41] Retriangulation and Global bundle adjustment
I0425 18:00:36.991492 29966 incremental_mapper.cc:376] Registering image #9 (9)
I0425 18:00:36.991520 29966 incremental_mapper.cc:379] => Image sees 602 / 1881 points
I0425 18:00:37.261857 29966 incremental_mapper.cc:41] Retriangulation and Global bundle adjustment
I0425 18:00:37.532910 29966 incremental_mapper.cc:376] Registering image #16 (10)
I0425 18:00:37.532940 29966 incremental_mapper.cc:379] => Image sees 735 / 1876 points
I0425 18:00:37.852524 29966 incremental_mapper.cc:41] Retriangulation and Global bundle adjustment
I0425 18:00:38.143537 29966 incremental_mapper.cc:376] Registering image #3 (11)
I0425 18:00:38.143568 29966 incremental_mapper.cc:379] => Image sees 513 / 1190 points
I0425 18:00:38.391364 29966 incremental_mapper.cc:41] Retriangulation and Global bundle adjustment
I0425 18:00:38.691735 29966 incremental_mapper.cc:376] Registering image #8 (12)
I0425 18:00:38.691766 29966 incremental_mapper.cc:379] => Image sees 480 / 1205 points
I0425 18:00:39.022234 29966 incremental_mapper.cc:376] Registering image #17 (13)
I0425 18:00:39.022269 29966 incremental_mapper.cc:379] => Image sees 558 / 1568 points
I0425 18:00:39.535617 29966 incremental_mapper.cc:41] Retriangulation and Global bundle adjustment
I0425 18:00:40.174641 29966 incremental_mapper.cc:376] Registering image #23 (14)
I0425 18:00:40.175036 29966 incremental_mapper.cc:379] => Image sees 649 / 1383 points
I0425 18:00:40.648156 29966 incremental_mapper.cc:376] Registering image #22 (15)
I0425 18:00:40.648204 29966 incremental_mapper.cc:379] => Image sees 446 / 972 points
I0425 18:00:41.058521 29966 incremental_mapper.cc:41] Retriangulation and Global bundle adjustment
I0425 18:00:41.775250 29966 incremental_mapper.cc:376] Registering image #18 (16)
I0425 18:00:41.775292 29966 incremental_mapper.cc:379] => Image sees 508 / 1165 points
I0425 18:00:42.046187 29966 incremental_mapper.cc:376] Registering image #4 (17)
I0425 18:00:42.046231 29966 incremental_mapper.cc:379] => Image sees 356 / 876 points
I0425 18:00:42.296836 29966 incremental_mapper.cc:41] Retriangulation and Global bundle adjustment
I0425 18:00:42.729629 29966 incremental_mapper.cc:376] Registering image #7 (18)
I0425 18:00:42.729662 29966 incremental_mapper.cc:379] => Image sees 405 / 905 points
I0425 18:00:42.853981 29966 incremental_mapper.cc:376] Registering image #21 (19)
I0425 18:00:42.854018 29966 incremental_mapper.cc:379] => Image sees 462 / 741 points
I0425 18:00:42.990330 29966 incremental_mapper.cc:41] Retriangulation and Global bundle adjustment
I0425 18:00:43.400600 29966 incremental_mapper.cc:376] Registering image #19 (20)
I0425 18:00:43.400630 29966 incremental_mapper.cc:379] => Image sees 361 / 680 points
I0425 18:00:43.543157 29966 incremental_mapper.cc:376] Registering image #5 (21)
I0425 18:00:43.543185 29966 incremental_mapper.cc:379] => Image sees 299 / 558 points
I0425 18:00:43.637622 29966 incremental_mapper.cc:41] Retriangulation and Global bundle adjustment
I0425 18:00:44.211854 29966 incremental_mapper.cc:376] Registering image #20 (22)
I0425 18:00:44.211897 29966 incremental_mapper.cc:379] => Image sees 290 / 434 points
I0425 18:00:44.341912 29966 incremental_mapper.cc:376] Registering image #6 (23)
I0425 18:00:44.341940 29966 incremental_mapper.cc:379] => Image sees 179 / 286 points
I0425 18:00:44.450908 29966 incremental_mapper.cc:41] Retriangulation and Global bundle adjustment
I0425 18:00:44.986716 29966 timer.cc:91] Elapsed time: 0.187 [minutes]
Sparse map created
Finished running COLMAP, see /content/instant-nsr-pl/load/scan/colmap_output.txt for logs`

Then I run !python launch.py --config configs/nerf-colmap.yaml --gpu 0 --train with nerf-colmap.yaml configurations as follows. I also tried up_est_method: ground:


name: nerf-colmap-${basename:${dataset.root_dir}}
tag: ""
seed: 42

dataset:
  name: colmap
  root_dir: ./load/scan
  img_downscale: 4 # specify training image size by either img_wh or img_downscale
  up_est_method: camera # if true, use estimated ground plane normal direction as up direction
  center_est_method: lookat
  n_test_traj_steps: 120
  apply_mask: false
  load_data_on_gpu: true

model:
  name: nerf
  radius: 1.0
  num_samples_per_ray: 2048
  train_num_rays: 128
  max_train_num_rays: 8192
  grid_prune: true
  dynamic_ray_sampling: true
  batch_image_sampling: true
  randomized: true
  ray_chunk: 16384
  learned_background: true
  background_color: random
  geometry:
    name: volume-density
    radius: ${model.radius}
    feature_dim: 16
    density_activation: trunc_exp
    density_bias: -1
    isosurface:
      method: mc
      resolution: 256
      chunk: 2097152
      threshold: 5.0
    xyz_encoding_config:
      otype: HashGrid
      n_levels: 16
      n_features_per_level: 2
      log2_hashmap_size: 19
      base_resolution: 16
      per_level_scale: 1.447269237440378
    mlp_network_config:
      otype: FullyFusedMLP
      activation: ReLU
      output_activation: none
      n_neurons: 64
      n_hidden_layers: 1
  texture:
    name: volume-radiance
    input_feature_dim: ${model.geometry.feature_dim}
    dir_encoding_config:
      otype: SphericalHarmonics
      degree: 4
    mlp_network_config:
      otype: FullyFusedMLP
      activation: ReLU
      output_activation: Sigmoid
      n_neurons: 64
      n_hidden_layers: 2

system:
  name: nerf-system
  loss:
    lambda_rgb: 1.
    lambda_distortion: 0.001
  optimizer:
    name: AdamW
    args:
      lr: 0.01
      betas: [0.9, 0.99]
      eps: 1.e-15
  scheduler:
    name: MultiStepLR
    interval: step
    args:
      milestones: [10000, 15000, 18000]
      gamma: 0.33

checkpoint:
  save_top_k: -1
  every_n_train_steps: ${trainer.max_steps}

export:
  chunk_size: 2097152
  export_vertex_color: False

trainer:
  max_steps: 10000
  log_every_n_steps: 200
  num_sanity_val_steps: 0
  val_check_interval: 5000
  limit_train_batches: 1.0
  limit_val_batches: 2
  enable_progress_bar: true
  precision: 16
weihan1 commented 3 months ago

could u try printing the value of mesh["v_pos"]? after you do mesh=self.helper(...)