search

wanmeihuali / taichi_3d_gaussian_splatting

An unofficial implementation of paper 3D Gaussian Splatting for Real-Time Radiance Field Rendering by taichi lang.
Apache License 2.0
659 stars 62 forks source link

Try add depth cov loss to improve quality #142

Closed wanmeihuali closed 12 months ago

github-actions[bot] commented 12 months ago

Running experiment on sagemaker with git sha a63d1f640d6102ab89aaaf2bf88af74327cce2bc

github-actions[bot] commented 12 months ago

Running experiment on sagemaker with git sha a63d1f640d6102ab89aaaf2bf88af74327cce2bc

github-actions[bot] commented 12 months ago

Training job depth-cov-a63d1f6-231009-042214-tat-truck-baseline created

github-actions[bot] commented 12 months ago

Training job depth-cov-a63d1f6-231009-042215-tat-train-baseline created

github-actions[bot] commented 12 months ago

Training job depth-cov-a63d1f6-231009-042215-tat-train-baseline failed

github-actions[bot] commented 12 months ago

Training job depth-cov-a63d1f6-231009-042215-tat-train-baseline final metrics:

github-actions[bot] commented 12 months ago

Training job depth-cov-a63d1f6-231009-042214-tat-truck-baseline failed

github-actions[bot] commented 12 months ago

Training job depth-cov-a63d1f6-231009-042214-tat-truck-baseline final metrics:

github-actions[bot] commented 12 months ago

Running experiment on sagemaker with git sha 2bc0ca3ba26b088b958246f7bc70d173306d8596

github-actions[bot] commented 12 months ago

Training job depth-cov-2bc0ca3-231009-064244-tat-truck-baseline created

github-actions[bot] commented 12 months ago

Training job depth-cov-2bc0ca3-231009-064244-tat-truck-baseline completed.

Model url: s3://taichi-3d-gaussian-splatting-log/tat-truck-baseline/depth-cov-2bc0ca3-231009-064244-tat-truck-baseline/output/model.tar.gz,

tensorboard output path: s3://taichi-3d-gaussian-splatting-log/tat-truck-baseline/depth-cov-2bc0ca3-231009-064244-tat-truck-baseline/output/output.tar.gz

github-actions[bot] commented 12 months ago

Training job depth-cov-2bc0ca3-231009-064244-tat-truck-baseline final metrics:

Latest Metrics

train:iteration train:l1loss train:loss train:num_valid_points train:psnr train:ssim train:ssimloss val:loss val:psnr val:ssim
30000.0 0.030032416805624962 0.046577088534832 442648.0 25.216562271118164 0.8872442245483398 0.11275577545166016 0.053330935537815094 25.173946380615234 0.8663384318351746

Max Metrics

train:5kpsnr train:5kssim train:7kpsnr train:7kssim train:psnr train:ssim val:5kpsnr val:5kssim val:7kpsnr val:7kssim val:psnr val:ssim
23.587406158447266 0.8418027758598328 23.745681762695312 0.7673179507255554 25.216562271118164 0.8872442245483398 23.048681259155273 0.8147985935211182 23.796051025390625 0.836073637008667 25.173946380615234 0.8663384318351746
github-actions[bot] commented 12 months ago

Running experiment on sagemaker with git sha 2bc0ca3ba26b088b958246f7bc70d173306d8596

github-actions[bot] commented 12 months ago

Training job depth-cov-2bc0ca3-231009-182444-bicycle created

github-actions[bot] commented 12 months ago

Running experiment on sagemaker with git sha 2bc0ca3ba26b088b958246f7bc70d173306d8596

github-actions[bot] commented 12 months ago

Training job depth-cov-2bc0ca3-231009-182458-garden created

github-actions[bot] commented 12 months ago

Running experiment on sagemaker with git sha 2bc0ca3ba26b088b958246f7bc70d173306d8596

github-actions[bot] commented 12 months ago

Training job depth-cov-2bc0ca3-231009-182500-tat-truck-baseline created

github-actions[bot] commented 12 months ago

Running experiment on sagemaker with git sha 2bc0ca3ba26b088b958246f7bc70d173306d8596

github-actions[bot] commented 12 months ago

Training job depth-cov-2bc0ca3-231009-182502-stump created

github-actions[bot] commented 12 months ago

Running experiment on sagemaker with git sha 2bc0ca3ba26b088b958246f7bc70d173306d8596

github-actions[bot] commented 12 months ago

Training job depth-cov-2bc0ca3-231009-182602-tat-train-baseline created

github-actions[bot] commented 12 months ago

Training job depth-cov-2bc0ca3-231009-182502-stump completed.

Model url: s3://taichi-3d-gaussian-splatting-log/stump/depth-cov-2bc0ca3-231009-182502-stump/output/model.tar.gz,

tensorboard output path: s3://taichi-3d-gaussian-splatting-log/stump/depth-cov-2bc0ca3-231009-182502-stump/output/output.tar.gz

github-actions[bot] commented 12 months ago

Training job depth-cov-2bc0ca3-231009-182502-stump final metrics:

Latest Metrics

train:iteration train:l1loss train:loss train:num_valid_points train:psnr train:ssim train:ssimloss val:loss val:psnr val:ssim
30000.0 0.0435270331799984 0.09709561616182327 420490.0 21.480112075805664 0.6886300444602966 0.31136995553970337 0.08620989322662354 25.267906188964844 0.7193743586540222

Max Metrics

train:5kpsnr train:5kssim train:7kpsnr train:7kssim train:psnr train:ssim val:5kpsnr val:5kssim val:7kpsnr val:7kssim val:psnr val:ssim
22.333518981933594 0.5448217391967773 18.99127197265625 0.5716498494148254 21.480112075805664 0.6886300444602966 23.60395050048828 0.6109822392463684 24.181747436523438 0.6468366384506226 25.267906188964844 0.7193743586540222
github-actions[bot] commented 12 months ago

Training job depth-cov-2bc0ca3-231009-182500-tat-truck-baseline completed.

Model url: s3://taichi-3d-gaussian-splatting-log/tat-truck-baseline/depth-cov-2bc0ca3-231009-182500-tat-truck-baseline/output/model.tar.gz,

tensorboard output path: s3://taichi-3d-gaussian-splatting-log/tat-truck-baseline/depth-cov-2bc0ca3-231009-182500-tat-truck-baseline/output/output.tar.gz

github-actions[bot] commented 12 months ago

Training job depth-cov-2bc0ca3-231009-182500-tat-truck-baseline final metrics:

Latest Metrics

train:iteration train:l1loss train:loss train:num_valid_points train:psnr train:ssim train:ssimloss val:loss val:psnr val:ssim
30000.0 0.02797527052462101 0.043598707765340805 438508.0 27.26865577697754 0.8939075469970703 0.10609245300292969 0.05406559631228447 25.1103458404541 0.8652971386909485

Max Metrics

train:5kpsnr train:5kssim train:7kpsnr train:7kssim train:psnr train:ssim val:5kpsnr val:5kssim val:7kpsnr val:7kssim val:psnr val:ssim
23.45797348022461 0.837868869304657 24.361480712890625 0.8570294380187988 27.26865577697754 0.8939075469970703 23.038990020751953 0.8133655190467834 23.702497482299805 0.8342337012290955 25.1103458404541 0.8652971386909485
github-actions[bot] commented 12 months ago

Training job depth-cov-2bc0ca3-231009-182444-bicycle completed.

Model url: s3://taichi-3d-gaussian-splatting-log/bicycle/depth-cov-2bc0ca3-231009-182444-bicycle/output/model.tar.gz,

tensorboard output path: s3://taichi-3d-gaussian-splatting-log/bicycle/depth-cov-2bc0ca3-231009-182444-bicycle/output/output.tar.gz

github-actions[bot] commented 12 months ago

Training job depth-cov-2bc0ca3-231009-182444-bicycle final metrics:

Latest Metrics

train:iteration train:l1loss train:loss train:num_valid_points train:psnr train:ssim train:ssimloss val:loss val:psnr val:ssim
30000.0 0.04101252928376198 0.09353327751159668 493619.0 23.156137466430664 0.6963837146759033 0.3036162853240967 0.0944795310497284 24.421031951904297 0.7000489234924316

Max Metrics

train:5kpsnr train:5kssim train:7kpsnr train:7kssim train:psnr train:ssim val:5kpsnr val:5kssim val:7kpsnr val:7kssim val:psnr val:ssim
15.774374008178711 0.4339006841182709 24.459922790527344 0.6456183195114136 23.156137466430664 0.6963837146759033 22.407760620117188 0.5648437142372131 22.973432540893555 0.6073026657104492 24.421031951904297 0.7000489234924316
github-actions[bot] commented 12 months ago

Training job depth-cov-2bc0ca3-231009-182602-tat-train-baseline completed.

Model url: s3://taichi-3d-gaussian-splatting-log/tat-train-baseline/depth-cov-2bc0ca3-231009-182602-tat-train-baseline/output/model.tar.gz,

tensorboard output path: s3://taichi-3d-gaussian-splatting-log/tat-train-baseline/depth-cov-2bc0ca3-231009-182602-tat-train-baseline/output/output.tar.gz

github-actions[bot] commented 12 months ago

Training job depth-cov-2bc0ca3-231009-182602-tat-train-baseline final metrics:

Latest Metrics

train:iteration train:l1loss train:loss train:num_valid_points train:psnr train:ssim train:ssimloss val:loss val:psnr val:ssim
30000.0 0.11023814231157303 0.1324193775653839 670207.0 16.892072677612305 0.7788556814193726 0.22114431858062744 0.10047636181116104 20.918642044067383 0.801039457321167

Max Metrics

train:5kpsnr train:5kssim train:7kpsnr train:7kssim train:psnr train:ssim val:5kpsnr val:5kssim val:7kpsnr val:7kssim val:psnr val:ssim
25.7470703125 0.912357747554779 20.638023376464844 0.8425439596176147 16.892072677612305 0.7788556814193726 19.05611801147461 0.7308907508850098 19.8507080078125 0.7578971982002258 20.918642044067383 0.801039457321167
github-actions[bot] commented 12 months ago

Training job depth-cov-2bc0ca3-231009-182458-garden completed.

Model url: s3://taichi-3d-gaussian-splatting-log/garden/depth-cov-2bc0ca3-231009-182458-garden/output/model.tar.gz,

tensorboard output path: s3://taichi-3d-gaussian-splatting-log/garden/depth-cov-2bc0ca3-231009-182458-garden/output/output.tar.gz

github-actions[bot] commented 12 months ago

Training job depth-cov-2bc0ca3-231009-182458-garden final metrics:

Latest Metrics

train:iteration train:l1loss train:loss train:num_valid_points train:psnr train:ssim train:ssimloss val:loss val:psnr val:ssim
30000.0 0.025489307940006256 0.05266251415014267 448067.0 28.651826858520508 0.8386446833610535 0.16135531663894653 0.06743820011615753 26.244369506835938 0.7957388162612915

Max Metrics

train:5kpsnr train:5kssim train:7kpsnr train:7kssim train:psnr train:ssim val:5kpsnr val:5kssim val:7kpsnr val:7kssim val:psnr val:ssim
21.013626098632812 0.6004989147186279 24.1752986907959 0.6809948682785034 28.651826858520508 0.8386446833610535 24.316099166870117 0.7003467082977295 25.008174896240234 0.734488308429718 26.244369506835938 0.7957388162612915
github-actions[bot] commented 12 months ago

Running experiment on sagemaker with git sha 1e1fedd25e24e7262dafe1df14f1e154b11906a3

github-actions[bot] commented 12 months ago

Training job depth-cov-1e1fedd-231010-035659-tat-truck-baseline created

github-actions[bot] commented 12 months ago

Running experiment on sagemaker with git sha 1e1fedd25e24e7262dafe1df14f1e154b11906a3

github-actions[bot] commented 12 months ago

Training job depth-cov-1e1fedd-231010-035744-tat-train-baseline created

github-actions[bot] commented 12 months ago

Running experiment on sagemaker with git sha 6288c1a7fd7f7f0404a9cf4bea9ead582883de6d

github-actions[bot] commented 12 months ago

Training job depth-cov-6288c1a-231010-040751-tat-truck-baseline created

github-actions[bot] commented 12 months ago

Running experiment on sagemaker with git sha 6288c1a7fd7f7f0404a9cf4bea9ead582883de6d

github-actions[bot] commented 12 months ago

Training job depth-cov-6288c1a-231010-040836-tat-train-baseline created

github-actions[bot] commented 12 months ago

Training job depth-cov-1e1fedd-231010-035659-tat-truck-baseline completed.

Model url: s3://taichi-3d-gaussian-splatting-log/tat-truck-baseline/depth-cov-1e1fedd-231010-035659-tat-truck-baseline/output/model.tar.gz,

tensorboard output path: s3://taichi-3d-gaussian-splatting-log/tat-truck-baseline/depth-cov-1e1fedd-231010-035659-tat-truck-baseline/output/output.tar.gz

github-actions[bot] commented 12 months ago

Training job depth-cov-1e1fedd-231010-035659-tat-truck-baseline final metrics:

Latest Metrics

train:iteration train:l1loss train:loss train:num_valid_points train:psnr train:ssim train:ssimloss val:loss val:psnr val:ssim
30000.0 0.031062206253409386 0.0493476539850235 440554.0 26.648462295532227 0.8775105476379395 0.12248945236206055 0.05409366264939308 25.106584548950195 0.8655980229377747

Max Metrics

train:5kpsnr train:5kssim train:7kpsnr train:7kssim train:psnr train:ssim val:5kpsnr val:5kssim val:7kpsnr val:7kssim val:psnr val:ssim
23.641111373901367 0.8123033046722412 22.83517074584961 0.8293399810791016 26.648462295532227 0.8775105476379395 23.018966674804688 0.8152655363082886 23.77359962463379 0.8364483118057251 25.106584548950195 0.8655980229377747
github-actions[bot] commented 12 months ago

Training job depth-cov-6288c1a-231010-040751-tat-truck-baseline completed.

Model url: s3://taichi-3d-gaussian-splatting-log/tat-truck-baseline/depth-cov-6288c1a-231010-040751-tat-truck-baseline/output/model.tar.gz,

tensorboard output path: s3://taichi-3d-gaussian-splatting-log/tat-truck-baseline/depth-cov-6288c1a-231010-040751-tat-truck-baseline/output/output.tar.gz

github-actions[bot] commented 12 months ago

Training job depth-cov-6288c1a-231010-040751-tat-truck-baseline final metrics:

Latest Metrics

train:iteration train:l1loss train:loss train:num_valid_points train:psnr train:ssim train:ssimloss val:loss val:psnr val:ssim
30000.0 0.027977630496025085 0.04519319534301758 437848.0 26.20476531982422 0.8859445452690125 0.11405545473098755 0.054122429341077805 25.10765838623047 0.8654577136039734

Max Metrics

train:5kpsnr train:5kssim train:7kpsnr train:7kssim train:psnr train:ssim val:5kpsnr val:5kssim val:7kpsnr val:7kssim val:psnr val:ssim
25.2652587890625 0.8586969375610352 22.62720489501953 0.8121758699417114 26.20476531982422 0.8859445452690125 23.11250877380371 0.8146746158599854 23.800506591796875 0.836269199848175 25.10765838623047 0.8654577136039734
github-actions[bot] commented 12 months ago

Training job depth-cov-1e1fedd-231010-035744-tat-train-baseline completed.

Model url: s3://taichi-3d-gaussian-splatting-log/tat-train-baseline/depth-cov-1e1fedd-231010-035744-tat-train-baseline/output/model.tar.gz,

tensorboard output path: s3://taichi-3d-gaussian-splatting-log/tat-train-baseline/depth-cov-1e1fedd-231010-035744-tat-train-baseline/output/output.tar.gz

github-actions[bot] commented 12 months ago

Training job depth-cov-1e1fedd-231010-035744-tat-train-baseline final metrics:

Latest Metrics

train:iteration train:l1loss train:loss train:num_valid_points train:psnr train:ssim train:ssimloss val:loss val:psnr val:ssim
30000.0 0.04034237563610077 0.05373716354370117 683313.0 24.988109588623047 0.8926836848258972 0.10731631517410278 0.10019411146640778 20.892578125 0.8003265857696533

Max Metrics

train:5kpsnr train:5kssim train:7kpsnr train:7kssim train:psnr train:ssim val:5kpsnr val:5kssim val:7kpsnr val:7kssim val:psnr val:ssim
19.99143409729004 0.8156391978263855 19.584033966064453 0.700856626033783 24.988109588623047 0.8926836848258972 19.137939453125 0.7308909296989441 19.883193969726562 0.7593801021575928 20.892578125 0.8003265857696533
github-actions[bot] commented 12 months ago

Training job depth-cov-6288c1a-231010-040836-tat-train-baseline completed.

Model url: s3://taichi-3d-gaussian-splatting-log/tat-train-baseline/depth-cov-6288c1a-231010-040836-tat-train-baseline/output/model.tar.gz,

tensorboard output path: s3://taichi-3d-gaussian-splatting-log/tat-train-baseline/depth-cov-6288c1a-231010-040836-tat-train-baseline/output/output.tar.gz

github-actions[bot] commented 12 months ago

Training job depth-cov-6288c1a-231010-040836-tat-train-baseline final metrics:

Latest Metrics

train:iteration train:l1loss train:loss train:num_valid_points train:psnr train:ssim train:ssimloss val:loss val:psnr val:ssim
30000.0 0.03149525821208954 0.04232235252857208 678714.0 26.761062622070312 0.9143692851066589 0.08563071489334106 0.09982308000326157 20.989418029785156 0.8008792996406555

Max Metrics

train:5kpsnr train:5kssim train:7kpsnr train:7kssim train:psnr train:ssim val:5kpsnr val:5kssim val:7kpsnr val:7kssim val:psnr val:ssim
18.38301658630371 0.6413297653198242 19.29852294921875 0.7729830145835876 26.761062622070312 0.9143692851066589 19.086259841918945 0.7320595383644104 19.68597412109375 0.7574818730354309 20.989418029785156 0.8008792996406555