Closed songllz closed 6 months ago
I use the dataset you provided for training, but encounter the following issue at checkpoint 7000.
testing for iter 7000 [28/01 20:59:13] [ITER 7000] Evaluating train: L1 0.01737641841173172 PSNR 30.760613250732423 [28/01 20:59:26] Traceback (most recent call last): File "/data/LangSplat/train.py", line 231, in <module> training(lp.extract(args), op.extract(args), pp.extract(args), args.test_iterations, args.save_iterations, args.checkpoint_iterations, args.start_checkpoint, args.debug_from) File "/data/LangSplat/train.py", line 116, in training training_report(tb_writer, iteration, Ll1, loss, l1_loss, iter_start.elapsed_time(iter_end), testing_iterations, scene, render, (pipe, background, opt)) File "/data/LangSplat/train.py", line 200, in training_report tb_writer.add_histogram("scene/opacity_histogram", scene.gaussians.get_opacity, iteration) File "/data/anaconda3/envs/langsplat/lib/python3.9/site-packages/torch/utils/tensorboard/writer.py", line 485, in add_histogram histogram(tag, values, bins, max_bins=max_bins), global_step, walltime File "/data/anaconda3/envs/langsplat/lib/python3.9/site-packages/torch/utils/tensorboard/summary.py", line 358, in histogram hist = make_histogram(values.astype(float), bins, max_bins) File "/data/anaconda3/envs/langsplat/lib/python3.9/site-packages/torch/utils/tensorboard/summary.py", line 386, in make_histogram cum_counts = np.cumsum(np.greater(counts, 0, dtype=np.int32)) TypeError: No loop matching the specified signature and casting was found for ufunc greater
It seems that this happened when plotting the histogram. Do you know how to resolve it?
"i have solve this problem by down-grade numpy version to 1.23.4"
reference: https://github.com/WongKinYiu/PyTorch_YOLOv4/issues/426#issuecomment-1587147284
I use the dataset you provided for training, but encounter the following issue at checkpoint 7000.
It seems that this happened when plotting the histogram. Do you know how to resolve it?