potree / PotreeConverter

Create multi res point cloud to use with potree
http://potree.org
BSD 2-Clause "Simplified" License
690 stars 427 forks source link

indexing error #636

Open arsene1949 opened 1 year ago

arsene1949 commented 1 year ago

[yuki@localhost data01]$ PotreeConverter-develop/build/PotreeConverter lasfiles/demo.las -o octreefiles/page -p index --title index

On a 256 core ARM64 server, the PotreeConverter conversion of pointcloud data is very slow, with the following message:

======================================= === INDEXING

[67%, 2s], [INDEXING: 0%, duration: 0s, throughput: nanMPs][RAM: 11.9GB (highest 13.7GB), CPU: 0%] [67%, 3s], [INDEXING: 0%, duration: 0s, throughput: nanMPs][RAM: 21.0GB (highest 21.0GB), CPU: 51%] [67%, 4s], [INDEXING: 0%, duration: 0s, throughput: nanMPs][RAM: 21.0GB (highest 21.0GB), CPU: 56%] [67%, 5s], [INDEXING: 0%, duration: 0s, throughput: nanMPs][RAM: 21.0GB (highest 21.0GB), CPU: 56%] [67%, 6s], [INDEXING: 0%, duration: 0s, throughput: nanMPs][RAM: 21.0GB (highest 21.0GB), CPU: 56%] [67%, 7s], [INDEXING: 0%, duration: 0s, throughput: nanMPs][RAM: 21.0GB (highest 21.0GB), CPU: 56%] [67%, 8s], [INDEXING: 0%, duration: 0s, throughput: nanMPs][RAM: 21.0GB (highest 21.0GB), CPU: 56%] [67%, 9s], [INDEXING: 0%, duration: 0s, throughput: nanMPs][RAM: 21.0GB (highest 21.0GB), CPU: 56%] [67%, 10s], [INDEXING: 0%, duration: 0s, throughput: nanMPs][RAM: 21.0GB (highest 21.0GB), CPU: 56%] [67%, 11s], [INDEXING: 0%, duration: 0s, throughput: nanMPs][RAM: 21.0GB (highest 21.0GB), CPU: 56%] [67%, 12s], [INDEXING: 0%, duration: 0s, throughput: nanMPs][RAM: 21.0GB (highest 21.0GB), CPU: 56%] [67%, 13s], [INDEXING: 0%, duration: 0s, throughput: nanMPs][RAM: 21.0GB (highest 21.0GB), CPU: 56%] [67%, 14s], [INDEXING: 0%, duration: 0s, throughput: nanMPs][RAM: 21.0GB (highest 21.0GB), CPU: 56%] [67%, 15s], [INDEXING: 0%, duration: 0s, throughput: nanMPs][RAM: 21.0GB (highest 21.0GB), CPU: 56%] [67%, 16s], [INDEXING: 0%, duration: 0s, throughput: nanMPs][RAM: 21.0GB (highest 21.0GB), CPU: 56%] [67%, 17s], [INDEXING: 0%, duration: 0s, throughput: nanMPs][RAM: 21.0GB (highest 21.0GB), CPU: 56%] [67%, 18s], [INDEXING: 0%, duration: 0s, throughput: nanMPs][RAM: 21.0GB (highest 21.0GB), CPU: 56%] [67%, 19s], [INDEXING: 0%, duration: 0s, throughput: nanMPs][RAM: 21.0GB (highest 21.0GB), CPU: 56%] [67%, 20s], [INDEXING: 0%, duration: 0s, throughput: nanMPs][RAM: 21.0GB (highest 21.0GB), CPU: 56%] [67%, 21s], [INDEXING: 0%, duration: 0s, throughput: nanMPs][RAM: 21.0GB (highest 21.0GB), CPU: 56%] [67%, 22s], [INDEXING: 0%, duration: 0s, throughput: nanMPs][RAM: 21.0GB (highest 21.0GB), CPU: 56%] [67%, 23s], [INDEXING: 0%, duration: 0s, throughput: nanMPs][RAM: 21.0GB (highest 21.0GB), CPU: 56%] [67%, 24s], [INDEXING: 0%, duration: 0s, throughput: nanMPs][RAM: 21.0GB (highest 21.0GB), CPU: 56%] [67%, 25s], [INDEXING: 0%, duration: 0s, throughput: nanMPs][RAM: 21.0GB (highest 21.0GB), CPU: 56%] [67%, 26s], [INDEXING: 0%, duration: 0s, throughput: nanMPs][RAM: 21.0GB (highest 21.0GB), CPU: 56%] [67%, 27s], [INDEXING: 0%, duration: 0s, throughput: nanMPs][RAM: 21.0GB (highest 21.0GB), CPU: 56%] [67%, 28s], [INDEXING: 0%, duration: 0s, throughput: nanMPs][RAM: 21.0GB (highest 21.0GB), CPU: 56%] [67%, 29s], [INDEXING: 0%, duration: 0s, throughput: nanMPs][RAM: 21.0GB (highest 21.0GB), CPU: 56%] [67%, 30s], [INDEXING: 0%, duration: 0s, throughput: nanMPs][RAM: 21.0GB (highest 21.0GB), CPU: 56%] [67%, 31s], [INDEXING: 0%, duration: 0s, throughput: nanMPs][RAM: 21.0GB (highest 21.0GB), CPU: 56%] [67%, 32s], [INDEXING: 0%, duration: 0s, throughput: nanMPs][RAM: 21.0GB (highest 21.0GB), CPU: 56%] [67%, 33s], [INDEXING: 0%, duration: 0s, throughput: nanMPs][RAM: 21.0GB (highest 21.0GB), CPU: 56%] [67%, 34s], [INDEXING: 0%, duration: 0s, throughput: nanMPs][RAM: 21.0GB (highest 21.0GB), CPU: 55%] [67%, 35s], [INDEXING: 0%, duration: 0s, throughput: nanMPs][RAM: 21.0GB (highest 21.0GB), CPU: 51%] [67%, 36s], [INDEXING: 0%, duration: 0s, throughput: nanMPs][RAM: 21.0GB (highest 21.0GB), CPU: 51%] [67%, 37s], [INDEXING: 0%, duration: 0s, throughput: nanMPs][RAM: 21.0GB (highest 21.0GB), CPU: 51%] [67%, 38s], [INDEXING: 0%, duration: 0s, throughput: nanMPs][RAM: 21.0GB (highest 21.0GB), CPU: 51%] [67%, 39s], [INDEXING: 0%, duration: 0s, throughput: nanMPs][RAM: 21.0GB (highest 21.0GB), CPU: 51%] [93%, 40s], [INDEXING: 80%, duration: 38s, throughput: 0MPs][RAM: 21.0GB (highest 21.0GB), CPU: 53%] [93%, 41s], [INDEXING: 80%, duration: 38s, throughput: 0MPs][RAM: 20.5GB (highest 21.0GB), CPU: 92%] [93%, 42s], [INDEXING: 80%, duration: 38s, throughput: 0MPs][RAM: 20.0GB (highest 21.0GB), CPU: 97%] [93%, 43s], [INDEXING: 80%, duration: 38s, throughput: 0MPs][RAM: 19.4GB (highest 21.0GB), CPU: 98%] [93%, 44s], [INDEXING: 80%, duration: 38s, throughput: 0MPs][RAM: 19.2GB (highest 21.0GB), CPU: 99%] [93%, 45s], [INDEXING: 80%, duration: 38s, throughput: 0MPs][RAM: 19.2GB (highest 21.0GB), CPU: 100%] [93%, 46s], [INDEXING: 80%, duration: 38s, throughput: 0MPs][RAM: 19.2GB (highest 21.0GB), CPU: 100%] [93%, 47s], [INDEXING: 80%, duration: 38s, throughput: 0MPs][RAM: 19.1GB (highest 21.0GB), CPU: 95%] [93%, 48s], [INDEXING: 80%, duration: 38s, throughput: 0MPs][RAM: 19.1GB (highest 21.0GB), CPU: 98%] [93%, 49s], [INDEXING: 80%, duration: 38s, throughput: 0MPs][RAM: 19.1GB (highest 21.0GB), CPU: 98%] [93%, 50s], [INDEXING: 80%, duration: 38s, throughput: 0MPs][RAM: 19.1GB (highest 21.0GB), CPU: 98%] [93%, 51s], [INDEXING: 80%, duration: 38s, throughput: 0MPs][RAM: 19.1GB (highest 21.0GB), CPU: 99%] [93%, 52s], [INDEXING: 80%, duration: 38s, throughput: 0MPs][RAM: 19.1GB (highest 21.0GB), CPU: 98%] [93%, 53s], [INDEXING: 80%, duration: 38s, throughput: 0MPs][RAM: 19.1GB (highest 21.0GB), CPU: 98%] [93%, 54s], [INDEXING: 80%, duration: 38s, throughput: 0MPs][RAM: 19.1GB (highest 21.0GB), CPU: 99%] [93%, 55s], [INDEXING: 80%, duration: 38s, throughput: 0MPs][RAM: 19.1GB (highest 21.0GB), CPU: 98%] [93%, 56s], [INDEXING: 80%, duration: 38s, throughput: 0MPs][RAM: 19.1GB (highest 21.0GB), CPU: 99%] [93%, 57s], [INDEXING: 80%, duration: 38s, throughput: 0MPs][RAM: 19.1GB (highest 21.0GB), CPU: 99%] [93%, 58s], [INDEXING: 80%, duration: 38s, throughput: 0MPs][RAM: 19.1GB (highest 21.0GB), CPU: 99%] [93%, 59s], [INDEXING: 80%, duration: 38s, throughput: 0MPs][RAM: 19.1GB (highest 21.0GB), CPU: 99%] [93%, 60s], [INDEXING: 80%, duration: 38s, throughput: 0MPs][RAM: 19.1GB (highest 21.0GB), CPU: 99%] [93%, 61s], [INDEXING: 80%, duration: 38s, throughput: 0MPs][RAM: 19.1GB (highest 21.0GB), CPU: 99%] [93%, 62s], [INDEXING: 80%, duration: 38s, throughput: 0MPs][RAM: 19.1GB (highest 21.0GB), CPU: 99%] [93%, 63s], [INDEXING: 80%, duration: 38s, throughput: 0MPs][RAM: 19.1GB (highest 21.0GB), CPU: 99%] [93%, 64s], [INDEXING: 80%, duration: 38s, throughput: 0MPs][RAM: 19.1GB (highest 21.0GB), CPU: 99%] [93%, 65s], [INDEXING: 80%, duration: 38s, throughput: 0MPs][RAM: 19.1GB (highest 21.0GB), CPU: 99%] [93%, 66s], [INDEXING: 80%, duration: 38s, throughput: 0MPs][RAM: 19.1GB (highest 21.0GB), CPU: 98%] [93%, 67s], [INDEXING: 80%, duration: 38s, throughput: 0MPs][RAM: 19.1GB (highest 21.0GB), CPU: 98%] [93%, 68s], [INDEXING: 80%, duration: 38s, throughput: 0MPs][RAM: 19.1GB (highest 21.0GB), CPU: 99%] [93%, 69s], [INDEXING: 80%, duration: 38s, throughput: 0MPs][RAM: 19.1GB (highest 21.0GB), CPU: 99%] [93%, 70s], [INDEXING: 80%, duration: 38s, throughput: 0MPs][RAM: 19.1GB (highest 21.0GB), CPU: 98%] [93%, 71s], [INDEXING: 80%, duration: 38s, throughput: 0MPs][RAM: 19.1GB (highest 21.0GB), CPU: 98%] [93%, 72s], [INDEXING: 80%, duration: 38s, throughput: 0MPs][RAM: 19.1GB (highest 21.0GB), CPU: 98%] [93%, 73s], [INDEXING: 80%, duration: 38s, throughput: 0MPs][RAM: 19.1GB (highest 21.0GB), CPU: 98%] [93%, 74s], [INDEXING: 80%, duration: 38s, throughput: 0MPs][RAM: 19.1GB (highest 21.0GB), CPU: 98%] [93%, 75s], [INDEXING: 80%, duration: 38s, throughput: 0MPs][RAM: 19.1GB (highest 21.0GB), CPU: 98%] [93%, 76s], [INDEXING: 80%, duration: 38s, throughput: 0MPs][RAM: 19.1GB (highest 21.0GB), CPU: 98%] [93%, 77s], [INDEXING: 80%, duration: 38s, throughput: 0MPs][RAM: 19.1GB (highest 21.0GB), CPU: 98%] [93%, 78s], [INDEXING: 80%, duration: 38s, throughput: 0MPs][RAM: 19.1GB (highest 21.0GB), CPU: 98%] [93%, 79s], [INDEXING: 80%, duration: 38s, throughput: 0MPs][RAM: 19.1GB (highest 21.0GB), CPU: 99%] [93%, 80s], [INDEXING: 80%, duration: 38s, throughput: 0MPs][RAM: 19.1GB (highest 21.0GB), CPU: 99%] [93%, 81s], [INDEXING: 80%, duration: 38s, throughput: 0MPs][RAM: 19.1GB (highest 21.0GB), CPU: 99%] [93%, 82s], [INDEXING: 80%, duration: 38s, throughput: 0MPs][RAM: 19.1GB (highest 21.0GB), CPU: 99%] [93%, 83s], [INDEXING: 80%, duration: 38s, throughput: 0MPs][RAM: 19.1GB (highest 21.0GB), CPU: 98%] [93%, 84s], [INDEXING: 80%, duration: 38s, throughput: 0MPs][RAM: 19.1GB (highest 21.0GB), CPU: 98%] [93%, 85s], [INDEXING: 80%, duration: 38s, throughput: 0MPs][RAM: 19.1GB (highest 21.0GB), CPU: 99%] [93%, 86s], [INDEXING: 80%, duration: 38s, throughput: 0MPs][RAM: 19.1GB (highest 21.0GB), CPU: 99%] [93%, 87s], [INDEXING: 80%, duration: 38s, throughput: 0MPs][RAM: 19.1GB (highest 21.0GB), CPU: 99%] [93%, 88s], [INDEXING: 80%, duration: 38s, throughput: 0MPs][RAM: 19.1GB (highest 21.0GB), CPU: 99%] [93%, 89s], [INDEXING: 80%, duration: 38s, throughput: 0MPs][RAM: 19.1GB (highest 21.0GB), CPU: 99%] [93%, 90s], [INDEXING: 80%, duration: 38s, throughput: 0MPs][RAM: 19.1GB (highest 21.0GB), CPU: 99%] [93%, 91s], [INDEXING: 80%, duration: 38s, throughput: 0MPs][RAM: 19.1GB (highest 21.0GB), CPU: 99%] [93%, 92s], [INDEXING: 80%, duration: 38s, throughput: 0MPs][RAM: 19.1GB (highest 21.0GB), CPU: 99%] [93%, 93s], [INDEXING: 80%, duration: 38s, throughput: 0MPs][RAM: 19.1GB (highest 21.0GB), CPU: 99%] [93%, 94s], [INDEXING: 80%, duration: 38s, throughput: 0MPs][RAM: 19.1GB (highest 21.0GB), CPU: 99%] [93%, 95s], [INDEXING: 80%, duration: 38s, throughput: 0MPs][RAM: 19.1GB (highest 21.0GB), CPU: 99%] [93%, 96s], [INDEXING: 80%, duration: 38s, throughput: 0MPs][RAM: 19.1GB (highest 21.0GB), CPU: 99%] [93%, 97s], [INDEXING: 80%, duration: 38s, throughput: 0MPs][RAM: 19.1GB (highest 21.0GB), CPU: 99%] [93%, 98s], [INDEXING: 80%, duration: 38s, throughput: 0MPs][RAM: 19.1GB (highest 21.0GB), CPU: 99%] [93%, 99s], [INDEXING: 80%, duration: 38s, throughput: 0MPs][RAM: 19.1GB (highest 21.0GB), CPU: 99%] [93%, 100s], [INDEXING: 80%, duration: 38s, throughput: 0MPs][RAM: 19.1GB (highest 21.0GB), CPU: 99%] [93%, 101s], [INDEXING: 80%, duration: 38s, throughput: 0MPs][RAM: 19.1GB (highest 21.0GB), CPU: 99%] [93%, 102s], [INDEXING: 80%, duration: 38s, throughput: 0MPs][RAM: 19.1GB (highest 21.0GB), CPU: 99%] [93%, 103s], [INDEXING: 80%, duration: 38s, throughput: 0MPs][RAM: 19.1GB (highest 21.0GB), CPU: 99%] [93%, 104s], [INDEXING: 80%, duration: 38s, throughput: 0MPs][RAM: 19.1GB (highest 21.0GB), CPU: 99%] [93%, 105s], [INDEXING: 80%, duration: 38s, throughput: 0MPs][RAM: 19.1GB (highest 21.0GB), CPU: 99%] [93%, 106s], [INDEXING: 80%, duration: 38s, throughput: 0MPs][RAM: 19.1GB (highest 21.0GB), CPU: 99%] [93%, 107s], [INDEXING: 80%, duration: 38s, throughput: 0MPs][RAM: 19.1GB (highest 21.0GB), CPU: 99%] [93%, 108s], [INDEXING: 80%, duration: 38s, throughput: 0MPs][RAM: 19.1GB (highest 21.0GB), CPU: 99%] [93%, 109s], [INDEXING: 80%, duration: 38s, throughput: 0MPs][RAM: 19.1GB (highest 21.0GB), CPU: 99%] [93%, 110s], [INDEXING: 80%, duration: 38s, throughput: 0MPs][RAM: 19.1GB (highest 21.0GB), CPU: 88%] [93%, 111s], [INDEXING: 80%, duration: 38s, throughput: 0MPs][RAM: 19.1GB (highest 21.0GB), CPU: 79%] [93%, 112s], [INDEXING: 80%, duration: 38s, throughput: 0MPs][RAM: 19.1GB (highest 21.0GB), CPU: 79%] [93%, 113s], [INDEXING: 80%, duration: 38s, throughput: 0MPs][RAM: 19.1GB (highest 21.0GB), CPU: 64%] [93%, 114s], [INDEXING: 80%, duration: 38s, throughput: 0MPs][RAM: 19.1GB (highest 21.0GB), CPU: 57%] [93%, 115s], [INDEXING: 80%, duration: 38s, throughput: 0MPs][RAM: 19.1GB (highest 21.0GB), CPU: 57%] [93%, 116s], [INDEXING: 80%, duration: 38s, throughput: 0MPs][RAM: 19.1GB (highest 21.0GB), CPU: 57%] [93%, 117s], [INDEXING: 80%, duration: 38s, throughput: 0MPs][RAM: 19.1GB (highest 21.0GB), CPU: 57%] [93%, 118s], [INDEXING: 80%, duration: 38s, throughput: 0MPs][RAM: 19.1GB (highest 21.0GB), CPU: 57%] [93%, 119s], [INDEXING: 80%, duration: 38s, throughput: 0MPs][RAM: 19.1GB (highest 21.0GB), CPU: 57%] [93%, 120s], [INDEXING: 80%, duration: 38s, throughput: 0MPs][RAM: 19.1GB (highest 21.0GB), CPU: 57%] [93%, 121s], [INDEXING: 80%, duration: 38s, throughput: 0MPs][RAM: 19.1GB (highest 21.0GB), CPU: 57%] [93%, 122s], [INDEXING: 80%, duration: 38s, throughput: 0MPs][RAM: 19.1GB (highest 21.0GB), CPU: 57%] [93%, 123s], [INDEXING: 80%, duration: 38s, throughput: 0MPs][RAM: 19.1GB (highest 21.0GB), CPU: 57%] [93%, 124s], [INDEXING: 80%, duration: 38s, throughput: 0MPs][RAM: 19.1GB (highest 21.0GB), CPU: 57%] [93%, 125s], [INDEXING: 80%, duration: 38s, throughput: 0MPs][RAM: 19.1GB (highest 21.0GB), CPU: 57%] [93%, 126s], [INDEXING: 80%, duration: 38s, throughput: 0MPs][RAM: 19.1GB (highest 21.0GB), CPU: 57%] [93%, 127s], [INDEXING: 80%, duration: 38s, throughput: 0MPs][RAM: 19.1GB (highest 21.0GB), CPU: 57%] [93%, 128s], [INDEXING: 80%, duration: 38s, throughput: 0MPs][RAM: 19.1GB (highest 21.0GB), CPU: 57%] [93%, 129s], [INDEXING: 80%, duration: 38s, throughput: 0MPs][RAM: 19.1GB (highest 21.0GB), CPU: 57%] [93%, 130s], [INDEXING: 80%, duration: 38s, throughput: 0MPs][RAM: 19.1GB (highest 21.0GB), CPU: 57%] [93%, 131s], [INDEXING: 80%, duration: 38s, throughput: 0MPs][RAM: 19.1GB (highest 21.0GB), CPU: 57%] [93%, 132s], [INDEXING: 80%, duration: 38s, throughput: 0MPs][RAM: 19.1GB (highest 21.0GB), CPU: 57%] [93%, 133s], [INDEXING: 80%, duration: 38s, throughput: 0MPs][RAM: 19.1GB (highest 21.0GB), CPU: 57%] [93%, 134s], [INDEXING: 80%, duration: 38s, throughput: 0MPs][RAM: 19.1GB (highest 21.0GB), CPU: 57%] [93%, 135s], [INDEXING: 80%, duration: 38s, throughput: 0MPs][RAM: 19.1GB (highest 21.0GB), CPU: 57%] [93%, 136s], [INDEXING: 80%, duration: 38s, throughput: 0MPs][RAM: 19.1GB (highest 21.0GB), CPU: 57%] [93%, 137s], [INDEXING: 80%, duration: 38s, throughput: 0MPs][RAM: 19.1GB (highest 21.0GB), CPU: 57%] [93%, 138s], [INDEXING: 80%, duration: 38s, throughput: 0MPs][RAM: 19.1GB (highest 21.0GB), CPU: 18%] [93%, 139s], [INDEXING: 80%, duration: 38s, throughput: 0MPs][RAM: 19.1GB (highest 21.0GB), CPU: 50%] [93%, 140s], [INDEXING: 80%, duration: 38s, throughput: 0MPs][RAM: 19.1GB (highest 21.0GB), CPU: 50%] [93%, 141s], [INDEXING: 80%, duration: 38s, throughput: 0MPs][RAM: 19.1GB (highest 21.0GB), CPU: 48%] [93%, 142s], [INDEXING: 80%, duration: 38s, throughput: 0MPs][RAM: 19.1GB (highest 21.0GB), CPU: 51%] [93%, 143s], [INDEXING: 80%, duration: 38s, throughput: 0MPs][RAM: 19.1GB (highest 21.0GB), CPU: 55%] [93%, 144s], [INDEXING: 80%, duration: 38s, throughput: 0MPs][RAM: 19.1GB (highest 21.0GB), CPU: 56%] [93%, 145s], [INDEXING: 80%, duration: 38s, throughput: 0MPs][RAM: 19.1GB (highest 21.0GB), CPU: 55%] [93%, 146s], [INDEXING: 80%, duration: 38s, throughput: 0MPs][RAM: 19.1GB (highest 21.0GB), CPU: 55%] [93%, 147s], [INDEXING: 80%, duration: 38s, throughput: 0MPs][RAM: 19.1GB (highest 21.0GB), CPU: 55%] [93%, 148s], [INDEXING: 80%, duration: 38s, throughput: 0MPs][RAM: 19.1GB (highest 21.0GB), CPU: 55%] [93%, 149s], [INDEXING: 80%, duration: 38s, throughput: 0MPs][RAM: 19.1GB (highest 21.0GB), CPU: 55%] [93%, 150s], [INDEXING: 80%, duration: 38s, throughput: 0MPs][RAM: 19.1GB (highest 21.0GB), CPU: 55%] [93%, 151s], [INDEXING: 80%, duration: 38s, throughput: 0MPs][RAM: 19.1GB (highest 21.0GB), CPU: 55%] [93%, 152s], [INDEXING: 80%, duration: 38s, throughput: 0MPs][RAM: 19.1GB (highest 21.0GB), CPU: 43%] [93%, 153s], [INDEXING: 80%, duration: 38s, throughput: 0MPs][RAM: 19.1GB (highest 21.0GB), CPU: 43%] [93%, 154s], [INDEXING: 80%, duration: 38s, throughput: 0MPs][RAM: 19.1GB (highest 21.0GB), CPU: 28%] sampling: 152.648022s flushing: 152.653615s metadata & hierarchy: 152.655852s deleting temporary files

arsene1949 commented 1 year ago

In servers with a higher number of CPU cores, when using PotreeConverter to process point cloud data, it is possible for the conversion process to utilize all available CPUs, resulting in significantly slow performance. To address this issue, the sched_setaffinity() function can be employed to set the CPU affinity of the executing process.