Open arsene1949 opened 1 year ago
In servers with a higher number of CPU cores, when using PotreeConverter to process point cloud data, it is possible for the conversion process to utilize all available CPUs, resulting in significantly slow performance. To address this issue, the sched_setaffinity() function can be employed to set the CPU affinity of the executing process.
[yuki@localhost data01]$ PotreeConverter-develop/build/PotreeConverter lasfiles/demo.las -o octreefiles/page -p index --title index
On a 256 core ARM64 server, the PotreeConverter conversion of pointcloud data is very slow, with the following message:
======================================= === INDEXING
[67%, 2s], [INDEXING: 0%, duration: 0s, throughput: nanMPs][RAM: 11.9GB (highest 13.7GB), CPU: 0%] [67%, 3s], [INDEXING: 0%, duration: 0s, throughput: nanMPs][RAM: 21.0GB (highest 21.0GB), CPU: 51%] [67%, 4s], [INDEXING: 0%, duration: 0s, throughput: nanMPs][RAM: 21.0GB (highest 21.0GB), CPU: 56%] [67%, 5s], [INDEXING: 0%, duration: 0s, throughput: nanMPs][RAM: 21.0GB (highest 21.0GB), CPU: 56%] [67%, 6s], [INDEXING: 0%, duration: 0s, throughput: nanMPs][RAM: 21.0GB (highest 21.0GB), CPU: 56%] [67%, 7s], [INDEXING: 0%, duration: 0s, throughput: nanMPs][RAM: 21.0GB (highest 21.0GB), CPU: 56%] [67%, 8s], [INDEXING: 0%, duration: 0s, throughput: nanMPs][RAM: 21.0GB (highest 21.0GB), CPU: 56%] [67%, 9s], [INDEXING: 0%, duration: 0s, throughput: nanMPs][RAM: 21.0GB (highest 21.0GB), CPU: 56%] [67%, 10s], [INDEXING: 0%, duration: 0s, throughput: nanMPs][RAM: 21.0GB (highest 21.0GB), CPU: 56%] [67%, 11s], [INDEXING: 0%, duration: 0s, throughput: nanMPs][RAM: 21.0GB (highest 21.0GB), CPU: 56%] [67%, 12s], [INDEXING: 0%, duration: 0s, throughput: nanMPs][RAM: 21.0GB (highest 21.0GB), CPU: 56%] [67%, 13s], [INDEXING: 0%, duration: 0s, throughput: nanMPs][RAM: 21.0GB (highest 21.0GB), CPU: 56%] [67%, 14s], [INDEXING: 0%, duration: 0s, throughput: nanMPs][RAM: 21.0GB (highest 21.0GB), CPU: 56%] [67%, 15s], [INDEXING: 0%, duration: 0s, throughput: nanMPs][RAM: 21.0GB (highest 21.0GB), CPU: 56%] [67%, 16s], [INDEXING: 0%, duration: 0s, throughput: nanMPs][RAM: 21.0GB (highest 21.0GB), CPU: 56%] [67%, 17s], [INDEXING: 0%, duration: 0s, throughput: nanMPs][RAM: 21.0GB (highest 21.0GB), CPU: 56%] [67%, 18s], [INDEXING: 0%, duration: 0s, throughput: nanMPs][RAM: 21.0GB (highest 21.0GB), CPU: 56%] [67%, 19s], [INDEXING: 0%, duration: 0s, throughput: nanMPs][RAM: 21.0GB (highest 21.0GB), CPU: 56%] [67%, 20s], [INDEXING: 0%, duration: 0s, throughput: nanMPs][RAM: 21.0GB (highest 21.0GB), CPU: 56%] [67%, 21s], [INDEXING: 0%, duration: 0s, throughput: nanMPs][RAM: 21.0GB (highest 21.0GB), CPU: 56%] [67%, 22s], [INDEXING: 0%, duration: 0s, throughput: nanMPs][RAM: 21.0GB (highest 21.0GB), CPU: 56%] [67%, 23s], [INDEXING: 0%, duration: 0s, throughput: nanMPs][RAM: 21.0GB (highest 21.0GB), CPU: 56%] [67%, 24s], [INDEXING: 0%, duration: 0s, throughput: nanMPs][RAM: 21.0GB (highest 21.0GB), CPU: 56%] [67%, 25s], [INDEXING: 0%, duration: 0s, throughput: nanMPs][RAM: 21.0GB (highest 21.0GB), CPU: 56%] [67%, 26s], [INDEXING: 0%, duration: 0s, throughput: nanMPs][RAM: 21.0GB (highest 21.0GB), CPU: 56%] [67%, 27s], [INDEXING: 0%, duration: 0s, throughput: nanMPs][RAM: 21.0GB (highest 21.0GB), CPU: 56%] [67%, 28s], [INDEXING: 0%, duration: 0s, throughput: nanMPs][RAM: 21.0GB (highest 21.0GB), CPU: 56%] [67%, 29s], [INDEXING: 0%, duration: 0s, throughput: nanMPs][RAM: 21.0GB (highest 21.0GB), CPU: 56%] [67%, 30s], [INDEXING: 0%, duration: 0s, throughput: nanMPs][RAM: 21.0GB (highest 21.0GB), CPU: 56%] [67%, 31s], [INDEXING: 0%, duration: 0s, throughput: nanMPs][RAM: 21.0GB (highest 21.0GB), CPU: 56%] [67%, 32s], [INDEXING: 0%, duration: 0s, throughput: nanMPs][RAM: 21.0GB (highest 21.0GB), CPU: 56%] [67%, 33s], [INDEXING: 0%, duration: 0s, throughput: nanMPs][RAM: 21.0GB (highest 21.0GB), CPU: 56%] [67%, 34s], [INDEXING: 0%, duration: 0s, throughput: nanMPs][RAM: 21.0GB (highest 21.0GB), CPU: 55%] [67%, 35s], [INDEXING: 0%, duration: 0s, throughput: nanMPs][RAM: 21.0GB (highest 21.0GB), CPU: 51%] [67%, 36s], [INDEXING: 0%, duration: 0s, throughput: nanMPs][RAM: 21.0GB (highest 21.0GB), CPU: 51%] [67%, 37s], [INDEXING: 0%, duration: 0s, throughput: nanMPs][RAM: 21.0GB (highest 21.0GB), CPU: 51%] [67%, 38s], [INDEXING: 0%, duration: 0s, throughput: nanMPs][RAM: 21.0GB (highest 21.0GB), CPU: 51%] [67%, 39s], [INDEXING: 0%, duration: 0s, throughput: nanMPs][RAM: 21.0GB (highest 21.0GB), CPU: 51%] [93%, 40s], [INDEXING: 80%, duration: 38s, throughput: 0MPs][RAM: 21.0GB (highest 21.0GB), CPU: 53%] [93%, 41s], [INDEXING: 80%, duration: 38s, throughput: 0MPs][RAM: 20.5GB (highest 21.0GB), CPU: 92%] [93%, 42s], [INDEXING: 80%, duration: 38s, throughput: 0MPs][RAM: 20.0GB (highest 21.0GB), CPU: 97%] [93%, 43s], [INDEXING: 80%, duration: 38s, throughput: 0MPs][RAM: 19.4GB (highest 21.0GB), CPU: 98%] [93%, 44s], [INDEXING: 80%, duration: 38s, throughput: 0MPs][RAM: 19.2GB (highest 21.0GB), CPU: 99%] [93%, 45s], [INDEXING: 80%, duration: 38s, throughput: 0MPs][RAM: 19.2GB (highest 21.0GB), CPU: 100%] [93%, 46s], [INDEXING: 80%, duration: 38s, throughput: 0MPs][RAM: 19.2GB (highest 21.0GB), CPU: 100%] [93%, 47s], [INDEXING: 80%, duration: 38s, throughput: 0MPs][RAM: 19.1GB (highest 21.0GB), CPU: 95%] [93%, 48s], [INDEXING: 80%, duration: 38s, throughput: 0MPs][RAM: 19.1GB (highest 21.0GB), CPU: 98%] [93%, 49s], [INDEXING: 80%, duration: 38s, throughput: 0MPs][RAM: 19.1GB (highest 21.0GB), CPU: 98%] [93%, 50s], [INDEXING: 80%, duration: 38s, throughput: 0MPs][RAM: 19.1GB (highest 21.0GB), CPU: 98%] [93%, 51s], [INDEXING: 80%, duration: 38s, throughput: 0MPs][RAM: 19.1GB (highest 21.0GB), CPU: 99%] [93%, 52s], [INDEXING: 80%, duration: 38s, throughput: 0MPs][RAM: 19.1GB (highest 21.0GB), CPU: 98%] [93%, 53s], [INDEXING: 80%, duration: 38s, throughput: 0MPs][RAM: 19.1GB (highest 21.0GB), CPU: 98%] [93%, 54s], [INDEXING: 80%, duration: 38s, throughput: 0MPs][RAM: 19.1GB (highest 21.0GB), CPU: 99%] [93%, 55s], [INDEXING: 80%, duration: 38s, throughput: 0MPs][RAM: 19.1GB (highest 21.0GB), CPU: 98%] [93%, 56s], [INDEXING: 80%, duration: 38s, throughput: 0MPs][RAM: 19.1GB (highest 21.0GB), CPU: 99%] [93%, 57s], [INDEXING: 80%, duration: 38s, throughput: 0MPs][RAM: 19.1GB (highest 21.0GB), CPU: 99%] [93%, 58s], [INDEXING: 80%, duration: 38s, throughput: 0MPs][RAM: 19.1GB (highest 21.0GB), CPU: 99%] [93%, 59s], [INDEXING: 80%, duration: 38s, throughput: 0MPs][RAM: 19.1GB (highest 21.0GB), CPU: 99%] [93%, 60s], [INDEXING: 80%, duration: 38s, throughput: 0MPs][RAM: 19.1GB (highest 21.0GB), CPU: 99%] [93%, 61s], [INDEXING: 80%, duration: 38s, throughput: 0MPs][RAM: 19.1GB (highest 21.0GB), CPU: 99%] [93%, 62s], [INDEXING: 80%, duration: 38s, throughput: 0MPs][RAM: 19.1GB (highest 21.0GB), CPU: 99%] [93%, 63s], [INDEXING: 80%, duration: 38s, throughput: 0MPs][RAM: 19.1GB (highest 21.0GB), CPU: 99%] [93%, 64s], [INDEXING: 80%, duration: 38s, throughput: 0MPs][RAM: 19.1GB (highest 21.0GB), CPU: 99%] [93%, 65s], [INDEXING: 80%, duration: 38s, throughput: 0MPs][RAM: 19.1GB (highest 21.0GB), CPU: 99%] [93%, 66s], [INDEXING: 80%, duration: 38s, throughput: 0MPs][RAM: 19.1GB (highest 21.0GB), CPU: 98%] [93%, 67s], [INDEXING: 80%, duration: 38s, throughput: 0MPs][RAM: 19.1GB (highest 21.0GB), CPU: 98%] [93%, 68s], [INDEXING: 80%, duration: 38s, throughput: 0MPs][RAM: 19.1GB (highest 21.0GB), CPU: 99%] [93%, 69s], [INDEXING: 80%, duration: 38s, throughput: 0MPs][RAM: 19.1GB (highest 21.0GB), CPU: 99%] [93%, 70s], [INDEXING: 80%, duration: 38s, throughput: 0MPs][RAM: 19.1GB (highest 21.0GB), CPU: 98%] [93%, 71s], [INDEXING: 80%, duration: 38s, throughput: 0MPs][RAM: 19.1GB (highest 21.0GB), CPU: 98%] [93%, 72s], [INDEXING: 80%, duration: 38s, throughput: 0MPs][RAM: 19.1GB (highest 21.0GB), CPU: 98%] [93%, 73s], [INDEXING: 80%, duration: 38s, throughput: 0MPs][RAM: 19.1GB (highest 21.0GB), CPU: 98%] [93%, 74s], [INDEXING: 80%, duration: 38s, throughput: 0MPs][RAM: 19.1GB (highest 21.0GB), CPU: 98%] [93%, 75s], [INDEXING: 80%, duration: 38s, throughput: 0MPs][RAM: 19.1GB (highest 21.0GB), CPU: 98%] [93%, 76s], [INDEXING: 80%, duration: 38s, throughput: 0MPs][RAM: 19.1GB (highest 21.0GB), CPU: 98%] [93%, 77s], [INDEXING: 80%, duration: 38s, throughput: 0MPs][RAM: 19.1GB (highest 21.0GB), CPU: 98%] [93%, 78s], [INDEXING: 80%, duration: 38s, throughput: 0MPs][RAM: 19.1GB (highest 21.0GB), CPU: 98%] [93%, 79s], [INDEXING: 80%, duration: 38s, throughput: 0MPs][RAM: 19.1GB (highest 21.0GB), CPU: 99%] [93%, 80s], [INDEXING: 80%, duration: 38s, throughput: 0MPs][RAM: 19.1GB (highest 21.0GB), CPU: 99%] [93%, 81s], [INDEXING: 80%, duration: 38s, throughput: 0MPs][RAM: 19.1GB (highest 21.0GB), CPU: 99%] [93%, 82s], [INDEXING: 80%, duration: 38s, throughput: 0MPs][RAM: 19.1GB (highest 21.0GB), CPU: 99%] [93%, 83s], [INDEXING: 80%, duration: 38s, throughput: 0MPs][RAM: 19.1GB (highest 21.0GB), CPU: 98%] [93%, 84s], [INDEXING: 80%, duration: 38s, throughput: 0MPs][RAM: 19.1GB (highest 21.0GB), CPU: 98%] [93%, 85s], [INDEXING: 80%, duration: 38s, throughput: 0MPs][RAM: 19.1GB (highest 21.0GB), CPU: 99%] [93%, 86s], [INDEXING: 80%, duration: 38s, throughput: 0MPs][RAM: 19.1GB (highest 21.0GB), CPU: 99%] [93%, 87s], [INDEXING: 80%, duration: 38s, throughput: 0MPs][RAM: 19.1GB (highest 21.0GB), CPU: 99%] [93%, 88s], [INDEXING: 80%, duration: 38s, throughput: 0MPs][RAM: 19.1GB (highest 21.0GB), CPU: 99%] [93%, 89s], [INDEXING: 80%, duration: 38s, throughput: 0MPs][RAM: 19.1GB (highest 21.0GB), CPU: 99%] [93%, 90s], [INDEXING: 80%, duration: 38s, throughput: 0MPs][RAM: 19.1GB (highest 21.0GB), CPU: 99%] [93%, 91s], [INDEXING: 80%, duration: 38s, throughput: 0MPs][RAM: 19.1GB (highest 21.0GB), CPU: 99%] [93%, 92s], [INDEXING: 80%, duration: 38s, throughput: 0MPs][RAM: 19.1GB (highest 21.0GB), CPU: 99%] [93%, 93s], [INDEXING: 80%, duration: 38s, throughput: 0MPs][RAM: 19.1GB (highest 21.0GB), CPU: 99%] [93%, 94s], [INDEXING: 80%, duration: 38s, throughput: 0MPs][RAM: 19.1GB (highest 21.0GB), CPU: 99%] [93%, 95s], [INDEXING: 80%, duration: 38s, throughput: 0MPs][RAM: 19.1GB (highest 21.0GB), CPU: 99%] [93%, 96s], [INDEXING: 80%, duration: 38s, throughput: 0MPs][RAM: 19.1GB (highest 21.0GB), CPU: 99%] [93%, 97s], [INDEXING: 80%, duration: 38s, throughput: 0MPs][RAM: 19.1GB (highest 21.0GB), CPU: 99%] [93%, 98s], [INDEXING: 80%, duration: 38s, throughput: 0MPs][RAM: 19.1GB (highest 21.0GB), CPU: 99%] [93%, 99s], [INDEXING: 80%, duration: 38s, throughput: 0MPs][RAM: 19.1GB (highest 21.0GB), CPU: 99%] [93%, 100s], [INDEXING: 80%, duration: 38s, throughput: 0MPs][RAM: 19.1GB (highest 21.0GB), CPU: 99%] [93%, 101s], [INDEXING: 80%, duration: 38s, throughput: 0MPs][RAM: 19.1GB (highest 21.0GB), CPU: 99%] [93%, 102s], [INDEXING: 80%, duration: 38s, throughput: 0MPs][RAM: 19.1GB (highest 21.0GB), CPU: 99%] [93%, 103s], [INDEXING: 80%, duration: 38s, throughput: 0MPs][RAM: 19.1GB (highest 21.0GB), CPU: 99%] [93%, 104s], [INDEXING: 80%, duration: 38s, throughput: 0MPs][RAM: 19.1GB (highest 21.0GB), CPU: 99%] [93%, 105s], [INDEXING: 80%, duration: 38s, throughput: 0MPs][RAM: 19.1GB (highest 21.0GB), CPU: 99%] [93%, 106s], [INDEXING: 80%, duration: 38s, throughput: 0MPs][RAM: 19.1GB (highest 21.0GB), CPU: 99%] [93%, 107s], [INDEXING: 80%, duration: 38s, throughput: 0MPs][RAM: 19.1GB (highest 21.0GB), CPU: 99%] [93%, 108s], [INDEXING: 80%, duration: 38s, throughput: 0MPs][RAM: 19.1GB (highest 21.0GB), CPU: 99%] [93%, 109s], [INDEXING: 80%, duration: 38s, throughput: 0MPs][RAM: 19.1GB (highest 21.0GB), CPU: 99%] [93%, 110s], [INDEXING: 80%, duration: 38s, throughput: 0MPs][RAM: 19.1GB (highest 21.0GB), CPU: 88%] [93%, 111s], [INDEXING: 80%, duration: 38s, throughput: 0MPs][RAM: 19.1GB (highest 21.0GB), CPU: 79%] [93%, 112s], [INDEXING: 80%, duration: 38s, throughput: 0MPs][RAM: 19.1GB (highest 21.0GB), CPU: 79%] [93%, 113s], [INDEXING: 80%, duration: 38s, throughput: 0MPs][RAM: 19.1GB (highest 21.0GB), CPU: 64%] [93%, 114s], [INDEXING: 80%, duration: 38s, throughput: 0MPs][RAM: 19.1GB (highest 21.0GB), CPU: 57%] [93%, 115s], [INDEXING: 80%, duration: 38s, throughput: 0MPs][RAM: 19.1GB (highest 21.0GB), CPU: 57%] [93%, 116s], [INDEXING: 80%, duration: 38s, throughput: 0MPs][RAM: 19.1GB (highest 21.0GB), CPU: 57%] [93%, 117s], [INDEXING: 80%, duration: 38s, throughput: 0MPs][RAM: 19.1GB (highest 21.0GB), CPU: 57%] [93%, 118s], [INDEXING: 80%, duration: 38s, throughput: 0MPs][RAM: 19.1GB (highest 21.0GB), CPU: 57%] [93%, 119s], [INDEXING: 80%, duration: 38s, throughput: 0MPs][RAM: 19.1GB (highest 21.0GB), CPU: 57%] [93%, 120s], [INDEXING: 80%, duration: 38s, throughput: 0MPs][RAM: 19.1GB (highest 21.0GB), CPU: 57%] [93%, 121s], [INDEXING: 80%, duration: 38s, throughput: 0MPs][RAM: 19.1GB (highest 21.0GB), CPU: 57%] [93%, 122s], [INDEXING: 80%, duration: 38s, throughput: 0MPs][RAM: 19.1GB (highest 21.0GB), CPU: 57%] [93%, 123s], [INDEXING: 80%, duration: 38s, throughput: 0MPs][RAM: 19.1GB (highest 21.0GB), CPU: 57%] [93%, 124s], [INDEXING: 80%, duration: 38s, throughput: 0MPs][RAM: 19.1GB (highest 21.0GB), CPU: 57%] [93%, 125s], [INDEXING: 80%, duration: 38s, throughput: 0MPs][RAM: 19.1GB (highest 21.0GB), CPU: 57%] [93%, 126s], [INDEXING: 80%, duration: 38s, throughput: 0MPs][RAM: 19.1GB (highest 21.0GB), CPU: 57%] [93%, 127s], [INDEXING: 80%, duration: 38s, throughput: 0MPs][RAM: 19.1GB (highest 21.0GB), CPU: 57%] [93%, 128s], [INDEXING: 80%, duration: 38s, throughput: 0MPs][RAM: 19.1GB (highest 21.0GB), CPU: 57%] [93%, 129s], [INDEXING: 80%, duration: 38s, throughput: 0MPs][RAM: 19.1GB (highest 21.0GB), CPU: 57%] [93%, 130s], [INDEXING: 80%, duration: 38s, throughput: 0MPs][RAM: 19.1GB (highest 21.0GB), CPU: 57%] [93%, 131s], [INDEXING: 80%, duration: 38s, throughput: 0MPs][RAM: 19.1GB (highest 21.0GB), CPU: 57%] [93%, 132s], [INDEXING: 80%, duration: 38s, throughput: 0MPs][RAM: 19.1GB (highest 21.0GB), CPU: 57%] [93%, 133s], [INDEXING: 80%, duration: 38s, throughput: 0MPs][RAM: 19.1GB (highest 21.0GB), CPU: 57%] [93%, 134s], [INDEXING: 80%, duration: 38s, throughput: 0MPs][RAM: 19.1GB (highest 21.0GB), CPU: 57%] [93%, 135s], [INDEXING: 80%, duration: 38s, throughput: 0MPs][RAM: 19.1GB (highest 21.0GB), CPU: 57%] [93%, 136s], [INDEXING: 80%, duration: 38s, throughput: 0MPs][RAM: 19.1GB (highest 21.0GB), CPU: 57%] [93%, 137s], [INDEXING: 80%, duration: 38s, throughput: 0MPs][RAM: 19.1GB (highest 21.0GB), CPU: 57%] [93%, 138s], [INDEXING: 80%, duration: 38s, throughput: 0MPs][RAM: 19.1GB (highest 21.0GB), CPU: 18%] [93%, 139s], [INDEXING: 80%, duration: 38s, throughput: 0MPs][RAM: 19.1GB (highest 21.0GB), CPU: 50%] [93%, 140s], [INDEXING: 80%, duration: 38s, throughput: 0MPs][RAM: 19.1GB (highest 21.0GB), CPU: 50%] [93%, 141s], [INDEXING: 80%, duration: 38s, throughput: 0MPs][RAM: 19.1GB (highest 21.0GB), CPU: 48%] [93%, 142s], [INDEXING: 80%, duration: 38s, throughput: 0MPs][RAM: 19.1GB (highest 21.0GB), CPU: 51%] [93%, 143s], [INDEXING: 80%, duration: 38s, throughput: 0MPs][RAM: 19.1GB (highest 21.0GB), CPU: 55%] [93%, 144s], [INDEXING: 80%, duration: 38s, throughput: 0MPs][RAM: 19.1GB (highest 21.0GB), CPU: 56%] [93%, 145s], [INDEXING: 80%, duration: 38s, throughput: 0MPs][RAM: 19.1GB (highest 21.0GB), CPU: 55%] [93%, 146s], [INDEXING: 80%, duration: 38s, throughput: 0MPs][RAM: 19.1GB (highest 21.0GB), CPU: 55%] [93%, 147s], [INDEXING: 80%, duration: 38s, throughput: 0MPs][RAM: 19.1GB (highest 21.0GB), CPU: 55%] [93%, 148s], [INDEXING: 80%, duration: 38s, throughput: 0MPs][RAM: 19.1GB (highest 21.0GB), CPU: 55%] [93%, 149s], [INDEXING: 80%, duration: 38s, throughput: 0MPs][RAM: 19.1GB (highest 21.0GB), CPU: 55%] [93%, 150s], [INDEXING: 80%, duration: 38s, throughput: 0MPs][RAM: 19.1GB (highest 21.0GB), CPU: 55%] [93%, 151s], [INDEXING: 80%, duration: 38s, throughput: 0MPs][RAM: 19.1GB (highest 21.0GB), CPU: 55%] [93%, 152s], [INDEXING: 80%, duration: 38s, throughput: 0MPs][RAM: 19.1GB (highest 21.0GB), CPU: 43%] [93%, 153s], [INDEXING: 80%, duration: 38s, throughput: 0MPs][RAM: 19.1GB (highest 21.0GB), CPU: 43%] [93%, 154s], [INDEXING: 80%, duration: 38s, throughput: 0MPs][RAM: 19.1GB (highest 21.0GB), CPU: 28%] sampling: 152.648022s flushing: 152.653615s metadata & hierarchy: 152.655852s deleting temporary files