rerun-io / rerun

Visualize streams of multimodal data. Fast, easy to use, and simple to integrate. Built in Rust using egui.
https://rerun.io/
Apache License 2.0
6.26k stars 292 forks source link

Reference all performance bottlenecks highlighted by "air traffic" example #5799

Open teh-cmc opened 5 months ago

teh-cmc commented 5 months ago

The recently added air traffic example highlights a lot of performance bottlenecks in every single corner of the app (and probably SDK too now that I think of it...).

All these bottlenecks should have a dedicated issue explaining what's going on so we can investigate them at some point.

The first thing to try out is the cleaned up dataset, which demonstrates a lot of performance issues with normal looking data:

python examples/python/air_traffic_data/main.py --dataset 2h

and then move on to the raw dataset, which adds another layer of issues specific to ill-formed data (which ironically is more likely to be what's in the wild):

python examples/python/air_traffic_data/main.py --dataset 2h --raw
abey79 commented 5 months ago
teh-cmc commented 2 months ago

Let's see how that behaves once 0.18 is ready to go.

emilk commented 1 month ago

This hits the performance problem of many entities:

abey79 commented 1 month ago

0.18 significantly increase frame time on my computer (3d view latest at and one plot with all data)

top 0.17, bottom main as of today. image