search

vivekratnavel / omniboard

Web-based dashboard for Sacred
MIT License
548 stars 46 forks source link

Omniboard freezes when displaying metrics plot #242

Open bentaculum opened 3 years ago

bentaculum commented 3 years ago

First, thanks for creating and maintaining omniboard :)

I have remote mongodb instances with Sacred logs and try to connect to them with a a local omniboard install. The initial table view is displayed without issues, as well as the metrics plot of experiments with few iterations. However, when I try to look into the metrics Plot of an experiment with a large number (e.g. 200k) iterations, omniboard does not finish loading the data and freezes completely.

I found a naive workaround: Dump the remote database, copy the dump to my local machine and then restore it in my local mongodb instance. This solves the performance issues and large metric plots can be displayed smoothly. As the experiments db is getting bigger, dump+transfer is obviously not an option in the long run.

The metrics plots at question consists of 10 metrics recorded for 200000 iterations, corresponding to ~ 8MB of data to transfer, connection speed is not an issue. I experience this for various mongodb instances.

omniboard: 2.12.0 installed via npm mongodb: 4.4.1 sacred: 0.8.1 chrome: 87.0.4280.88

vivekratnavel commented 3 years ago

Hi @benjamin9555,

Thanks for using Omniboard! Can you open the network console in Chrome and paste a screen-shot when these metrics are loaded? You would have to open the network inspector first and then open the metrics plot for the experiment to capture the request and response.