chovanecm / sacredboard

Dashboard for sacred. Monitor and access your past machine learning experiments.
MIT License
184 stars 39 forks source link

Pymongo crashes when ordering by anything different than ID #98

Closed Gonzalo933 closed 6 years ago

Gonzalo933 commented 6 years ago

I like to sort my experiments by "last activity" and recently the number of experiments stored on my DB has increased.

Today I opened sacredboard, and it crashed whenever I try to go to the next page or increase the number of entries per page. I can post the whole stack trace but this is the important bit:

pymongo.errors.OperationFailure: Executor error during find command: OperationFailed: Sort operation used more than the maximum 33554432 bytes of RAM. Add an index, or specify a smaller limit.

I think that the problem is that sorting by any other field that is not "ID" triggers this error. I currently have 60 experiments on the DB.

chovanecm commented 6 years ago

Hi Gonzalo, this is unfortunately a known issue and an open point. Please try adding some database indices to the fields you'd like to sort by. See #70.