WorldBrain / Memex

Browser extension to curate, annotate, and discuss the most valuable content and ideas on the web. As individuals, teams and communities.
https://worldbrain.io
4.43k stars 339 forks source link

What to do when storage quota is exceeded `QuotaExceededError` #845

Closed daviddias closed 9 months ago

daviddias commented 5 years ago

If reporting a bug:

  1. Can you describe the problem and bug in more detail?

As soon as I imported my bookmarks, pocket and browsing history, I immediately filled my browser quota for the Storex. It seems that it is simply hitting the Group Limit

https://developer.mozilla.org/en-US/docs/Web/API/IndexedDB_API/Browser_storage_limits_and_eviction_criteria

  1. How can we replicate the issue?

  2. Expected behavior (i.e. solution)

  3. Error stack (from extension crash page)

Error: QuotaExceededError The current transaction exceeded its quota limitations.

  1. Other comments

Do you have any advice to work around this? Have you considered some "hacks" such as:

blackforestboi commented 5 years ago

yeah we have issues with firefox. It is not committing to the infinite persistent storage of the spec. That is why by default on new extensions we disable screenshots.

How many items did you import? 2gb even for full-text should mean it is roughly 130.000 items? (which is a lot) :D

daviddias commented 5 years ago

yeah we have issues with firefox. It is not committing to the infinite persistent storage of the spec.

This is interesting. Do you have a reproducible test? We could add this to the list at https://github.com/arewedistributedyet/arewedistributedyet/issues as it will be essential to enable full P2P apps on Firefox.

How many items did you import? 2gb even for full-text should mean it is roughly 130.000 items? (which is a lot) :D

How did you reach the 130000 number?

My import looks like:

Screenshot 2019-07-03 at 08 03 51

In a fresh memex import, it starts crashing at

Screenshot 2019-07-03 at 09 34 56

I wanted to get the console log but unfortunately the browser got so stuck that not even the console would open

Now that I've reopen the browser with memex with the goal of finishing my import (mostly pocket bookmarks), I am getting

image

Other than the numbers, these logs are not super useful. Is there anything I can provide that would help you point me on the right direction? Thanks in advance!