search

EclipseFdn / open-vsx.org

Source of open-vsx.org
https://open-vsx.org/
Eclipse Public License 2.0
135 stars 40 forks source link

Procedure for the clean up of the database #2844

Open chills-eclipse opened 4 weeks ago

chills-eclipse commented 4 weeks ago

Hi John. We need a procedure on how to clean up the database from time to time to prevent the size to become uncontrollable. Can you please provide us the steps on what we can clean etc. Thanks

denisroy commented 4 weeks ago

See also: https://gitlab.eclipse.org/eclipsefdn/helpdesk/-/issues/4157#note_1703626

kineticsquid commented 4 weeks ago

@chills-eclipse Yep, something we need to get back to. @amvanbaren Thoughts?

amvanbaren commented 3 weeks ago

@kineticsquid You want to move forward on https://github.com/eclipse/openvsx/pull/888?

kineticsquid commented 3 weeks ago

@amvanbaren MS doesn't limit extension versions. I'd like to see what other options we have.

The biggest offender is the file table. And there appear to be two API calls that could reference the table,

Are there other API calls that reference the table?

I'm wondering if then consider where these API calls are coming from, we might be able to limit the size of the able. Where are calls to this API originating?

In this Gitlab issue, https://gitlab.eclipse.org/eclipsefdn/helpdesk/-/issues/4797, @denisroy provided a dump of the access logs and I took a look at the use of the API