GlennRicaud / data-toolbox-app

Apache License 2.0
10 stars 1 forks source link

Search for blobs #72

Open espen42 opened 1 year ago

espen42 commented 1 year ago

We're having some problems with corrupt references to blobs (that are empty or missing etc). The error messages often only mention blob ID's and that they can't be referred.

We'd like a new feature (or if it's already possible, just to know how to do it), possibly under "Node search": look for all nodes that refer to a blob by ID.

GlennRicaud commented 1 year ago

Hei Espen,

This is not possible as of now using DT. This kind of information is not exposed through the classic node search but it is technically doable by accessing ElasticSearch directly. It will take me a bit of time to do this as the idea would be to expose the ElasticSearch indexes directly through DT.

Meanwhile, what can help is the XPDoctor if you are familiar (https://market.enonic.com/vendors/runar-myklebust/xpdoctor). I think one of the option is to try to load related blob so you should get a list of all nodes that have blobs not found.

Or if the HTTP endpoint of elasticsearch is open (port 9200 by default), you could try to query for it manually.

GlennRicaud commented 1 year ago

If you go with the manual querying, what you want is to query on the index "storage-xxx" of your repository and there you have 2 types "branch" and "version". These nodes contain the reference to the blobs (yes there are multiple blobs referenced): accesscontrolblobkey, nodeblobkey, indexconfigblobkey