search

archesproject / arches

Arches is a web platform for creating, managing, & visualizing geospatial data. Arches was inspired by the needs of the Cultural Heritage community, particularly the widespread need of organizations to build & manage cultural heritage inventories
GNU Affero General Public License v3.0
216 stars 144 forks source link

Update nonlocalized string search to correct the null search performance issue #11347

Closed aarongundel closed 2 months ago

aarongundel commented 2 months ago

There's an issue with the null/empty search performance for non-localized string nodes in very large datasets. Performance is dramatically slower because of the base painless script. This bypasses that problem only for this datatype.

Also extracting nonlocalized string (similar to geojson feature collection datatype).

apeters commented 2 months ago

I was interested in the fix, but after looking at it I realized that this will fail the Has no value search when a single resource instance with a cardinality "n" card has one tile with a null "non-localized-string" node and another tile with a value in the "non-localized-string" node. This was the core reason for using the "painless" script from what I can recall.

Not sure how to resolve this @aarongundel and @chiatt