search

mrbrianevans / social-media-export-analyser

Analyse GDPR exports of your data from big social media companies
https://social-media-export-analyser-mrybc.ondigitalocean.app/
MIT License
1 stars 0 forks source link

Add text search #37

Closed mrbrianevans closed 2 years ago

mrbrianevans commented 2 years ago

Search

To help users find datapoints in a large set of uploaded data (ie find a specific message in a whatsapp chat), there needs to be a text search feature that indexes the data uploaded, and allows the user to make search queries.

Ideally, this would work with any arbitrary data structure, but it might be necessary to specify how to index the data structure in the post processor, which would limit this feature to supported data structures.

mrbrianevans commented 2 years ago

I tried to implement full text search indexing with Go compiled to WebAssembly using the Bleve library, but unfortunately there are some system calls required by Bleve that are not yet supported in WebAssembly, so this idea didn't work.

Instead, I will try use the flexsearch JavaScript library on npm.

mrbrianevans commented 2 years ago

There is now a search bar for any data that is an array. All top level fields of each object are indexed and searched.