Police-Data-Accessibility-Project / meta

Planning our activities with issues that don't fit in a specific repository yet.
GNU General Public License v3.0
693 stars 58 forks source link

Add keywords to data extractions for quick searchability #172

Closed josh-chamberlain closed 1 year ago

josh-chamberlain commented 2 years ago

This process to crawls through Extractions finding recurring words and weighting them by frequency or relevance in an easily referenced "keywords" string.

We should use something like OpenAI or a research tool like Splunk (we have a license) instead of reinventing the wheel.

This is a good balance of allowing a quick search like like "K-9" or "evaluation" to bring up some useful data, though maybe not every single mention.