query SOLR, ingest into MatrixMarkov instance

Trogluddite / loombreaker

Tools for building Topic-Specific Web Indexes (CS-480 Capstone)

MIT License

0 stars 0 forks source link

query SOLR, ingest into MatrixMarkov instance #42

Closed Trogluddite closed 9 months ago

Trogluddite commented 9 months ago

Now that we have a working markov bot, and the bot can cite it's sources, we want to load documents from SOLR (instead of our starter location: files on disk).

Trogluddite commented 9 months ago

Marcus and I have chatted about this a bit: he's going to:

experiment with the python requests library, to make it query our SOLR API.
parse results from that request into an instance of MatrixMarkov, using load_docs.py as an example.

Once that's working, we'll integrate that code into the discord robutt in one way or another.