alan-turing-institute / reginald

Reginald repository for REG Hack Week 23
3 stars 0 forks source link

Update data preparation in LlamaIndex #82

Closed rchan26 closed 12 months ago

rchan26 commented 1 year ago

Thanks to @rwood-97 (in #69, #81), we have examples in models/llama-index-hack of using llama-hub readers to pull directly from markdown files and to pull issues & docs from repos. We now need to update the _prep_documents method in the LlamaIndex class to use these.

We can then remove the some data from from the repo.

rwood-97 commented 12 months ago

See PR #92