gharbat
commented
1 year ago Thanks for sharing this, will definitely give it a read this weekend and see how It can make things easier.
Will keep this issue open and updated it once i get more clarity on the tool
Not knowing the complexity of that new option and certain of your overloading with other actual work, it's possible the OnDemandLoader might be a way to support more data sources without hand coding each one.
https://gpt-index.readthedocs.io/en/latest/examples/tools/OnDemandLoaderTool.html