search

gordonwatts / snowmass-chat

Experiments exploring the US Snowmass Process documents using LLM
Apache License 2.0
2 stars 0 forks source link

Implement the cache as an fsspec file system (S3, etc.) #6

Open gordonwatts opened 11 months ago

gordonwatts commented 11 months ago

The current cache is just the local file system. Re-implement it as a fsspec file system as then it can be shared by everyone working on a common project. Espeically true given the rate limits required for the archive.