Adding the ability to support large file uploads with intermediate saving checkpoints - Githubissues

567-labs / fastllm

A collection of LLM services you can self host via docker or modal labs to support your applications development

MIT License

181 stars 23 forks source link

Adding the ability to support large file uploads with intermediate saving checkpoints #34

Closed ivanleomk closed 8 months ago

ivanleomk commented 8 months ago

Made the following changes

deleted local.py and upload.py since I don't think they're needed now
refactored out some of the logic into helper functions so that it reads a bit more easily
Cleaned up the vars in main.py so that config and constants variables are all capitalised by default
cleaned up download.py and removed the useless functions.

Also added an example of how to use the Modal cli volume feature with an example for ls and rm inside the Readme file.