Tanuki / tanuki.py

Prompt engineering for developers
https://pypi.org/project/tanuki.py/
MIT License
670 stars 23 forks source link

Add S3 support for dataset reading and saving #129

Open MartBakler opened 8 months ago

MartBakler commented 8 months ago

Is your feature request related to a problem? Please describe. We need to support reading and saving data to S3 rather than only disk support

Describe the solution you'd like When starting up Tanuki, it should be configurable where data is saved or read from. That should be used to save align statements and patch datapoints and read data for finetuning apart from using local disk