search

ludwig-ai / ludwig

Low-code framework for building custom LLMs, neural networks, and other AI models
http://ludwig.ai
Apache License 2.0
10.97k stars 1.18k forks source link

Support for Models stored in GCS bucket #3966

Open kainspraveen opened 3 months ago

kainspraveen commented 3 months ago

Is your feature request related to a problem? Please describe. More often than not in organizations developers don't have access to download models directly from huggingface. It's ususally located in a cloud storage. Would like to add a feature that can directly take gcs link as input inside config.yaml and continue with training the model.

Describe the use case

Describe the solution you'd like config yaml file will take gcs link as input just like it takes a local storage location of the model. It will load the model into a temporary storage and continue with regular fine-tuning or serving etc..

Describe alternatives you've considered A clear and concise description of any alternative solutions or features you've considered.

Additional context Add any other context or screenshots about the feature request here.

kainspraveen commented 3 months ago

would like to assign myself to this issue. #take #self-assign