Open DR-DAT4 opened 6 months ago
Hi @DR-DAT4, I wonder if how oobabooga handles the model directories changed - what I would do is start the container manually into a shell:
jetson-containers run $(autotag text-generation-webui) /bin/bash
and then play around with launching oobabooga server.py with different options like is done here:
that should allow you to change around the model dir and see what is going on
Hi, Apologies i seem to be unable to figure this out.
When using the Webui to download a model the list loads correctly and it also downloads giving the confirmation "Model successfully saved to models/Maykeye_TinyLLama-v0/." but in jetson-containers/data/models not even a text-generation-webui folder is created. No change when creating it manually, model still doesnt get saved.
disc usage analysis shows the downloads are stored in the var/liv/docker/overlay2
Using Jetson orin AGX 64 devkit, was all working fine on a 128gb ssd running jetpack 5.1.2 a few days ago. Put in a 1TB ssd and flashed it with 5.1.3 on the ssd (not eemc) and after downloading the models are not shown in the drop down or the file explorer.
I dont get what the hell i did this time differently.