Closed EricWiener closed 10 months ago
Thank you for reaching out and sharing the details of the issue you are facing. First and foremost, it's important to note that there are two weight files for the 13B model. Besides the one you mentioned, you also need consolidated.01-of-02.model.pth. The pretrained_path should point to the directory containing both .pth files.
Our demos are designed to work on a single computer. However, under the default settings, the 7B model requires 1 GPU, the 13B model requires 2 GPUs, and so forth. To facilitate a smooth setup, I would recommend you to utilize bash demos/start.sh as it provides detailed guidance on configuring each step. This should hopefully address the issues you are encountering and enable you to run the multi-modal model on your machine successfully.
Should you require further assistance or have any additional questions, feel free to contact us. We're here to help!
I tried running with:
and I get the error:
Commenting out
fs_init.initialize_model_parallel(args.model_parallel_size)
results in a failure later on.Is there a working demo for a multi-modal model on a single computer?