search

KoboldAI / KoboldAI-Client

For GGUF support, see KoboldCPP: https://github.com/LostRuins/koboldcpp
https://koboldai.com
GNU Affero General Public License v3.0
3.47k stars 747 forks source link

The link in the collab does not appear #313

Open Myuless opened 1 year ago

Myuless commented 1 year ago

Here's what comes out Found TPU at: grpc://10.35.80.178:8470 Now we will need your Google Drive to store settings and saves, you must login with the same account you used for Colab. Drive already mounted at /content/drive/; to attempt to forcibly remount, call drive.mount("/content/drive/", force_remount=True). --2023-04-25 04:33:22-- https://koboldai.org/ckds Resolving koboldai.org (koboldai.org)... 172.67.199.170, 104.21.21.176, 2606:4700:3034::6815:15b0, ... Connecting to koboldai.org (koboldai.org)|172.67.199.170|:443... connected. HTTP request sent, awaiting response... 302 Moved Temporarily Location: https://raw.githubusercontent.com/henk717/KoboldAI/united/colabkobold.sh [following] --2023-04-25 04:33:22-- https://raw.githubusercontent.com/henk717/KoboldAI/united/colabkobold.sh Resolving raw.githubusercontent.com (raw.githubusercontent.com)... 185.199.108.133, 185.199.109.133, 185.199.110.133, ... Connecting to raw.githubusercontent.com (raw.githubusercontent.com)|185.199.108.133|:443... connected. HTTP request sent, awaiting response... 200 OK Length: 6675 (6.5K) [text/plain] Saving to: ‘STDOUT’

2023-04-25 04:33:22 (26.9 MB/s) - written to stdout [6675/6675]

mkdir: cannot create directory ‘/content/drive/MyDrive/KoboldAI/’: File exists mkdir: cannot create directory ‘/content/drive/MyDrive/KoboldAI/stories/’: File exists mkdir: cannot create directory ‘/content/drive/MyDrive/KoboldAI/models/’: File exists mkdir: cannot create directory ‘/content/drive/MyDrive/KoboldAI/settings/’: File exists mkdir: cannot create directory ‘/content/drive/MyDrive/KoboldAI/softprompts/’: File exists mkdir: cannot create directory ‘/content/drive/MyDrive/KoboldAI/userscripts/’: File exists mkdir: cannot create directory ‘/content/drive/MyDrive/KoboldAI/presets/’: File exists mkdir: cannot create directory ‘/content/drive/MyDrive/KoboldAI/themes/’: File exists mkdir: cannot create directory ‘/content/KoboldAI-Client’: File exists Reinitialized existing Git repository in /content/KoboldAI-Client/.git/ Fetching origin From https://github.com/koboldai/KoboldAI-Client

Launching KoboldAI with the following options : python3 aiserver.py --model KoboldAI/GPT-NeoX-20B-Erebus --colab 2023-04-25 04:33:45.195169: I tensorflow/core/platform/cpu_feature_guard.cc:182] This TensorFlow binary is optimized to use available CPU instructions in performance-critical operations. To enable the following instructions: AVX2 FMA, in other operations, rebuild TensorFlow with the appropriate compiler flags. 2023-04-25 04:33:48.611429: W tensorflow/compiler/tf2tensorrt/utils/py_utils.cc:38] TF-TRT Warning: Could not find TensorRT MESSAGE | Welcome to KoboldAI! MESSAGE | You have selected the following Model: KoboldAI/GPT-NeoX-20B-Erebus INIT | Starting | Flask INIT | OK | Flask INIT | Starting | Webserver Initializing Mesh Transformer JAX, please wait... Connecting to your Colab instance's TPU Elapsed Time: 0:00:12 [ █ ]

8 TPU cores will be used to run the model.

Running in NeoX compatibility mode.

This model has 20 566 007 808 parameters.

Loading model tensors: 100%|█████████████████████████████████████| 664/664 [19:16<00:00, 1.74s/it] INIT | Starting | LUA bridge INIT | OK | LUA bridge INIT | Starting | LUA Scripts Loading Userscript [Location scanner] INIT | OK | LUA Scripts Traceback (most recent call last): File "/content/KoboldAI-Client/aiserver.py", line 10313, in cloudflare = _run_cloudflared(port) File "/usr/local/lib/python3.9/dist-packages/flask_cloudflared.py", line 68, in _run_cloudflared _download_cloudflared(cloudflared_path, command) File "/usr/local/lib/python3.9/dist-packages/flask_cloudflared.py", line 100, in _download_cloudflared update_cloudflared = subprocess.Popen([(cloudflared_path+'/'+command), 'update'], stdout=subprocess.DEVNULL, stderr=subprocess.STDOUT) File "/usr/local/lib/python3.9/dist-packages/eventlet/green/subprocess.py", line 58, in init subprocess_orig.Popen.init(self, args, 0, *argss, **kwds) File "/usr/lib/python3.9/subprocess.py", line 951, in init self._execute_child(args, executable, preexec_fn, close_fds, File "/usr/lib/python3.9/subprocess.py", line 1821, in _execute_child raise child_exception_type(errno_num, err_msg, err_filename) OSError: [Errno 8] Exec format error: '/tmp/cloudflared-linux-amd64' TPU backend compilation triggered INFO | main:settingschanged:1125 - Saving settings.

henk717 commented 1 year ago

Cloudflare broke, for now you can use Localtunnel to bypass the issue.