Open flotufox opened 9 months ago
Sorry, I can't test this extension in google colab. Can you try running it again and give more detailed information about the error?
i tried to run the code in google colab: ################ !echo "dark_theme: true" > /content/settings.yaml !echo "chat_style: wpp" >> /content/settings.yaml !echo "mode: 'instruct'" >> /content/settings.yaml !echo "instruction_template: 'Wizard-Mega WizardLM'" >> /content/settings.yaml
%cd /content/text-generation-webui !python server.py --share --settings /content/settings.yaml --wbits 4 --groupsize 128 --extensions google_translate_plus --loader AutoGPTQ --model /content/text-generation-webui/models/airoboros-l2-13b-gpt4-2.0-GPTQ
#########################
and the full output is shown as following:
/content/text-generation-webui 2023-10-31 15:17:05 WARNING:The gradio "share link" feature uses a proprietary executable to create a reverse tunnel. Use it with care. 2023-10-31 15:17:11.028153: E tensorflow/compiler/xla/stream_executor/cuda/cuda_dnn.cc:9342] Unable to register cuDNN factory: Attempting to register factory for plugin cuDNN when one has already been registered 2023-10-31 15:17:11.028215: E tensorflow/compiler/xla/stream_executor/cuda/cuda_fft.cc:609] Unable to register cuFFT factory: Attempting to register factory for plugin cuFFT when one has already been registered 2023-10-31 15:17:11.028257: E tensorflow/compiler/xla/stream_executor/cuda/cuda_blas.cc:1518] Unable to register cuBLAS factory: Attempting to register factory for plugin cuBLAS when one has already been registered 2023-10-31 15:17:12.139827: W tensorflow/compiler/tf2tensorrt/utils/py_utils.cc:38] TF-TRT Warning: Could not find TensorRT 2023-10-31 15:17:16 INFO:Loading settings from /content/settings.yaml... 2023-10-31 15:17:16 INFO:Loading /content/text-generation-webui/models/airoboros-l2-13b-gpt4-2.0-GPTQ... 2023-10-31 15:17:16 INFO:The AutoGPTQ params are: {'model_basename': 'model', 'device': 'cuda:0', 'use_triton': False, 'inject_fused_attention': True, 'inject_fused_mlp': True, 'use_safetensors': True, 'trust_remote_code': False, 'max_memory': None, 'quantize_config': BaseQuantizeConfig(bits=4, group_size=128, damp_percent=0.01, desc_act=False, static_groups=False, sym=True, true_sequential=True, model_name_or_path=None, model_file_base_name=None), 'use_cuda_fp16': True, 'disable_exllama': False} 2023-10-31 15:18:06 WARNING:skip module injection for FusedLlamaMLPForQuantizedModel not support integrate without triton yet. 2023-10-31 15:18:06 WARNING:models/airoboros-l2-13b-gpt4-2.0-GPTQ/tokenizer_config.json is different from the original LlamaTokenizer file. It is either customized or outdated. 2023-10-31 15:18:06 WARNING:models/airoboros-l2-13b-gpt4-2.0-GPTQ/special_tokens_map.json is different from the original LlamaTokenizer file. It is either customized or outdated. 2023-10-31 15:18:06 INFO:Loaded the model in 49.96 seconds.
2023-10-31 15:18:06 INFO:Loading the extension "google_translate"...
2023-10-31 15:18:06 ERROR:Failed to load the extension "google_translate".
Traceback (most recent call last):
File "/content/text-generation-webui/modules/extensions.py", line 35, in load_extensions
exec(f"import extensions.{name}.script")
File "
using camenduru/text-generation-webui-colab i used following code to download the extension: !aria2c --console-log-level=error -c -x 16 -s 16 -k 1M https://github.com/Vasyanator/google_translate_plus/blob/main/requirements.txt -d /content/text-generation-webui/extensions/google_translate_plus -o requirements.txt !aria2c --console-log-level=error -c -x 16 -s 16 -k 1M https://github.com/Vasyanator/google_translate_plus/blob/main/script.py -d /content/text-generation-webui/extensions/google_translate_plus -o script.py !aria2c --console-log-level=error -c -x 16 -s 16 -k 1M https://github.com/Vasyanator/google_translate_plus/blob/main/settings.json -d /content/text-generation-webui/extensions/google_translate_plus -o settings.json
i used following code to load the extension: --extensions google_translate_plus
when i try to run the model, at the stage : 2023-10-15 14:59:48 INFO:Loading the extension "google_translate_plus"... 2023-10-15 14:59:48 ERROR:Failed to load the extension "google_translate_plus".
Traceback (most recent call last): File "/content/text-generation-webui/modules/extensions.py", line 35, in load_extensions exec(f"import extensions.{name}.script") File "", line 1, in
File "/content/text-generation-webui/extensions/google_translate_plus/script.py", line 1, in
{"payload":{"allShortcutsEnabled":false,"fileTree":{"":{"items":[{"name":"README.md","path":"README.md","contentType":"file"},{"name":"requirements.txt","path":"requirements.txt","contentType":"file"},{"name":"script.py","path":"script.py","contentType":"file"},{"name":"settings.json","path":"settings.json","contentType":"file"}],"totalCount":4}},"fileTreeProcessingTime":1.890233,"foldersToFetch":[],"reducedMotionEnabled":null,"repo":........
NameError: name 'false' is not defined