-
### Summary
[You]:
Write me a short description of the Adidas brand
[Bot]:
^C
### Reproduction steps
alex@M1 ~ % bash
-
This is the code, I achived 4bits with normal libs
import gc
import os
import re
import torch
import tensorflow as tf
import pandas as pd
import matplotlib.pyplot as plt
import nltk
import …
-
### Your current environment
Python3.8
8*A10 GPU
Model:InternVL2-26B
vllm branch:main
torch 2.4.0
torchvision 0.19…
-
### My current environment
````text
[pip3] numpy==2.1.1
[pip3] nvidia-cublas-cu12==12.1.3.1
[pip3] nvidia-cuda-cupti-cu12==12.1.105
[pip3] nvidia-cuda-nvrtc-cu12==12.1.105
[pip3] nvidia-cuda-r…
-
Post your question here about the orienting readings: “[Preface: How to Think with Deep Learning](https://docs.google.com/document/d/1_IiBXAPDNmGHXk2ETmr85eKT9BgjOFqB72D0nRsqnEY/edit?usp=sharing)”, “[…
-
### Summary
I used the following command to run the phi-3 model.
```
wasmedge --dir .:. --nn-preload default:GGML:AUTO:Phi-3-mini-4k-instruct-Q5_K_M.gguf llama-chat.wasm -p phi-3-chat -s "You are…
-
I'm developing AI assistant for fiction writer. As openai API gets pretty expensive with all the inference tricks needed, I'm looking for a good local alternative for most of inference, saving gpt4 ju…
-
### Your current environment
The output of `python collect_env.py`
```
Collecting environment information...
Traceback (most recent call last):
File "/home/kojoe/EasyAnimate/easyanimate/i…
-
### System Info
- `transformers` version: 4.36.0
- Platform: Linux-5.15.0-70-generic-x86_64-with-glibc2.35
- Python version: 3.11.4
- Huggingface_hub version: 0.19.4
- Safetensors version: 0.3.3
…
-
### Summary
```
[INFO] LlamaEdge-RAG version: 0.11.1
[INFO] Model names: aya-23-8B-Q5_K_M
[INFO] Model aliases: default,embedding
[INFO] Context sizes: 16384
[INFO] Batch sizes: 512,512
Error: …