-
按照https://www.lepton.ai/docs/overview/quickstart 执行
- huggingface要代理
```
(.py3) play@mini ~ % lep photon create --name mygpt2 --model hf:gpt2
Failed to create photon: (MaxRetryError("HTTPSConnecti…
-
I think conversationalRetrival would be a great feature on this awesome project. https://python.langchain.com/docs/modules/chains/popular/chat_vector_db Unfortunately i am not good enough to make it w…
-
**Getting the following Error from Terminal, while my browser is stuck at a infinite loop:**
LangChainDeprecationWarning: The function __call__ was deprecated in LangChain 0.1.7 and will be removed…
-
I didn't change anything in run_localGPT.py:
```
model_id="TheBloke/Llama-2-7B-Chat-GGML"
model_basename = "llama-2-7b-chat.ggmlv3.q4_0.bin"
```
I got everything installed until I tried to star…
-
A new set of 7b foundational models that claim to beat all 13b Llama 2 models in benchmarks.
https://huggingface.co/mistralai/Mistral-7B-v0.1
https://huggingface.co/mistralai/Mistral-7B-Instruct-v…
-
I have Python 3.10, ctransformers 0.2.24 ( I tested with 0.2.24 too)
The code
```
llm = AutoModelForCausalLM.from_pretrained('llama-2-7b-chat.ggmlv3.q2_K.bin', model_type='llama')
```
Sistemat…
-
I am trying to use a 'custom tokenizer' but I am unable to see how can I invoke it. Also can we use a standard tokenizer from HF by pulling it or loading from the local path?
-
I am trying to run the project on Linux and I installed the library using following:
```python
CMAKE_ARGS="-DLLAMA_BLAS=ON -DLLAMA_BLAS_VENDOR=OpenBLAS" pip install ctransformers
```
## Q: How t…
-
I started out with experimenting a bit with CTransformers. The device I have been using is
```
ASUS Laptop
16 GB RAM
6 GB NVIDIA RTX 3060
```
And I tried to install `mpt-7B chat` ggml file…
-
I dont understand why the GPU doesnt want to work. its always the CPU
![image](https://github.com/marella/chatdocs/assets/47395819/93b23a9b-cf59-4eda-ae9e-3b491680f01e)