-
As was suggested in https://github.com/ggerganov/llama.cpp/issues/1333
Create a basic inference example for MosaicML MPT-7B model
-
Hi! I'm giving babyagi an objective:
`OBJECTIVE=Find the most innovative home appliances manufacturer`
trying with LLM: vicuna - koala, plain LLaMA
I always end up with this error:
```
****…
-
I run the "npx dalai alpaca install 7B" command, and cmd seems to just stop, without downloading the model. Anyone have any ideas? Thanks!
![9259be87187d661a19bf694cc6dfe08a](https://user-images.gi…
-
Initialization benchmarks are introduced in https://github.com/outlines-dev/outlines/pull/542
We should extend these benchmarks to measure the performance of inference.
# Goal
Outlines shoul…
lapp0 updated
1 month ago
-
### Bug Description
when I run this code:
from llama_index.core import SimpleDirectoryReader
from llama_index.core.embeddings import BaseEmbedding
from llama_index.core.extractors import SummaryEx…
-
**Is your feature request related to a problem? Please describe.**
Request for a deepseek chat_format template
**Additional context**
Deepseek prompt template found here:
https://huggingface.co…
-
I has a local server for llama, it's built with the project:
https://github.com/soulteary/llama-docker-playground
And I want to add it in the system, but it dependence my custom api, so I will a…
-
### Terraform Core Version
1.5.7
### AWS Provider Version
5.29.0
### Affected Resource(s)
resource: aws_sagemaker_model
### Expected Behavior
I'm attempting to create an AWS Sagem…
-
### This is my env version:
```
torch:2.2.1
transformers: 4.39.0.dev0
vllm: custom compile at master@24aecf421a4ad5989697010963074904fead9a1b
```
### I use SqueezeLLM quantization my llama-7B tr…
-
I am using LMstudio and I experiment a lot of frustrations.
I would advice to publish and example how to run it locally with LMStudio or Ollama
Say that I encountered this error with this code:
…