-
Hi,
I am trying to test Lagllama on a prediction task. the dataset i feed is what i use for context. then using that context, i want it to make predictions. however, the first step of the predictions…
-
I'm trying out the new Unlimiformer llama-2 code on llama-2-7b-chat-hf, on a 24GB 3090.
I understand Unlimiformer probably wasn't created with consumer GPUs in mind, but I'd hoped I'd be able to sque…
-
Running `npx dalai llama install 7B` it creates a directory `"$HOME"/dalai` with 34 GB of content.
Is it possible to configure a different directory?
-
## Objective
Create an adapter for https://defillama.com/ for the Meter Chain
## Context
The Meter ecosystem is poised for growth. We are looking to gain exposure to broader DeFI users throug…
-
### What is the issue?
I installed ollama today, the system is Ubuntu2204,I downloaded llama3.1-405b-Q2.gguf,There are 9 split files in total. Ollama create llama -f Modelfile.txt is completed succes…
-
### Bug Description
My nodes is a list of `ImageNode` objects, I only have images with their metadata, where each node is defined as
```python
nodes.append(
ImageNode(
image_path=pa…
-
### Feature request
Recently, we have added the ability to load `gguf` files within [transformers](https://huggingface.co/docs/hub/en/gguf).
The goal was to offer the possibility to users …
-
Server OS:
Homeasisstant OS on a Proxmox vm
Ai renderer OS:
Windows 10
**Approach**
After entering all connection credentials, the OpenAI API, OpenAI API admin key, as well as the model name …
-
### Bug Description
async def generate_reply_content_async(content, original_message):
try:
# 检查缓存
cache_key = hash(content)
if cache_key in query_cache:
…
-
Hello 👋
This issue is for #43
I am creating this issue to demonstrate a use case of Llama Guard in filtering and auto-adjusting prompts for safe input in image generation models. I will be usi…