-
Hi Kaicheng,
Thank you, this is super helpful! Considering data privacy issues and the emergence of really powerful small models I think a tutorial for using local LLMs would be very useful. I've e…
-
**Is your feature request related to a problem? Please describe.**
Local LLMs are not suficent supported.
**Describe the solution you'd like**
since most of the local loader, like ollama, ooba's,…
-
当前情况:单卡3090,生成提示词3分钟,出图15秒
盲猜本地llama3-8b表现得速度太慢,是否支持openai这种标准接口?期待回复,再一次感谢作者团队的伟大作品!
-
Assume an LLM responds with something like
```java
package com.eval;
import org.junit.jupiter.api.Test;
import org.mockito.InMockito;
import static org.junit.jupiter.api.Assertions.*;
…
-
so many help videos show devika is running very easily, but in reality it is not so, always getting error 401 and api key error, i have been searching for a solution but not finding it. Any guidance r…
-
Vision LLMs like [Llava](https://huggingface.co/docs/transformers/en/model_doc/llava) or [Idefics](https://huggingface.co/docs/transformers/v4.39.3/en/model_doc/idefics#transformers.IdeficsImageProces…
-
### Summary
# Motivation
WasmEdge is a lightweight inference runtime for AI and LLM applications. Build specialized and finetuned models for WasmEdge community. The model should be supported by Wa…
-
Hi @MaartenGr,
Could you please add more LLMs like supporting DataBricks, Anthropic, and other APis in your LLM arsenal?
-
Do you have any plans to support multimodal LLMs, such as MiniGPT-4/MiniGPT v2 (https://github.com/Vision-CAIR/MiniGPT-4/) and LLaVA (https://github.com/haotian-liu/LLaVA/)? That would be a significan…
-
Multilingual Amazon Reviews Corpus ([MARC](https://paperswithcode.com/dataset/marc)) {En, Jp, De, Fr, Es, Zh} [2015 2019] text classification: review text, the review title, the star rating, an anonym…