-
Overview:
We want to use pytest's parameterize decorator function to enable the testing of multiple models of a provider.
For example:
We automatically test the LLM's default.
```
@pytest.m…
-
Failed to load model: No LM Runtime found for format 'safetensors!
Model: Phi-3.5-vision-instruct-gguf
![image](https://github.com/user-attachments/assets/0f9b1a82-c260-45bb-a286-9118dcefb33c)
…
-
### Prerequisites
- [X] I am running the latest code. Mention the version if possible as well.
- [X] I carefully followed the [README.md](https://github.com/ggerganov/llama.cpp/blob/master/README.md)…
-
### What happened?
Follow the steps in [README-minicpmv2.5.md#usage](https://github.com/ggerganov/llama.cpp/blob/master/examples/llava/README-minicpmv2.5.md#usage) to convert `minicpm v2.5`. The conv…
-
I tried two gguf conversion on M2 ultra (metal) but no luck. I converted them myself and still the same error.
Here is the first model I tried:
https://huggingface.co/guinmoon/MobileVLM-1.7B-GGUF…
-
- [Phi-3.5-mini-instruct](https://huggingface.co/microsoft/Phi-3.5-mini-instruct)
- [Phi-3.5-MoE-instruct](https://huggingface.co/microsoft/Phi-3.5-MoE-instruct)
- [Phi-3.5-vision-instruct](https://…
-
When attempting to use the `OpenAI` class from `llama_index.llms.openai` and providing running the example from this repo, on this line:
```
agent1 = ReActAgent.from_tools([tool], llm=get_tool_llm…
-
That model is insane for its size ....
https://huggingface.co/microsoft/Phi-3-vision-128k-instruct
-
Paper : [https://arxiv.org/pdf/2406.16860](https://arxiv.org/pdf/2406.16860)
Website : [https://cambrian-mllm.github.io](https://cambrian-mllm.github.io)
Code : [https://github.com/cambrian-mllm/cam…
-
### Please check that this issue hasn't been reported before.
- [X] I searched previous [Bug Reports](https://github.com/OpenAccess-AI-Collective/axolotl/labels/bug) didn't find any similar reports.
…