-
-
I have tried to convert llama 2 model from .gguf to .bin
```
~/llm_inferences/llama.cpp/models/meta$ ls
llama-2-7b.Q4_K_M.gguf
python3 export.py llama2_7b.bin --meta-llama /home/####/llm_inf…
-
Hi! I learned about Agency-Swarm from your videos. They are very good, thank you.
You made a video, saying that there is open source LLM support. Is there a guide to using locally hosted LLMs?
W…
-
Running on 1xH100 with latest docker container from docker hub
```
>>> fast_pipe = optimum_pipeline('text-generation', 'meta-llama/Meta-Llama-3-8B-Instruct', use_fp8=True)
Special tokens have bee…
-
Add another channel for small talk that utilizes AI...possibly hardcode something like `What are fun things to do around ${location}` as the prompt.
[Potentially helpful reference on how to do this…
-
- [ ] [Comparing LLM Performance: Introducing the Open Source Leaderboard for LLM APIs](https://www.anyscale.com/blog/comparing-llm-performance-introducing-the-open-source-leaderboard-for-llm)
# Comp…
-
**Open source LLM seems to be struggling to grasp how to call Action and Action Input even after repeated errors while in runtime.**
Action 'Ask question to co-worker (NewsFetcher)' don't exist, th…
-
This document outlines the steps in the AIOS roadmap for refactoring the LLM structure. Feel free to discuss any of the following topics, and add any other topics you'd like to talk about in this issu…
-
### Your current environment
```Collecting environment information...
Traceback (most recent call last):
File "/home/yangzhiyu/workspace/open-long-agent/collect_env.py", line 721, in
main()…
-
- Start LLM
- Close laptop
- Sleep 8 hours
- Open laptop
- Issue command to LLM