-
The landscape of Large Language Models (LLMs) is rapidly expanding, and integrating native AI capabilities into the blockchain is a forward-thinking move:
1. Enhanced Productivity: AI has the poten…
-
This is an LFX mentorship project intended to run in the Fall of 2024.
This is related to https://github.com/cncf/mentoring/pull/1287
# Description
Kai is a tool designed to leverage AI for a…
-
Since you tried to implement both with autogen and langgraph can you share experience on which one is better?
-
### Is your feature request related to a problem? Please describe.
The HuggingFace Hub provides an elegant python [client](https://huggingface.co/docs/huggingface_hub/index) to allow users to control…
-
How to make use of ollama models instead of Openai models?
-
How do I get the input and output of each LLM call
-
Hello, I was wondering if you could make a customizable stat system for this and keeps track of it? Maybe XP and the likes?
-
I am using trtllm 0.8.0 (added moe support following llama's implementation). we serve models with trtllm_backend (docker images triton-trtllm-24.02)
[qwen2-moe-57B-A14B](https://huggingface.co/Qwe…
-
-
Running the example:
```
./run.sh $(./autotag local_llm) \
python3 -m local_llm --api=mlc --model=liuhaotian/llava-v1.5-13b \
--prompt '/data/images/fruit.jpg' \
--prompt 'what kind of …