-
### Feature Description
Despite the successes of large language models (LLMs), they exhibit significant drawbacks, particularly when processing long contexts. Their inference cost scales quadraticall…
-
metagpt "Write a cli snake game"
2024-11-15 15:03:50.927 | INFO | metagpt.const:get_metagpt_package_root:21 - Package root set to /app/metagpt
2024-11-15 15:03:55.243 | INFO | metagpt.team:i…
-
### Feature Idea
Hi.
I just remark that if I press the "cancel" button, and press again "Queue", the v-ram is not cleared.
I used the nodes "ComfyUI_Searge_LLM" (https://github.com/SeargeDP/Com…
-
### System Info
**OS version**: MacOS Sequoia 15.0
My *pyproject.toml*
```
[project]
name = "pandasai-benchmark"
version = "0.1.0"
description = "Add your description here"
readme = "READM…
-
マップ情報をLLMにチューニングしたい.
fortniteGGからスクレイピングするか、Reactで入力ページを作る
-
## Problem Description
When trying to use pipeline parallelism in tensorrt-llm on 2+ NVIDIA GPUs, I encounter ```AssertionError: Expected but not provided tensors:{'transformer.vocab_embedding.weig…
-
Hi experts,
I'm running a 1.3B model on windows with 16GB V100 with below envs, but hit an issue which I couldn't find any clue. Could you please help check it.
TensorRT-LLM version: tag v0.10.0…
-
Test sarvam 2b llm for hindi, kannada, malayalam and other languages
Think about a router to route to particular llm based on language
this is needed for better summarisation for diff indian languag…
-
### Your current environment
The output of `python collect_env.py`
```text
Collecting environment information...
PyTorch version: 2.4.0+cu121
Is debug build: False
CUDA used to build PyTorch…
-
Hi! Have you tried using open-source LLMs for your results? If so, would you be willing to share some instructions on deploying an open-source LLM, such as Llama3?