-
I attempted to build triton wheel for macOS on a MacBook with M2 Max chip and the build fails.
Local config: M2 Max, macOS 14.4, Python 3.12.2, with all the project-specific python library depende…
-
Getting an error doing a `pip install triton`
Python version is: 3.10.3
**Error Message:**
```
ERROR: Could not find a version that satisfies the requirement triton (from versions: none)
ERROR: …
-
### System Info / 系統信息
centos 7.9
python 3.10.6
Package Version
absl-py 2.1.0
accelerate 0.33.0
aiobotocore 2.7.0
aiofiles 23.2.1
aiohttp 3.9.5
aioitertools 0.11.0
aioprometheus 23.12.0
a…
-
### Motivation
As described in https://github.com/InternLM/lmdeploy/issues/1280, there are some performance issues with the Triton backend currently implemented in the repo, and its throughput is not…
-
### 联系方式
_No response_
### MaxKB 版本
1.3
### 问题描述
感谢查看问题,现在后端启动时, 完全无响应,无法接收请求,同时修改代码时也不会自动保存,没有任何相关报错信息。
在源代码基础上自己修改增加了rerank功能,但是相关代码全部注释也会有此问题,且没有任何报错信息。
有时启动后完全正常,但修改后端代码自动重启又可能变成无响应状态。
从1.…
-
**LocalAI version:**
2.18.1
**Environment, CPU architecture, OS, and Version:**
Linux localAI 6.1.0-22-amd64 #1 SMP PREEMPT_DYNAMIC Debian 6.1.94-1 (2024-06-21) x86_64 GNU/Linux
**Describe…
-
Apologies if this is already described somewhere, but how can one add a new model not in the library of models already?
I am particularly interested in OSS models and would like to add many of them…
-
I'm reading matmul.py source code. Should [pid_m](https://github.com/openai/triton/blob/27e25f82b64165752bab10ea6267526409158b1d/python/triton/ops/matmul.py#L107) calculation be `pid_m = group_id * GR…
-
### 🐛 Describe the bug
When bumping triton from old pin (989adb9a29496c22a36ef82ca69cad5dad536b9c), to new pin (45fff310c891f5a92d55445adf8cc9d29df5841e) here https://github.com/pytorch/pytorch/pull/…
-
### Your current environment
```text
root@6eb559dd0e72:/app/aphrodite-engine# python3 env.py
Collecting environment information...
PyTorch version: 2.2.1+cu121
Is debug build: False
CUDA used …