-
我尝试利用 rknn-llm 构建一个 OpenAI API兼容的server,由于我对 python 比较熟悉,因此我尝试通过 python 调用 librknnrt.so,并将librknnrt.so的一些函数进行了封装。
rkllm_createDefaultParam 可以正常工作,但是rkllm_init在进行初始化时会自行退出,并且没有任何提示信息,由于librknnrt.so是闭源…
-
问题类型:其它
**问题描述**
使用pip install pycuda进行安装失败,尝试升级驱动10.0及10.2方式都失败了
========================
所有包版本
appdirs 1.4.4
astor 0.8.1
Babel 2.9.0
bce-python-sdk…
-
It is a non-trivial task to understand what needs to be done to implement a new exchange or to modify an existing exchange for additional functionality.
To name a few of the variables that add co…
-
### Proposed new feature or change:
There is a newer package that has been implemented by other major packages such as FastAPI and Llama index which has overwhelming performance gains. I would like t…
-
### Initial Checks
- [X] I have searched Google & GitHub for similar requests and couldn't find anything
- [X] I have read and followed [the docs](https://docs.pydantic.dev) and still think this f…
-
When working with types and one wants to capture generic typescript types and runtime information in one go, without using experimental decorators, which also has limitations when its comes to type ca…
-
### Report
Hi Nimbus-Team,
when trying to run nimbus on a float 32 tiff image I get the following json TypeError while running nimbus.prepare_normalization_dict():
> {
> "name": "TypeError",
…
-
### Description
Tried the diabetes tutorial and ran this:
```
flytectl demo start
cd examples/pima_diabetes
pyflyte run --remote pima_diabetes/diabetes.py diabetes_xgboost_model # as usually prac…
-
in requirement.txt. is it Flask or flask. or it doesn't matter?
-
### Checked other resources
- [X] I added a very descriptive title to this issue.
- [X] I searched the LangChain documentation with the integrated search.
- [X] I used the GitHub search to find a…