-
Would it be possible to add max tokens property to `ModelType` enum, that specifies the maximum number of tokens that the model can consume?
With this property added, one could add a method for che…
-
### Describe the bug
command :
```python
def classify_tokens_gpt3_5_turbo_multiple_parts(email_text: str) -> list:
# Define the prompt
prompt = (
f"Given the request for quotatio…
-
Add [@dqbd/tiktoken](https://github.com/dqbd/tiktoken) to count prompt tokens
Benchmark: https://github.com/transitive-bullshit/compare-tokenizers
-
根据官方模型导出文档：
```
from modelscope.models import Model
from modelscope.exporters import Exporter
model_id = 'damo/nlp_structbert_sentence-similarity_chinese-base'
model = Model.from_pretrained(model…
-
I wrote a demo using openai-java, and my account has been terminated access.
Is it because this library uses multithreading to call OpenAI API, resulting in too high access frequency, which Openai d…
-
**Description**
I want to deploy Triton server via Azure Kubernetes Service.
Target node is `ND96asr v4` which is equipped with 8 A100 GPUs.
Triton server **without** loading any models cannot st…
-
Hey,
First of all, thanks for working on this!
I was trying to get the local `llamacpp` provider working, without much success.
I tried to debug what was going wrong, but my lack of lua knowledge…
-
SRS4.0.116 version, when kicking off a stream, there is a relatively high probability of a crash occurring.
```
build: 2021-05-19 20:54:49, configure: --x86-x64 --stream-caster=on --stat=on --witho…
-
**Starting Words**
Again, thank you very much for this handy library and sorry to have to bother you again🥲
**Describe the bug**
Occasionally when using the API, the service call itself will er…
-
The specific requirements for fine-tuning algorithms for the Hua project are not clear.
2023-07-06 16:20:38.774 | INFO | metagpt.provider.openai_api:update_cost:91 - Total running cost: $0.007 | …