-
Subscribe to this issue and stay notified about new [weekly trending repos in Python](https://github.com/trending/python?since=weekly)!
-
# URL
- https://arxiv.org/abs/2203.13366
# Affiliations
- Shijie Geng, N/A
- Shuchang Liu, N/A
- Zuohui Fu, N/A
- Yingqiang Ge, N/A
- Yongfeng Zhang, N/A
# Abstract
- For a long time, diff…
-
https://virtual2023.aclweb.org/paper_P1149.html
-
Forgive the bluntness, but MemGPT is one of the hardest pieces of AI software to get to grips with at the moment because of an unfortunate conjunction of two things it tries to do well.
You've trie…
-
TensorRT-LLM v0.12.0 Tag
Model generation is less than ideal when building an FP16 variant of Llama 3.1 on SM 7.5 GPU(s) as opposed to building a BFP16 variant on SM 8.0 GPU(s).
transformers was upgr…
-
**Describe the bug**
When trying to use Azure Openai by setting the .env file, I get the following issue:
"Did not find openai_api_key, please add an environment variable `OPENAI_API_KEY` which …
-
Framework not specified. Using pt to export the model.
====Exporting IR=====
Loading checkpoint shards: 0%| | 0/7 [00:00
-
## Description
I am trying text generation example with GTP2 as shown [here](http://gluon-nlp-staging.s3-accelerate.dualstack.amazonaws.com/PR-1010/8/model_zoo/text_generation/index.html):
I am us…
-
Hello,
I am new explorer of MII.
When I am trying to do the batch inference, something like this
```
start_text = ["blablabla..."]
batch_size = 10
result = generator.query({"query": start_text …
-
```
~~> nix run .#textgen-nvidia -- --api --auto-launch
Running on local URL: http://127.0.0.1:7860
To create a public link, set `share=True` in `launch()`.
2023-12-12 23:44:37 ERROR:Could not fi…