-
I run the file `tensorrt_llm/examples/chatglm2-6b/build.py` using the following commad to build chatglm2-6b model from huggface format to tensorrt-llm format. :
```bash
python3 build.py --mo…
-
This issue is deprecated.
Please submit here: https://www.gptshunter.com/submit-gpt
## Thanks to our sponsor: FlowGPT
Click to view more.
![image](https://github.com/airyland/gptshunter.com/…
-
- [ ] ◆ 0ad : FOSS historical Real Time Strategy (RTS) game of ancient warfare.
- [ ] ◆ 0ad-latest : Real Time Strategy game of ancient warfare (development branch).
- [ ] ◆ 3d-puzzles : 3D-Puzzles …
-
Hi,
Can I check why did you not ignore the loss for the bos token (``)?
https://github.com/jzhang38/TinyLlama/blob/c53075b679c9a97f96562052689e0043120a5fd5/pretrain/tinyllama.py#L197
I notic…
-
I cloned the repo, and ran the tests via `go test ./...`. Some of them seem to fail.
I further restricted this to `go test -v ./pkg/boot/...`, and there still seem to be some failures.
There's a…
-
I followed readme @ https://github.com/microsoft/semantic-kernel/tree/main/dotnet/src/Connectors/Connectors.Memory.Kusto#microsoftsemantickernelconnectorsmemorykusto.
Please find the code snippet b…
-
**Describe the bug**
I'm using Microsoft.SemanticKernel version="1.0.0-beta2"
The `InvokeAsync` method raises an exception:
>The operation was cancelled because it exceeded the configured timeo…
-
### Steps to Reproduce
Use the send_chat_action method in a "MessageHandler" callback for exemple.
`test = await update.effective_chat.send_chat_action(action="upload_document")
`
Here is the ca…
-
### System Info
- TensorRT-LLM v0.8.0 (pinned to release commit)
- Nvidia A100
- Mistral-7B-Instruct-v0.2
- Using the CPP runner
- Installed with `pip install tensorrt_llm==0.8.0 --extra-index-ur…
-
**Is your feature request related to a problem? Please describe.**
It seems like a lot of actions in Guidance are control flows that use a Handlebars template. This requires users of the library to e…