-
For the code:
https://github.com/THUDM/CogVideo/blob/2fdc59c3ce48aee1ba7572a1c241e5b3090abffa/sat/configs/sft.yaml#L39 , **contiguous_gradients** is deepspeed memory optimization, which is **default …
-
Hi @frdel , thanks for your amazing work on this project.
I have noticed that AutoMemory can be quite inefficient, primarily because it embeds the entire message history to find relevant entries. F…
-
Given a simple AI service:
```java
@RegisterAiService
public interface Assistant {
TokenStream chat(@UserMessage String prompt);
}
```
and a simple REST resource:
```java
@Appli…
-
### System Info
- GPU 4 x A10G (EC2 g5.12xlarge) - memory 24GB
- TRTLLM v0.12.0
- torch 2.4.0
- cuda 12.5.1
- tensorrt 10.1
- triton 24.04
- modelopt 0.15
### Who can help?
_No response_
### Info…
-
### Describe the bug
i bought 120M token and for sure 100M of it wasted on fixing bugs that AI itself made it and it goes into a loop sometimes to consume more tokens. please fix them. this way Bolt …
-
### System Info
`transformers==4.46.1`
`python==3.10.14`
### Who can help?
@muellerzr @SunMarc @ArthurZucker
### Information
- [X] The official example scripts
- [ ] My own modified scripts
##…
-
When a task requires a large amount of shared memory (for example, for `torch.Dataloader with batch_size = 100000` (a lot))
The container gives an error:
`ERROR: Unexpected bus error encountered…
-
Hi Everyone,
I am a student that is currently trying to do an AI voice command recognition with a i2s microphone(INMP441) and an esp32-s3- wroom. And I have come to your amazing library that should…
-
### Checked other resources
- [X] I added a very descriptive title to this issue.
- [X] I searched the [LangGraph](https://langchain-ai.github.io/langgraph/)/LangChain documentation with the integ…
-
### Checked other resources
- [X] I added a very descriptive title to this issue.
- [X] I searched the LangChain documentation with the integrated search.
- [X] I used the GitHub search to find a sim…