-
It would be nice to segment character iterators, especially for interoperability with the `unicode-normalization` crate. This could provide a solution to #7 when/if `io::Chars` stabilizes. In particul…
-
- Single video url: https://vybory.mos.ru/voting-stations/28102?channel=0
- Playlist: https://msk-cache-4-1-h.cdn.vybory.mos.ru/master.m3u8?sid=e252c26a-a563-11e8-812f-00259057913e
and some other …
nmr50 updated
5 years ago
-
### Describe the bug
When using streaming datasets set up with train/val split using `.skip()` and `.take()`, the following error occurs when iterating over a torch dataloader:
```
File "/Users/j…
-
A couple issues with the new tensor parallelism implementation!
1) Tensor Parallelism doesn't appear to respect a lack of flash attention, even via the -nfa flag. It also doesn't document flash att…
-
As part of e2e training, encountered wild loss curve spikes:
After additional hyperparam tuning and further investigation, the root cause is that we are reading the dataset sequentially, so to …
-
> Thanks - I need to upgrade this plugin to the latest Replicate library version and make a bunch of changes.
_Originally posted by @simonw in https://github.com/simonw/llm-replicate/issues/24#issu…
-
### Question Validation
- [X] I have searched both the documentation and discord for an answer.
### Question
i was using 3900 tokens before while using chatmemorybuffer from llamaindex
facing i…
-
I saw the falcon blog: https://github.com/huggingface/blog/blob/main/falcon.md and here: https://huggingface.co/blog/falcon.
I tried using it but I noticed setting eos = pad leads to the issue whe…
-
### Checklist
- [X] 1. I have searched related issues but cannot get the expected help.
- [ ] 2. The bug has not been fixed in the latest version.
- [X] 3. Please note that if the bug-related issue y…
-
how to add eos token