-
Hi!
Quick question, is it possible to train Vicuna-13B with 8xA100(40GB) (320GB)?
If yes, will it need any special setup different than this one ?
```
torchrun --nproc_per_node=8 --master_port…
-
## Keyword: sgd
There is no result
## Keyword: optimization
### Joint Information and Mechanism Design for Queues with Heterogeneous Users
- **Authors:** Authors: Nasimeh Heydaribeni, Achilleas Ana…
-
Run times error:
Traceback (most recent call last):
File "/home/nlp/MyProject/LEAD/main.py", line 49, in
pipeline.initialize()
File "/home/nlp/MyProject/LEAD/pipeline/BasicPipeline.py", …
-
Hi @nreimers ,
First of all, I would like to thank you for this great project. Your sentence transformers were much easier to implement that of hugging face. I would also like to thank you for being…
-
In this function: https://github.com/czlwang/BrainBERT/blob/master/util/mask_utils.py#L28
Shouldn't lines 48-49 come after the for loop on line 52?
Your masked_labels and masked input don't align
-
Thank you for your great work!!
TrOCR working fine on single text line images. But the speed is slow on even V100 GPU, it taking 600 ms for single text line. As currently it take 384x384 size input, …
-
在您代码 `models/prompt.py` 中的 `Prompt` 中使用了 BERT,请问 BERT 权重是否冻结了,BERT 参数也是可更新的吗 ?
若没有冻结,参考刘知远老师 _"PPT: Pre-trained Prompt Tuning for Few-shot Learning"_,`HPT` 的训练方式是 `Prompt-oriented Fine-tuning` 吗 …
-
**Describe the bug**
Intuitively, the Init() context seems like it should be idempotent. It should activate model partitioning, and calling it again shouldn't have any unexpected consequences.
How…
-
I am currently trying to optimize an AL pipeline using small-text therefore I am looking into the source code and came across something slightly bizarre looking, namely in the `\integrations\transform…
-
1. only take sentences (100-128 tokens)
2. evaluate sota model code on 100- 128 tokens (train our code and sota)
3. Just run bert model on 100 - 128 tokens
4. Vader Polarity Visualization for pos/n…