-
**Source**
- *paper*: `Looking Beyond the Surface: A Challenge Set for Reading Comprehension over Multiple Sentences
`
- *paper-url*: `https://www.aclweb.org/anthology/papers/N/N18/N18-1023/`
-…
-
**Issue by [roongtarohit](https://github.com/roongtarohit)**
_Monday Apr 06, 2020 at 02:07 GMT_
_Originally opened as https://github.com/nyu-mll/jiant/issues/1052_
----
Hi,
I want to setup jiant…
-
Excuse me, where can I get the file "MultiRC_IDF_vals.json" in "AIR_evidence_retrieval_scores.py"?
Looking forward to your reply!
-
MultiRC is one of the tasks of the [SuperGLUE](https://super.gluebenchmark.com) benchmark. The task is to re-trace the steps of Facebook's RoBERTa paper (https://arxiv.org/pdf/1907.11692.pdf) and buil…
-
how to get span_end for multibidaf?
-
- Test zero-shot and few shot (5 shots) in each dataset in the notion
To do
- [ ] Test eval pipeline with once model
- [ ] Run batch.sh in Lanta by 1 model 1 GPU config
- [ ] Run batch.sh in Lan…
-
## 问题描述 / Issue Description
请简要描述您遇到的问题。 / Please briefly describe the issue you encountered.
本地/root/ChatGLM目录下载的ChatGLM2-6B模型，
使用vllm部署server：
vllm serve /root/ChatGLM --chat-template ./…
-
**Issue by [varunchaudharycs](https://github.com/varunchaudharycs)**
_Wednesday Apr 29, 2020 at 06:22 GMT_
_Originally opened as https://github.com/nyu-mll/jiant/issues/1081_
----
Hi,
I'm trying o…
-
From the GPT-3 paper
> In order to better aggregate results on NLP tasks and compare to popular models such as BERT and RoBERTa in a more systematic way, we also evaluate GPT-3 on a standardized co…
-
## Describe the bug
We have a test that saves a DatasetDict to disk and then loads it from disk. In 1.6 there is an incompatibility in the schema.
Downgrading to `>1.6` -- fixes the proble…