-
When building a model with conformal, the output does not print c0 and c1, and only print ymatrix. By the way, where are the yadjusted values?? I would add another column where it says out of domain i…
-
**Presentations + Publications Task:** NLM TG Conference Analysis Plan + Slides Outline
**Due Dates:**
- [x] 06/24/2019 (presentation date)
- [x] Near final draft to @tdbennett by 06/18/2019
…
-
The pretrained MLM+TLM model achieves < 30% Pearson correlation with human scores. With CBOW at 60% and BERT at 86%, this score seems low for the STS-B task.
I am not sure if there is a mistake in …
-
I try to reproduce the CoLA results from the BERT paper (BERTBase, Single GPU).
Running the following command
```
python run_classifier.py \
--task_name cola \
--do_train \
--do_eval \…
-
See [http://journals.plos.org/plosone/article?id=10.1371/journal.pone.0041882](http://journals.plos.org/plosone/article?id=10.1371/journal.pone.0041882)
as well as
[https://en.wikipedia.org/wiki…
-
I am trying to build a review to rating prediction model. I have a CSV of reviews and corresponding ratings by the users [data_500.csv.txt](https://github.com/uber/ludwig/files/2899633/data_500.csv.tx…
-
I received a request to add the Matthews correlation coefficient to the evaluation engine for classification. It can be straightforwardly derived from the confusion table: MCC = (TP \* TN – FP \* FN)/…
-
When I finished the finetune job of CLoA,I want to inference the test.tsv.
But I got zero test sample:
```
...
...
data_dev = task('dev').transform(trans, lazy=False)
dataloader_dev = …
-
Is the `matthews_correlation` metric available?
```
model %>% compile(
loss = 'kld',
optimizer = optimizer_rmsprop(),
metrics = c ( 'matthews_correlation' )
)
```
```
Error in py_cal…
-
Thank you for the great research and code! Regarding this section in the research paper:
"For CoLA (linguistic acceptability), examples are scored as the average token log-probability the
generati…