-
Train and store an RF classifier on a sampling of data from many countries, then see how it performs on a benchmark dataset relative to a classifier trained on data from that country alone
-
You should set number of devices to equal number for CatBoost/XGBoost
so the benchmark in not fair without CUDA_VISIBLE_DEVICES=id, because CatBoost uses all devices by default and this is not a go…
-
Thank you for your great work. I am trying to reproduce the results in "Benchmark 2: Fine-Tuning RoBERTa on GLUE tasks"
I have go through [this issue](https://github.com/jiaweizzhao/GaLore/issues/…
-
- [x] Prepare sparse L factor as benchmark dataset
- [x] Benchmark [Intel SpMP trsv kernel](https://github.com/IntelLabs/SpMP/blob/master/test/trsv_test.cpp#L345) as multi-threaded performance baseli…
-
#### Tested on CF versions `3.34.0` and `3.42.0`
----
I executed `WPI` on [NJR](https://zenodo.org/records/6314162) benchmarks to infer annotations for [Nullness Checker](https://checkerframewor…
-
RB2: Robotic Manipulation Benchmarking with a Twist
Sudeep Dasari, Jianren Wang, Joyce Hong, Shikhar Bahl, Yixin Lin, Austin Wang, Abitha Thankaraj, Karanbir Chahal, Berk Calli, Saurabh Gupta, David H…
-
## Chore
We should cache the dataset used for running fairscale/benchmarks/pipe.py so that we don't end up downloading this at every run. This has been [done for OSS](https://github.com/facebookres…
anj-s updated
3 years ago
-
Hi guys, congrats on your ICLR23-top25% paper. The 'severity' benchmark in your work is impressing. However, up to now I can only find your released dummy dataset in this repo. If you can kindly relea…
-
Traceback (most recent call last):
File "/Applications/PyCharm.app/Contents/helpers/pydev/pydevd.py", line 1741, in
main()
File "/Applications/PyCharm.app/Contents/helpers/pydev/pydevd.py"…
-
Thank you for your solid work.
Does the repo implement the function that pick the model weights that perform best in val dataset to evaluate in test dataset?
From the code below, it seems that the r…