issues
search
google
/
uncertainty-baselines
High-quality implementations of standard and SOTA methods on a variety of tasks.
Apache License 2.0
1.46k
stars
203
forks
source link
issues
Newest
Newest
Most commented
Recently updated
Oldest
Least commented
Least recently updated
Using prediction based TracIn scores and random scores (baseline) as active sampling signal.
#1230
copybara-service[bot]
closed
1 year ago
1
Fix bug in SKAI data loader and adds some basic unit tests.
#1229
copybara-service[bot]
closed
1 year ago
1
fix test failure in ub/jft
#1228
copybara-service[bot]
closed
1 year ago
0
Open source ub/multimodal directory
#1227
copybara-service[bot]
closed
1 year ago
0
Allows calculation of Tracin values
#1226
copybara-service[bot]
opened
1 year ago
1
Internal.
#1225
copybara-service[bot]
closed
1 year ago
0
Update TODO to be findable by tools.
#1224
copybara-service[bot]
closed
1 year ago
0
Implements stacked image feature. Allows user to specify whether to use post-disaster image only with config flag.
#1223
copybara-service[bot]
closed
1 year ago
1
Adds SKAI dataset.
#1222
copybara-service[bot]
closed
1 year ago
1
Improve support for token-level-score-based top-1 beam inference.
#1221
copybara-service[bot]
closed
2 years ago
0
internal test change
#1220
copybara-service[bot]
closed
1 year ago
1
Reweight by subgroup label.
#1219
copybara-service[bot]
closed
2 years ago
1
util refactoring.
#1218
copybara-service[bot]
closed
2 years ago
0
Question: SNGP initialization of random features
#1217
dhuseljic
closed
2 years ago
2
Supports generating bias table for a given training epoch.
#1216
copybara-service[bot]
closed
2 years ago
0
Support computing multiple signals over multiple epochs.
#1215
copybara-service[bot]
closed
2 years ago
0
Adds evaluation config for signal computation across multiple checkpoints.
#1214
copybara-service[bot]
closed
2 years ago
0
Adds util to support loading multiple checkpoints.
#1213
copybara-service[bot]
closed
2 years ago
0
Adds ensemble training to single model training and fixes bug with .predict calls (new dataloader now returns dict, not just features/labels).
#1212
copybara-service[bot]
closed
2 years ago
1
Add DTD and Random Gaussian datasets to SNGP OOD evaluation
#1211
copybara-service[bot]
closed
2 years ago
0
Add HET-XL support to heteroscedastic library.
#1210
copybara-service[bot]
closed
2 years ago
0
Adds data loader for `waterbirds10K`.
#1209
copybara-service[bot]
closed
2 years ago
0
1) Added model evaluation. 2) Fix bug in active sampling pipeline
#1208
copybara-service[bot]
closed
2 years ago
1
Allows calculation of Tracin values
#1207
copybara-service[bot]
closed
1 year ago
1
Fixed active sampling pipeline to be compatible with recent changes to training
#1206
copybara-service[bot]
closed
2 years ago
1
Adds temperature sampling to `baselines/t5/decoding`.
#1205
copybara-service[bot]
closed
2 years ago
0
Internal
#1204
copybara-service[bot]
opened
2 years ago
0
Adds token-level temperature sampling.
#1203
copybara-service[bot]
closed
2 years ago
0
Adds Decoder model class.
#1202
copybara-service[bot]
closed
2 years ago
0
Adds support for metrics by subgroup. Removes "as_supervised" keys in dataloader so that all features are returned, including subgroup label.
#1201
copybara-service[bot]
closed
2 years ago
1
Update genomics_ood data directory
#1200
copybara-service[bot]
closed
2 years ago
0
Adds regularization to ResNet base model and last output layer. Makes SGD with lr 1e-5 the default params for optimizer. Saves subgroup label for each Waterbirds example in dataloader.
#1199
copybara-service[bot]
closed
2 years ago
1
RETINA Data Install Tutorial
#1198
nband
closed
2 years ago
0
Change how data splits are created to allow more flexibility. Specifically, allow for leave-one-out training and training with a large number of splits of fixed size (for initial bias estimation).
#1197
copybara-service[bot]
opened
2 years ago
1
Allow the option to modify the width of the WideResNet models using a fractionary value.
#1196
copybara-service[bot]
opened
2 years ago
0
Internal.
#1195
copybara-service[bot]
opened
2 years ago
0
Internal
#1194
copybara-service[bot]
opened
2 years ago
0
External demo colab for loading a T5 Plex model and run inference.
#1193
copybara-service[bot]
closed
2 years ago
1
Make model training compatible to CLIP-ResNet models
#1192
copybara-service[bot]
closed
2 years ago
0
Add retrieval utils.
#1191
copybara-service[bot]
closed
2 years ago
0
Internal
#1190
copybara-service[bot]
closed
2 years ago
1
Internal
#1189
copybara-service[bot]
closed
2 years ago
0
Add the option to pass an optional `process_batch_fn` when loading a dataset that overrides its default behavior.
#1188
copybara-service[bot]
opened
2 years ago
0
Fix bias percentile check.
#1187
copybara-service[bot]
closed
2 years ago
1
Fix how to percentile threshold is used (specify integer between 0 and 100, not decimal). Fix sample weight bug (do not use one-hot vector in comparison).
#1186
copybara-service[bot]
closed
2 years ago
1
Internal
#1185
copybara-service[bot]
closed
2 years ago
0
Implements reweighted training with ensemble. Supports specifying the number of splits.
#1184
copybara-service[bot]
opened
2 years ago
1
Robust segvit compatibility + new dataset.
#1183
ekellbuch
opened
2 years ago
0
Implements reweighted training with error. Supports specifying an error percentile as a threshold as well as an upweighting coefficient (using reweighting_lambda).
#1182
copybara-service[bot]
closed
2 years ago
1
Train with reweighting using introspection signal and sweep over lambda. Also supports SGD optimizer.
#1181
copybara-service[bot]
closed
2 years ago
1
Previous
Next