00:00 Welcome!
1:17 Agenda
2:23 Part 1: Introduction and UQ360 web-interface
2:58 UQ in human-AI collaboration
4:08 UQ for Model Improvement
4:40 Are AI model uncertainties reliable?
10:05 UQ algorithms
11:18 UQ communication methods
11:57 Workflow: UQ360 toolkit
12:48 Interactive UQ360 website
13:14 Web Demo: House price prediction model
17:41 Other features of website
19:30 Part 1 Q/A
27:55 Part 2: Fast UQ via Infinitesimal Jackknife
28:20 Ordinary supervised learning
30:04 Perturbing and refitting method
33:51 Weighted risk minimization
36:21 Key idea for IJ
38:44 Approximate! Don't refit
41:13 Extensions to structured models
41:39 Demo: Infinitesimal Jackknife
57:06 Part 3: Meta-modeling and UCC
58:00 Meta-modeling for UQ
1:00:48 Why MM?
1:03:07 MM in UQ360
1:03:44 Class Interface for UQ360 MM
1:04:51 Demo: MM for a regression task
1:11:41 Part 3 Q/A
1:15:00 Uncertainty Characteristics Curve
1:17:42 Motivation for UCC
1:19:20 UCC and Band-excess vs Miss-rate trade-off
https://www.youtube.com/watch?v=5_yDVdC36wI
00:00 Welcome! 1:17 Agenda 2:23 Part 1: Introduction and UQ360 web-interface 2:58 UQ in human-AI collaboration 4:08 UQ for Model Improvement 4:40 Are AI model uncertainties reliable? 10:05 UQ algorithms 11:18 UQ communication methods 11:57 Workflow: UQ360 toolkit 12:48 Interactive UQ360 website 13:14 Web Demo: House price prediction model 17:41 Other features of website 19:30 Part 1 Q/A 27:55 Part 2: Fast UQ via Infinitesimal Jackknife 28:20 Ordinary supervised learning 30:04 Perturbing and refitting method 33:51 Weighted risk minimization 36:21 Key idea for IJ 38:44 Approximate! Don't refit 41:13 Extensions to structured models 41:39 Demo: Infinitesimal Jackknife 57:06 Part 3: Meta-modeling and UCC 58:00 Meta-modeling for UQ 1:00:48 Why MM? 1:03:07 MM in UQ360 1:03:44 Class Interface for UQ360 MM 1:04:51 Demo: MM for a regression task 1:11:41 Part 3 Q/A 1:15:00 Uncertainty Characteristics Curve 1:17:42 Motivation for UCC 1:19:20 UCC and Band-excess vs Miss-rate trade-off