Closed jc-bao closed 1 year ago
$\pi(x,e)$ error: 0.264
MLP: $\pi(x,e)$ error: 0.217 (variance is large. ) $\pi(x)$ error: 0.123 Polynomial: ✔️ $\pi(x,e)$ error: 0.053 $\pi(x)$ error: 0.16
Last 10 steps average tracking error. | Expert | RMA before adaptation | RMA after adaptation | Vanilla(Robust) |
---|---|---|---|---|
0.053 | 0.083 | 0.058 | 0.147 | |
C-4 Expert | C-4 RMA before adaptation | C-4 RMA after adaptation | ||
0.067 | 0.097 | 0.074 | ||
$f(v)$ Expert | $f(v)$ RMA before adaptation | $f(v)$ RMA after adaptation | ||
0.008 | 0.028 | 0.007 |
Experiment settings
Current result
*C-4: use MLP to compress all parameters to a 4-dimensional embedding.
Possible solutions