search

SuReLI / SGQN

16 stars 1 forks source link

finger spin #5

Closed kailugaji closed 2 months ago

kailugaji commented 2 months ago

Hello, I am experimenting on the finger spin task in DistractingCS environment, batch size=64, the evaluation result is all 0, while on other tasks there are values, is this the reason for the batch size setting?

DavidBert commented 2 months ago

Hi, we did not test other batch sizes during our experiments. We base most of our implementation on the original DMControl Generalization Benchmark repository and took the default parameters used there. Have you tried vanilla SAC with this batch size?

kailugaji commented 2 months ago

Hi, we did not test other batch sizes during our experiments. We base most of our implementation on the original DMControl Generalization Benchmark repository and took the default parameters used there. Have you tried vanilla SAC with this batch size?

Ok, thank you for your reply