Buffer size - Githubissues

sfujim / BCQ

Author's PyTorch implementation of BCQ for continuous and discrete actions

MIT License

599 stars 139 forks source link

Closed jack1442 closed 5 years ago

jack1442 commented 5 years ago

Why is the default buffer size 10% of the paper's?

sfujim commented 5 years ago

The defaults are all set for the "imperfect demonstrations" task, which uses 100k transitions rather than 1 million.