search

BY571 / Implicit-Q-Learning

PyTorch implementation of the implicit Q-learning algorithm (IQL)
42 stars 4 forks source link

offline training #4

Open roger-creus opened 1 year ago

roger-creus commented 1 year ago

Hi! Is offline training now fully supported? I am confused because I see the train_offline script but in the README I see that you say that offline training is not implemented. Maybe not with the D4RL dataset, but should it work for any dataset of experiences (s,a,r,s',d)?

Thank you!

stijnmeels commented 10 months ago

@BY571 I am really curious to know this as I want to implement discrete IQL on a project I am working on. Kind regards,

Stijn