Evaluation metric for offline RL data

[pranavguru]

How do we calculate success rate to evaluate a model that only predicts the next action and not observation state? Can we use similarity in action trajectories instead of success rate as a metric?

[pranavguru]

MSE between model predicted action and expert action for a given timestep. Averaged over all timesteps in an episode, and reported as AMSE.