Does discrete BCQ use vae?

[zichuan-liu]

is this? """
i_loss = F.nll_loss(imt, action.reshape(-1)) """

thx!

[sfujim]

With discrete actions we can avoid using a VAE because a regular classifier can give multimodal outputs. See https://arxiv.org/abs/1910.01708 for details.