Open saleml opened 1 year ago
Currently, the flow matching loss requires a loop over all possible actions for action_idx in range(self.env.n_actions - 1):.
for action_idx in range(self.env.n_actions - 1):
This might be impractical if the number of actions blows. We might want to explore ways of vectorizing that for loop.
One idea is to "repeat" the states, and creating a big actions tensor.
states
Currently, the flow matching loss requires a loop over all possible actions
for action_idx in range(self.env.n_actions - 1):.This might be impractical if the number of actions blows. We might want to explore ways of vectorizing that for loop.
One idea is to "repeat" the
states, and creating a big actions tensor.