This PR makes it possible to have a separate set of parameters for P_B by setting cfg.model.do_separate_p_b. It also introduces cfg.algo.min_len, which defaults to 0 and prevents and agent from stopping before min_len steps have been taken.
Other changes:
This change required adding a timestep parameter to graph_to_Data across contexts.
While debugging I added a consider_masks_complete flag to contexts, which indicates when masks computed by a context should be taken as ground truth in terms of which actions are valid. This should help in some aspects in the future (e.g. counting parents, debugging new masks).
Adds explicit mask computation in SeqTransformerGFN
This PR makes it possible to have a separate set of parameters for P_B by setting
cfg.model.do_separate_p_b
. It also introducescfg.algo.min_len
, which defaults to0
and prevents and agent from stopping beforemin_len
steps have been taken.Other changes:
graph_to_Data
across contexts.consider_masks_complete
flag to contexts, which indicates when masks computed by a context should be taken as ground truth in terms of which actions are valid. This should help in some aspects in the future (e.g. counting parents, debugging new masks).SeqTransformerGFN