Rewrite the interval OP extension to refine usability (no runtime complication anymore) and efficiency (the previous implementation is actually very slow).
Add a timeout parameter in the multiprocessing testing instance.
Fix a bug in parameter reallocation. Intervals are sorted according to keys, rather than the starts of intervals.
Remove the sequence_parallel parameters in parameter realloaction test, since it actually does not matter.
Support carrying metadata in data transfer.
Fix a KeyError bug in master worker that was caused by clearing data before finishing a training step.
Fix a bug of comparing different parallel strategies. We should not consider sequence_parallel when deciding model_names.
Changes:
Rewrite the interval OP extension to refine usability (no runtime complication anymore) and efficiency (the previous implementation is actually very slow).
Add a timeout parameter in the multiprocessing testing instance.
Fix a bug in parameter reallocation. Intervals are sorted according to keys, rather than the starts of intervals.
Remove the sequence_parallel parameters in parameter realloaction test, since it actually does not matter.
Support carrying metadata in data transfer.
Fix a KeyError bug in master worker that was caused by clearing data before finishing a training step.
Fix a bug of comparing different parallel strategies. We should not consider sequence_parallel when deciding model_names.