Open KastanDay opened 1 year ago
Solution: It appears the bug originates in the receive()
function.
# bad:
task.rankings = pressed_vals
# good
task.data.rankings = pressed_vals
My suggested solution:
def receive(self, *inp):
_, task, pressed_vals = inp
task.data.rankings = pressed_vals
return task
The present()
function uses this style, which may be preferable.
data : LMGenerationElement = task.data
, but seems too verbose in this case.
Describe the bug Printing the results in extract_data() here, the
rankings
areNone
. The rankings are also missing from the producedrankings_dataset
file.To Reproduce Steps to reproduce the behavior:
instruct_hf_pipeline
, e.g.python -m examples.instruct_hf_pipeline
Expected behavior
rankings
should be a list of ints, corresponding to the human labeler's decisions.Example buggy result (printing inside
extract_data()
):The
LMGenerationElement
does not report an error, but is missing the rankings.If I solve the issue I'll comment here. Thx.