Open JFChi opened 1 year ago
Thanks for your interest in using TabLLM! Unfortunately, I currently don’t have access to my computer. I will come back to you on the 11th of April. Sorry for the delay.
Best, Stefan
Hi @JFChi ,
seems like something is going wrong during the metric calculation. It seems to me that the error message is missing in your output. It only refers to the file that contains the error. Could you maybe provide the complete output?
Hi @JFChi ,
seems like something is going wrong during the metric calculation. It seems to me that the error message is missing in your output. It only refers to the file that contains the error. Could you maybe provide the complete output?
Hi @stefanhgm,
Thanks for your reply. The error is in the output of predict
function of EncoderDecoder.py. In order to calculate AUC score in dataset_readers.py, we should have the probabilities of the answer choices. Thus, I think you code add the probability calculation in the EncoderDecoder.py. Could you please upload the updated EncoderDecoder.py? Thanks.
Hi @JFChi,
I added our EncoderDecoder.py
implementation. We retrieve the probabilities to determine the AUC. We also added some functionality to keep track of the best model during validation, however, we did not use this for the final experiments where we choose the same number of epochs for all experiments.
Please let me know if there is anything else I could help you with!
Stefan
Hi there,
I encounter this error when I try to run the code. Could you please take a look at it?