search

nasaharvest / presto

Lightweight, Pre-trained Transformers for Remote Sensing Timeseries
https://arxiv.org/abs/2304.14065
MIT License
165 stars 28 forks source link

TreeSatAI evaluation #3

Closed isaaccorley closed 1 year ago

isaaccorley commented 1 year ago

My understanding is that the TreeSatAI dataset is multilabel and the labels can be loaded from the labels.json file provided with the dataset. However, on this line it appears that you are taking the label from the filename and treating it not as a multilabel task but just a multiclass task. Is this correct?

gabrieltseng commented 1 year ago

Thanks for pointing this out, and apologies for the error. I'll work on a fix ASAP

isaaccorley commented 1 year ago

I think it's fine as long as you clarify what task you are doing (multilabel vs multiclass). It wasn't clear from the paper or any readme until I dived in the code itself.

gabrieltseng commented 1 year ago

Hi @isaaccorley - thanks again for pointing this out.

I've updated the code - the new results are in the PR, and I'll update them on arxiv too.