Open karob13 opened 2 years ago
Hi @karob13, recall on eval set is 92.5%, but despite our best efforts its distribution is different from the whole US data corpus. Measuring real FNs is very hard and expensive, and we are missing that part of information. On the other hand, measuring real FP is easy. Someone can just take the sample of extractions and count bad examples.
I'm wondering if this dataset could be considered to be a "complete" dataset of US building footprints, or if not, what estimated percentage are included.
Thank you!