Compare performance to first version of models - Githubissues

allenai / satlas

Apache License 2.0

202 stars 24 forks source link

Compare performance to first version of models #47

Open favyen2 opened 3 months ago

favyen2 commented 3 months ago

The 1 October 2023 models seem to provide worse downstream performance than these that were previously trained:

High-resolution, single-image (NAIP + others @ 0.5-2 m/pixel): https://ai2-public-datasets.s3.amazonaws.com/satlas/satlas-model-v1-highres.pth
High-resolution, multi-image: https://ai2-public-datasets.s3.amazonaws.com/satlas/satlas-model-v1-highres-multi.pth
Sentinel-2, single-image: https://ai2-public-datasets.s3.amazonaws.com/satlas/satlas-model-v1-lowres.pth
Sentinel-2, multi-image: https://ai2-public-datasets.s3.amazonaws.com/satlas/satlas-model-v1-lowres-multi.pth
Sentinel-2, multi-band, single-image: https://ai2-public-datasets.s3.amazonaws.com/satlas/satlas-model-v1-lowres-band.pth
Sentinel-2, multi-band, multi-image: https://ai2-public-datasets.s3.amazonaws.com/satlas/satlas-model-v1-lowres-band-multi.pth