Clay-foundation / model

The Clay Foundation Model (in development)
https://clay-foundation.github.io/model/
Apache License 2.0
262 stars 30 forks source link

Add option to output raw patch embeddings #133

Closed yellowcap closed 5 months ago

yellowcap commented 6 months ago

This PR adds an option to the Lightning CLI to output patch level embeddings. I.e. one embedding per patch in each chip. The band group dimension is reduced and, so the patch embeddings are averages over the band groups.

This adds two args to the CLI output_patch_embeddings, and shuffle. Because for the patch embeddings we need to ensure that shuffle is off, while it is on by default. See also https://github.com/Clay-foundation/model/issues/123.

Updated the documentation to explain these changes.

This PR Closes https://github.com/Clay-foundation/model/issues/130