Update docs with benchmark tutorial

Clay-foundation / model

The Clay Foundation Model (in development)

https://clay-foundation.github.io/model/

Apache License 2.0

262 stars 30 forks source link

Update docs with benchmark tutorial #141

Closed brunosan closed 1 month ago

brunosan commented 5 months ago

After #117 has closed, I think we should update the documentation in two places, which I think are both small changes:

[ ] Add a new model benchmark section, so in all future versions we compared how the scores are improving.
[ ] Add the code in the finetune section to help users apply finetuned for a random places with random labeled data, using the floods as the example.

lauracchen commented 4 months ago

Re-upping this @yellowcap - can we incorporate this in the next sprint?

yellowcap commented 4 months ago

Potentially, we did work on this back in December and early January, but without having a finalized version. In January we de-prioritized the systematic benchmarking in favor of creating more hands-on examples.

@lillythomas what would it take to document how to do fine tuning?

Refs https://github.com/Clay-foundation/model/pull/87 https://github.com/Clay-foundation/model/issues/117

yellowcap commented 1 month ago

Closing as out of date, feel free to re-open if appropriate.