Enable embedders to return logits

frederikkemarin / BEND

Benchmarking DNA Language Models on Biologically Meaningful Tasks

BSD 3-Clause "New" or "Revised" License

97 stars 13 forks source link

Closed fteufel closed 3 months ago

fteufel commented 3 months ago

So far, embedders only returned embeddings. Logits and crossentropy can also be useful.

First enabled for HyenaDNA. New options for HyenaDNAEmbedder:

return_logits: bool=False, return_loss: bool=False

Other models WIP.

fteufel commented 3 months ago