search

tue-mps / algm-segmenter

ALGM applied to Segmenter
Other
15 stars 1 forks source link

Source Code regarding the similarity threshold #1

Closed yq790 closed 1 month ago

yq790 commented 2 months ago

Greetings,

Thank you for your excellent work!

The threshold values seem already available in the training commands. Will you post the code for selecting the optimal threshold based on a pre-trained baseline model and a training dataset?

Thank you!

narsisn commented 2 months ago

Hi, Thanks for your interest in our work!

Yes, I'll share the code for selecting the optimal threshold in the next few months. In the meantime, you can easily do it yourself by extracting tokens from the first layer, calculating similarities to find the threshold.