search

salesforce / CodeT5

Home of CodeT5: Open Code LLMs for Code Understanding and Generation
https://arxiv.org/abs/2305.07922
BSD 3-Clause "New" or "Revised" License
2.74k stars 401 forks source link

Code-to-text prediction confidence #76

Closed alexkarargyris closed 1 year ago

alexkarargyris commented 1 year ago

Is it possible to get the confidence on the code-to-text prediction of the codet5 model?

yuewang-cuhk commented 1 year ago

Hi, there is no explicit confidence score for this. But maybe a relevant indicator is to check the combined probability of the prediction from beam search.