BiomedSciAI / fuse-med-ml

A python framework accelerating ML based discovery in the medical field by encouraging code reuse. Batteries included :)
Apache License 2.0
137 stars 34 forks source link

Bug fix in `ModularTokenizer.decode()` when the input is `torch.Tensor` type #376

Closed SagiPolaczek closed 1 month ago

SagiPolaczek commented 1 month ago

Another "solution" would be to validate that the input value is a list of integers.

The main problem in the current implementation, is that the user is not aware of the type mismatch - the token just appears as missing (!)