NBoost is a scalable, search-api-boosting platform for deploying transformer models to improve the relevance of search results on different platforms (i.e. Elasticsearch)
Apache License 2.0
675
stars
69
forks
source link
Fix/TransformersRerankPlugin: Fix query and choices encoding #73
Fix and improve the usage of encode_plus function:
Set the return_token_type_ids flag to prevent KeyErrors when using
custom models. Currently "token_type_ids" key is not present in the encoded dict
Set max_length while encoding, to reduce computation cost and avoid
unnecessary warnings
pertschuk
commented
4 years ago
Fix and improve the usage of encode_plus function: Set the return_token_type_ids flag to prevent KeyErrors when using custom models. Currently "token_type_ids" key is not present in the encoded dict Set max_length while encoding, to reduce computation cost and avoid unnecessary warnings