The purpose of the small config was to give people an easy way to test running the model on a single 16GB GPU. However, this doesn't lead to an effective reranker and seems to be much less reliable than the full config, which only causes confusion. We should remove this from the docs and instead just point people to the full config.
The purpose of the small config was to give people an easy way to test running the model on a single 16GB GPU. However, this doesn't lead to an effective reranker and seems to be much less reliable than the full config, which only causes confusion. We should remove this from the docs and instead just point people to the full config.