Closed bawahakim closed 5 months ago
Unsure what was the proper method to calculate the default input length. It seems other models simply divide the model context by 2, but the comment below was using a different formula as 1.33 * model_context. Opted to simply divide by 2
1.33 * model_context
Thanks
Unsure what was the proper method to calculate the default input length. It seems other models simply divide the model context by 2, but the comment below was using a different formula as
1.33 * model_context
. Opted to simply divide by 2