Open FosanzDev opened 12 months ago
Long inputs caused the model to say things worse than usual. This implementation creates chunks of phrases that do not exceed the maximum length set.
If the phrase is longer, it is split into chunks of the maximum length and then concatenated together.
Long inputs caused the model to say things worse than usual. This implementation creates chunks of phrases that do not exceed the maximum length set.
If the phrase is longer, it is split into chunks of the maximum length and then concatenated together.