The "generate_simple" method will now accept a new boolean input argument called "return_lowest_perplexity". If this argument is set to True, the input prompt should be a single string while the batch_size should be greater than 1. Then the generator will generate as many as batch_size outputs based on the same input and it will return the one with lowest perplexity.
The "generate_simple" method will now accept a new boolean input argument called "return_lowest_perplexity". If this argument is set to True, the input prompt should be a single string while the batch_size should be greater than 1. Then the generator will generate as many as batch_size outputs based on the same input and it will return the one with lowest perplexity.