Closed abdulfatir closed 6 months ago
Description of changes: This PR adds an option to torch.compile the generate function.
torch.compile
By submitting this pull request, I confirm that you can use, modify, copy, and redistribute this contribution, under the terms of your choice.
Could the user not just torch.compile(pipeline.predict) instead?
torch.compile(pipeline.predict)
Yeah, actually I am not sure how helpful this is even.
Description of changes: This PR adds an option to
torch.compile
the generate function.By submitting this pull request, I confirm that you can use, modify, copy, and redistribute this contribution, under the terms of your choice.