Closed ink-pad closed 1 month ago
@ink-pad Looks like your commit needs a sign-off https://github.com/ibm-granite-community/granite-snack-cookbook/pull/39/commits/bc6b84d814e11034542f58dfe7462ecf91e3c1ef
If the calls to torch.no_grad
are meant to be an optimization for testing, let's check this environment variable and only apply that optimization only when this variable is present with this value:
@adampingel : Thanks for the comment, Adam. No - it is not specific to testing alone. We want this to be default behavior for any inference.
PR Checklist
!pip install git+https://github.com/ibm-granite-community/granite-kitchen
in the instructions.