Model is not sufficient to load on the GPU, i want to modify the threshold values in my local system
What needs to be done?
if it's possible i want to change the values threshold, top-p, top-k values in my local system. could i get the respective file path, where it could it be modify.
Example Pull Requests
No response
Resources
Contact points
I had go through the convert and benchmark. i didn't find any arguments related threshold values
Context
Model is not sufficient to load on the GPU, i want to modify the threshold values in my local system
What needs to be done?
if it's possible i want to change the values threshold, top-p, top-k values in my local system. could i get the respective file path, where it could it be modify.
Example Pull Requests
No response
Resources
Contact points
I had go through the convert and benchmark. i didn't find any arguments related threshold values
Ticket
No response