[Feature Request] Add Slider to Change Context Size of Passthrough Models

smallcloudai / refact

WebUI for Fine-Tuning and Self-hosting of Open-Source Large Language Models for Coding

https://refact.ai

BSD 3-Clause "New" or "Revised" License

1.5k stars 100 forks source link

Open valaises opened 1 month ago

valaises commented 1 month ago

As for now all passthrough models are capped by 16_000 tokens of context size. We could add a slider to adjust this value in GUI