Small fixes to brightness adjustment and EOS token removal

acon96 / home-llm

A Home Assistant integration & Model to control your smart home using a Local LLM

631 stars 64 forks source link

Closed xBelladonna closed 6 months ago

xBelladonna commented 6 months ago

Currently, brightness cannot not be adjusted to 100% due to the value being interpreted as 1/255 (minimum brightness). This includes 1.0 in the conditional statement that converts a brightness percentage to an 8-bit value, so the model can specify 100% brightness correctly.
The current implementation of EOS token removal uses a hardcoded ChatML EOS token. This finds the EOS token from the assistant section of the user's configured prompt format.

acon96 commented 6 months ago

Awesome! thanks for the contribution