[Feature request] Support quantization

[MNeMoNiCuZ]

Suppor model quantization with different precision.

[MNeMoNiCuZ]

Now supports "unsloth/llama-3-8b-bnb-4bit" Change the setting: LOW_VRAM_MODE = True # Option to switch to a model that uses less VRAM