As detailed in the issue https://github.com/LLukas22/llm-rs-python/issues/15, the current setup prevents the quantization of a model via a Jupyter notebook. To rectify this situation, the logging mechanism of the quantization process needs to be transitioned from the Rust side to the Python side.
As detailed in the issue https://github.com/LLukas22/llm-rs-python/issues/15, the current setup prevents the quantization of a model via a Jupyter notebook. To rectify this situation, the logging mechanism of the quantization process needs to be transitioned from the Rust side to the Python side.