Closed aleksandr-mokrov closed 3 months ago
Check out this pull request on
See visual diffs & provide feedback on Jupyter Notebooks.
Powered by ReviewNB
View / edit / reply to this conversation on ReviewNB
eaidova commented on 2024-07-11T13:48:14Z ----------------------------------------------------------------
is it possible to use less detiled title? in case if we want to replace it by new model version it will required to rewrite title
aleksandr-mokrov commented on 2024-07-15T23:34:56Z ----------------------------------------------------------------
Renamed
View / edit / reply to this conversation on ReviewNB
eaidova commented on 2024-07-11T13:48:15Z ----------------------------------------------------------------
judging by described architecture, model is fully transformed. Is it possible to try to apply int8/int4 weight compression for it?
aleksandr-mokrov commented on 2024-07-15T23:34:59Z ----------------------------------------------------------------
Weight Compression is added. But only with mode=CompressWeightsMode.INT8_SYM it generates good results.
View / edit / reply to this conversation on ReviewNB
eaidova commented on 2024-07-11T13:48:16Z ----------------------------------------------------------------
please turns model parts to headers for simplification of notebook navigation
aleksandr-mokrov commented on 2024-07-15T23:35:04Z ----------------------------------------------------------------
Extended
View / edit / reply to this conversation on ReviewNB
eaidova commented on 2024-07-11T13:48:17Z ----------------------------------------------------------------
from which this print comes from?
aleksandr-mokrov commented on 2024-07-15T23:35:09Z ----------------------------------------------------------------
Non informational outputs was removed
View / edit / reply to this conversation on ReviewNB
eaidova commented on 2024-07-11T13:54:43Z ----------------------------------------------------------------
Line #1. %pip install -q "torch>=2.1" "torchaudio" einops "stable-audio-tools" "gradio>=4.19" --extra-index-url https://download.pytorch.org/whl/cpu
I met some issues with the latest stable-audio-tools release, when worked on model export, did you check that it is working?
Weight Compression is added. But only with mode=CompressWeightsMode.INT8_SYM it generates good results.
View entire conversation on ReviewNB
CVS-144663