search

redotvideo / mamba-chat

Mamba-Chat: A chat LLM based on the state-space model architecture 🐍
Apache License 2.0
878 stars 68 forks source link

Feature 'cvt with .bf16' requires .target sm_80 or higher Error #24

Open venkat-p-r opened 5 months ago

venkat-p-r commented 5 months ago

An error message stating that "Feature 'cvt with.bf16' requires.target sm_80 or higher Error" appears when I try to fine-tune Mamba. I looked up this repo . I'm fine-tuning in the Tesla T4 card it uses Turning Architecture and only supports SM_75, although SM_80 or above is needed from error. Thus, support for SM_80 in Ampere Architecture, such as A100, the error is being caused by ineffective hardware or if there is another cause. I would appreciate clarification. Is there another option to fine-tune in T4? Thanks in advance

Rohith04MVK commented 3 months ago

I know I'm very late to this but you can change the datatype to float32, this should help