88776 segmentation fault tabby serve --device metal --model TabbyML/StarCoder-7B

mindaslab commented 4 months ago

Describe the bug

Getting segmentation fault on mac M1

~ tabby serve --device metal --model TabbyML/StarCoder-7B
2024-04-06T07:43:21.506323Z  INFO tabby::serve: crates/tabby/src/serve.rs:118: Starting server, this might take a few minutes...
[1]    88776 segmentation fault  tabby serve --device metal --model TabbyML/StarCoder-7B

Information about your version

~ tabby --version
tabby 0.9.1

Information about your GPU

Don't have nvidia-smi, I use Mac pro wit M1 processor

Additional context

None

wsxiaoys commented 4 months ago

Hey - could you share a screenshot of your About This Mac dialog? it shall be something like below:

mindaslab commented 4 months ago

TabbyML / tabby

88776 segmentation fault tabby serve --device metal --model TabbyML/StarCoder-7B #1773