Mozilla-Ocho / llamafile

Distribute and run LLMs with a single file.
https://llamafile.ai
Other
20.15k stars 1.01k forks source link

Bug: malloc: *** error for object 0x600003310600: pointer being freed was not allocated #537

Open groovecoder opened 2 months ago

groovecoder commented 2 months ago

Contact Details

lcrouch@mozilla.com

What happened?

  1. I followed the steps in https://github.com/Mozilla-Ocho/llamafile?tab=readme-ov-file#quickstart
  2. When I got to step 5, I got this:
     lcrouch  ~  Downloads  chmod +x llava-v1.5-7b-q4.llamafile
     lcrouch  ~  Downloads  ./llava-v1.5-7b-q4.llamafile
    bash(7808,0x100908580) malloc: *** error for object 0x600003310600: pointer being freed was not allocated
    bash(7808,0x100908580) malloc: *** set a breakpoint in malloc_error_break to debug
    Abort trap: 6

Version

llava-v1.5-7b-q4.llamafile

What operating system are you seeing the problem on?

Mac

Relevant log output

 lcrouch  ~  Downloads  ./llava-v1.5-7b-q4.llamafile
bash(7808,0x100908580) malloc: *** error for object 0x600003310600: pointer being freed was not allocated
bash(7808,0x100908580) malloc: *** set a breakpoint in malloc_error_break to debug
Abort trap: 6
jart commented 2 months ago

That error definitely isn't coming from llamafile. What kind of bash shell are you running?