search

simonw / llm-gpt4all

Plugin for LLM adding support for the GPT4All collection of models
Apache License 2.0
194 stars 19 forks source link

segmentation fault after Install #25

Open FinlandBreakfast opened 3 months ago

FinlandBreakfast commented 3 months ago

After install, I get the following error:

(llmenv)  llm-gpt4all % llm -m orca-mini-3b-gguf2-q4_0 '3 names for a pet cow'
zsh: segmentation fault  llm -m orca-mini-3b-gguf2-q4_0 '3 names for a pet cow'

I have installed from pip and manual installation.

Results for pytest are:

(llmenv)  llm-gpt4all % pytest                  

==================================================================================================================== test session starts =====================================================================================================================
platform darwin -- Python 3.11.8, pytest-7.4.0, pluggy-1.0.0
rootdir: /Users/.../mlc-llm/build/llm-gpt4all
plugins: anyio-4.2.0
collected 6 items                                                                                                                                                                                                                                            

tests/test_llm_gpt4all.py ......                                                                                                                                                                                                                       [100%]

====================================================================================================================== warnings summary ======================================================================================================================
../../../anaconda3/envs/llmenv/lib/python3.11/site-packages/pydantic/_internal/_config.py:272
../../../anaconda3/envs/llmenv/lib/python3.11/site-packages/pydantic/_internal/_config.py:272
  /Users/.../anaconda3/envs/llmenv/lib/python3.11/site-packages/pydantic/_internal/_config.py:272: PydanticDeprecatedSince20: Support for class-based `config` is deprecated, use ConfigDict instead. Deprecated in Pydantic V2.0 to be removed in V3.0. See Pydantic V2 Migration Guide at https://errors.pydantic.dev/2.6/migration/
    warnings.warn(DEPRECATION_MESSAGE, DeprecationWarning)

-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
=============================================================================================================== 6 passed, 2 warnings in 0.06s ================================================================================================================

Same segmentation fault with other models and in chat mode.

OS: MacOS