InfoSecInnovations / concierge

Repo for Concierge AI dev work
Apache License 2.0
181 stars 31 forks source link

Manual - Prompter - Failing #19

Closed dwairlk closed 4 months ago

dwairlk commented 8 months ago

Hi. I'm running manually the application. I have an error when I access the prompter window. The model is almost loaded.

The error:

File "/home/user/tools/concierge/pages/Prompter.py", line 43, in <module>
    load_llm_model()
File "/home/user/tools/concierge/pages/Prompter.py", line 38, in load_llm_model
    pbar.refresh()
File "/home/user/tools/concierge/lib/python3.11/site-packages/tqdm/std.py", line 1347, in refresh
    self.display()
File "/home/user/tools/concierge/lib/python3.11/site-packages/stqdm/stqdm.py", line 97, in display
    self.st_display(**self.format_dict)
File "/home/userer/tools/concierge/lib/python3.11/site-packages/stqdm/stqdm.py", line 89, in st_display
    self.st_progress_bar.progress(n / total)
File "/home/user/tools/concierge/lib/python3.11/site-packages/streamlit/elements/progress.py", line 153, in progress
    progress_proto.value = _get_value(value)
                           ^^^^^^^^^^^^^^^^^
  File "/home/user/tools/concierge/lib/python3.11/site-packages/streamlit/elements/progress.py", line 74, in _get_value
    raise StreamlitAPIException(
streamlit.errors.StreamlitAPIException: Progress Value has invalid value [0.0, 1.0]: 361910.289539
treamlit.errors.StreamlitAPIException: Progress Value has invalid value ^

Thanks!

sebovzeoueb commented 8 months ago

Hmmm, that's annoying, I will have to do some testing to reproduce this issue.

In the mean time you can pull the model manually before running Concierge. With Docker and the required containers running, can you try the command docker exec -it ollama ollama pull mistral?

And once that has completed, can you try Concierge again and see if it's fixed?

besimorhino commented 7 months ago

nudge: @dwairlk, does this issue still persist? Did @sebovzeoueb's suggestion help?

If you could please reply it would help.

Thanks!

jianni20 commented 6 months ago

Hi @besimorhino, I was having the same issue with Prompter and @sebovzeoueb's suggestion did help.

sebovzeoueb commented 4 months ago

There has been no followup on this for a while, closing.