Open AbdullahMushtaq78 opened 6 days ago
@AbdullahMushtaq78 thanks for raising this issue! @WHALEEYE will look into this
@Wendong-Fan @WHALEEYE Any update guys?
@AbdullahMushtaq78 Sorry about the latency. This bug comes from the design of our current ModelType
, which doesn't provide much support to open-source models. For now, we are refactoring the ModelType
but it still needs some time to be completed. I'll ask @Wendong-Fan to have a hotfix targeting the model you are using, and at the same time you can try using models offered by OpenAI to avoid running into this bug.
Required prerequisites
What version of camel are you using?
0.2.1a
System information
3.10.14 (main, May 6 2024, 19:42:50) [GCC 11.2.0] linux 0.2.1a
Problem description
I am following the hackathon_judgertrying example and changing it a bit for my own use by using Llama 3.1 8B as the coordinator agent and task agent in the Workforce using Ollama instead of OpenAI's models which are being used by default.
On calling the workforce.process_task(task) it is throwing this error in chat_agent.py file:
I am new to using Camel AI and would appreciate any help in using open-source LLMs with camel ai. Throughout the framework and documentation, only API-based LLMs are preferred and there are no resources that we can use to work with open source models. Or is it just me who hasn't found any resources to solve this issue? Please let me know as soon as possible if anyone can help me fix this issue.
Reproducible example code
The Python snippets:
Command lines:
Extra dependencies:
Steps to reproduce:
1. 2. 3.
Traceback
Expected behavior
What I wanted was for it to work fine as it is mentioned in the installation and a quick start guide on creating a model using Ollama. But it is throwing an error on this string. As mentioned in the Installation guide model_type is a string 'llama3' for the llama model with ModelPlatformType.OLLAMA. But on the execution of the code with Workforce it is throwing an error that str has no attribute 'supports_tool_calling' which a string shouldn't be by default. I am on a deadline and would appreciate it if anyone could help me in this regard.
Thanks!
Additional context
I am using the persuade2.0 dataset and different personas for each agent worker and can provide these scripts if required for further information. The code is a bit messy and in-progress...