wasurenakusa / engine

The modular ai conversation engine
GNU Affero General Public License v3.0
0 stars 1 forks source link

Anthropic llm plugin #9

Closed chr1st0ph3rGG closed 6 days ago

chr1st0ph3rGG commented 3 weeks ago

We could of course use langchain… but tbh. I dont want to use it because it would mean that we had to convert our domain model to another one just so that it would be converted a second time… I may be a bit biased (And I personallydont see the need) but if anyone wants to use langchain you are free to create a plugin :)

chr1st0ph3rGG commented 6 days ago

wow... Anthropic has become quite restrictive by default, you cant even say the word '"fun"' without it getting triggered that only family friendly stuff is allowed...

I add a "important_rules" option to the config that gets appended to the system prompt config... (sure could be solved in other ways (as SystemPromptPlugin) but these important rules are quit specific to Anthropic so its a good place for stuff like that)

Additionally with that we can config how much the llm should write in terms of sentences etc. this way the Character Descriptions can well, stay in character...

chr1st0ph3rGG commented 6 days ago

Additionally I directly added a inmemory plugin... with that we are acctualy able to hold a conversation (eventhou after a restart its forgotten ^^)