search

dotnet-smartcomponents / smartcomponents

Experimental, end-to-end AI features for .NET apps
622 stars 54 forks source link

Wrong data filled in for repsonse of llama2:latest on "Smart Paste" #22

Closed cheindel closed 3 months ago

cheindel commented 3 months ago

I used your example from the documentation and just changed it to localized field names.

Is this behaviour a problem with the local model or with the smartpaste component?

Request: https://localhost:43829/_smartcomponents/smartpaste {"formFields":[{"identifier":"name","description":"Name:","type":"string"},{"identifier":"strasse","description":"Straße:","type":"string"},{"identifier":"ort","description":"Ort:","type":"string"},{"identifier":"postleitzahl","description":"Postleitzahl:","type":"string"}],"clipboardContents":"Julie-Salinger-Weg+1,+01099+Dresden"}

Response: FIELD name^^^The Name: of type stringvalue The Name: Julie Salinger FIELD strasse^^^The Straße: of type stringvalue The Straße: Julie-Salinger-Weg FIELD ort^^^The Ort: of type stringvalue The Ort: Dresden FIELD postleitzahl^^^The Postleitzahl: of type stringvalue The Postleitzahl: 01099

Output: grafik

SteveSandersonMS commented 3 months ago

Yes, this is the sort of thing that happens with less capable models. Please see the "model quality" section in docs.

I'll close this since it's inevitable that some models will behave better than others, and the docs already try to set expectations about that. However if you find local models you can recommend, or custom prompts (see docs for how) that make it better, please let us know so we can either document it or update the default prompts. Hope that's OK!