Recent bedrock integration throwing an error about system role messge getting passed. - Githubissues

continuedev / continue

⏩ Continue is the leading open-source AI code assistant. You can connect any models and any context to build custom autocomplete and chat experiences inside VS Code and JetBrains

https://docs.continue.dev/

Apache License 2.0

19.63k stars 1.71k forks source link

Recent bedrock integration throwing an error about system role messge getting passed. #1938

Open digitalneedstech opened 3 months ago

digitalneedstech commented 3 months ago

Before submitting your bug report

[X] I believe this is a bug. I'll try to join the Continue Discord for questions
[X] I'm not able to find an open issue that reports the same bug
[X] I've seen the troubleshooting guide on the Continue Docs

Relevant environment info

- OS:
- Continue:
- IDE:
- Model:
- config.json:

Description

Recent bedrock integration throwing an error about system role messge getting passed.

When a prompt is sent to aws bedrock along with system message setup in config.json.

An error is thrown back that says role type system is not allowed when calling bedrock api.

To reproduce

Go to config.json
Configure basic bedrock config along with system message.
Type a prompt and click send
Error is received and added in log output section.

Log output

_ValidationException: 1 validation error detected: Value 'system' at 'messages.1.member.role' failed to satisfy constraint: Member must satisfy enum value set: [user, assistant]_

digitalneedstech commented 3 months ago

PR raised at https://github.com/continuedev/continue/pull/1951