bug: Instructions are not sent when using the Claude 3.5 model

luketech85 commented 2 months ago

[X] I have searched the existing issues

Current behavior

Instructions are not sent when using the Claude 3.5 model. They work with other models (tested Open AI).

Minimum reproduction step

Select Claude 3.5 model. Enter instructions e.g. "You will play the role of Hal, a highly knowledgeable AI assistant with a humorous and often sarcastic personality. Engage in conversation with the user, providing informative and helpful responses while injecting wit, irony, and playful jabs. Your responses should be a mix of genuine information and sarcastic remarks that poke fun at the situation, the user’s questions, or even yourself. Maintain a lighthearted and friendly tone throughout the conversation, ensuring that your sarcasm is not hurtful or offensive." Send a chat "What's your name" Model will respond: "My name is Claude." Switch to GPT4o model and ask the same question. Model will correctly identify it's name.

Expected behavior

Model should respond based on the instructions provided.

Screenshots / Logs

2024-09-01T12:56:19.546Z [SPECS]::Version: 0.5.32024-09-01T12:56:19.546Z [SPECS]::CPUs: [{"model":"Intel(R) Core(TM) i3-8100 CPU @ 3.60GHz","speed":3600,"times":{"user":319642578,"nice":0,"sys":78278203,"idle":1196330375,"irq":18647265}},{"model":"Intel(R) Core(TM) i3-8100 CPU @ 3.60GHz","speed":3600,"times":{"user":446380343,"nice":0,"sys":63399218,"idle":1084471375,"irq":984531}},{"model":"Intel(R) Core(TM) i3-8100 CPU @ 3.60GHz","speed":3600,"times":{"user":421282921,"nice":0,"sys":56779203,"idle":1116188812,"irq":931203}},{"model":"Intel(R) Core(TM) i3-8100 CPU @ 3.60GHz","speed":3600,"times":{"user":379067468,"nice":0,"sys":53951906,"idle":1161231562,"irq":725218}}] 2024-09-01T12:56:19.547Z [SPECS]::Machine: x86_64 2024-09-01T12:56:19.547Z [SPECS]::Endianness: LE 2024-09-01T12:56:19.548Z [SPECS]::OS Version: Windows 10 Home 2024-09-01T12:56:19.548Z [SPECS]::OS Release: 10.0.19045 2024-09-01T12:56:19.547Z [SPECS]::Parallelism: 4 2024-09-01T12:56:19.548Z [APP]::{"notify":true,"run_mode":"cpu","nvidia_driver":{"exist":false,"version":""},"cuda":{"exist":false,"version":""},"gpus":[],"gpu_highest_vram":"","gpus_in_use":[""],"is_initial":false,"vulkan":false} 2024-09-01T12:56:19.547Z [SPECS]::Free Mem: 17538760704 2024-09-01T12:56:19.548Z [SPECS]::OS Platform: win32 2024-09-01T12:56:19.548Z [SPECS]::Total Mem: 34278678528 2024-09-01T12:58:01.662Z [CORTEX]::Debug: Request to kill cortex 2024-09-01T12:58:13.092Z [SPECS]::Version: 0.5.3 2024-09-01T12:58:13.093Z [SPECS]::Endianness: LE 2024-09-01T12:58:13.092Z [SPECS]::Machine: x86_64 2024-09-01T12:58:13.092Z [SPECS]::CPUs: [{"model":"Intel(R) Core(TM) i3-8100 CPU @ 3.60GHz","speed":3600,"times":{"user":319745640,"nice":0,"sys":78310218,"idle":1196489531,"irq":18651765}},{"model":"Intel(R) Core(TM) i3-8100 CPU @ 3.60GHz","speed":3600,"times":{"user":446492500,"nice":0,"sys":63426046,"idle":1084626625,"irq":985046}},{"model":"Intel(R) Core(TM) i3-8100 CPU @ 3.60GHz","speed":3600,"times":{"user":421399625,"nice":0,"sys":56802734,"idle":1116342812,"irq":931500}},{"model":"Intel(R) Core(TM) i3-8100 CPU @ 3.60GHz","speed":3600,"times":{"user":379193781,"nice":0,"sys":53974171,"idle":1161377218,"irq":725515}}] 2024-09-01T12:58:13.093Z [SPECS]::Parallelism: 4 2024-09-01T12:58:13.093Z [SPECS]::Free Mem: 17837563904 2024-09-01T12:58:13.093Z [SPECS]::Total Mem: 34278678528 2024-09-01T12:58:13.093Z [SPECS]::OS Version: Windows 10 Home 2024-09-01T12:58:13.093Z [SPECS]::OS Platform: win32 2024-09-01T12:58:13.094Z [SPECS]::OS Release: 10.0.19045 2024-09-01T12:58:13.094Z [APP]::{"notify":true,"run_mode":"cpu","nvidia_driver":{"exist":false,"version":""},"cuda":{"exist":false,"version":""},"gpus":[],"gpu_highest_vram":"","gpus_in_use":[""],"is_initial":false,"vulkan":false} 2024-09-01T13:16:13.601Z [CORTEX]::Debug: Request to kill cortex 2024-09-01T13:16:13.650Z [CORTEX]::Debug: cortex process is terminated 2024-09-01T13:16:17.900Z [SPECS]::Version: 0.5.3 2024-09-01T13:16:17.901Z [SPECS]::CPUs: [{"model":"Intel(R) Core(TM) i3-8100 CPU @ 3.60GHz","speed":3600,"times":{"user":320054218,"nice":0,"sys":78402125,"idle":1197174015,"irq":18666046}},{"model":"Intel(R) Core(TM) i3-8100 CPU @ 3.60GHz","speed":3600,"times":{"user":446885265,"nice":0,"sys":63504078,"idle":1085240796,"irq":986078}},{"model":"Intel(R) Core(TM) i3-8100 CPU @ 3.60GHz","speed":3600,"times":{"user":421792984,"nice":0,"sys":56874125,"idle":1116963031,"irq":932171}},{"model":"Intel(R) Core(TM) i3-8100 CPU @ 3.60GHz","speed":3600,"times":{"user":379580781,"nice":0,"sys":54046437,"idle":1162002921,"irq":726343}}] 2024-09-01T13:16:17.901Z [SPECS]::Machine: x86_64 2024-09-01T13:16:17.901Z [SPECS]::Endianness: LE 2024-09-01T13:16:17.901Z [SPECS]::Parallelism: 4 2024-09-01T13:16:17.901Z [SPECS]::Free Mem: 18733211648 2024-09-01T13:16:17.901Z [SPECS]::Total Mem: 34278678528 2024-09-01T13:16:17.902Z [SPECS]::OS Version: Windows 10 Home 2024-09-01T13:16:17.902Z [SPECS]::OS Release: 10.0.19045 2024-09-01T13:16:17.902Z [SPECS]::OS Platform: win32 2024-09-01T13:16:17.902Z [APP]::{"notify":true,"run_mode":"cpu","nvidia_driver":{"exist":false,"version":""},"cuda":{"exist":false,"version":""},"gpus":[],"gpu_highest_vram":"","gpus_in_use":[""],"is_initial":false,"vulkan":false}