ottlseo / bedrock-ai-tutor

GenAI w AWS CDK example using Anthropic Claude 3.0 Haiku & Sonnet
https://d2s3v0hqemilkh.cloudfront.net
1 stars 1 forks source link

[BE] Improve Haiku prompt #10

Closed ottlseo closed 4 months ago

ottlseo commented 7 months ago

Haiku has more issues than Sonnet like below.

1. Including the answer of System: prompt, not only Human: prompt

image

2. Returning multiple answers

image

3. Showing duplicated vocabulary at one sentence (both <corrected> and <better> tag)

Corrected by Haiku:  We're <corrected>usually</corrected> <better>often</better> watching the YouTube videos <corrected>frequently</corrected>. It <corrected>has been</corrected> <better>has been shown</better> that the <corrected>helping this</corrected> <better>help this provides</better> is to our daily routines because the video content can provide us with <corrected>many learnings</corrected> <better>much learning</better> and entertainment that we <corrected>couldn't</corrected> <better>may not</better> experience on our own.
image
ottlseo commented 5 months ago

Haiku 3.0 vs Sonnet 3.5

Haiku 3.0에 아무리 적절한 프롬프트를 추가해도 Sonnet 3.5 성능이 훨씬 좋음

image image image