search

JamesDoonan1 / emerging-technologies

0 stars 0 forks source link

Manual Testing for ELIZA Chatbot #41

Closed JamesDoonan1 closed 2 weeks ago

JamesDoonan1 commented 2 weeks ago

Manual Testing Chart for ELIZA Chatbot

Test # Input Expected Response Observed Response Pass/Fail Notes
1 "Hello" "Hello! How are you feeling today?" or similar Basic greeting check
2 "Good morning" "Good morning! How can I assist you today?" Greeting variation
3 "Who are you?" "I'm ELIZA, a virtual therapist." Identity question
4 "What do you do?" "I'm here to listen and help you talk through things." Identity question
5 "I feel happy" "I'm glad to hear that you're feeling happy! What made you feel this way?" Positive emotion
6 "I feel sad" "I'm sorry you're feeling sad. Would you like to discuss what’s causing it?" Negative emotion
7 "Why don't you help me?" "Do you really think I don't help you?" or similar Complex question with reflection
8 "I need advice" "Why do you need advice?" "I need" pattern
9 "Can you assist me?" "What makes you think I can't assist you?" Capability question
10 "Goodbye" "Goodbye! Take care." or similar Farewell
11 "I feel frustrated" "Feeling frustrated can be tough. Do you want to share more?" Emotion-specific response
12 "I think you’re helpful" "Do you really think so?" Reflective response based on opinion
13 "Why can’t I feel happy?" "Do you think you should be able to feel happy?" Reflecting capability
14 "Tell me about yourself" "I'm here to listen and support you." Generic prompt
15 "What should I do?" "What do you feel would help you most?" Guidance request
16 "I’m frustrated with work" "Tell me more about feeling frustrated." Emotion with context
17 "I want to feel better" "What would it mean if you felt better?" "I want" pattern
18 "My mother is supportive" "Tell me more about your mother." Family-oriented prompt
19 "Are you a real person?" "Why does it matter whether I am real?" Question about ELIZA's nature
20 "Why do you care?" "Why don't you tell me the reason why I would care?" Challenging question with reflective answer
JamesDoonan1 commented 2 weeks ago

Manual Testing Results for ELIZA Chatbot,

Test 1: code reference go to 3602463ef0da0a5b9bc0dce6f463332281d2cbe2

Test # Input Expected Response Observed Response Pass/Fail Notes
1 Hello "Hello! How are you feeling today?" or similar "Hey! How can I help you?" Pass Response is appropriate for greeting.
2 Good morning "Good morning! How can I assist you today?" Fail No response observed for "Good morning."
3 Who are you "I'm ELIZA, a virtual therapist." "I'm ELIZA, a virtual therapist. How can I support you today?" Pass Accurate response.
4 What do you do? "I'm here to listen and help you talk through things." "I’m here to listen and have conversations to help you explore your thoughts." Pass Accurate response.
5 I feel happy "I'm glad to hear that you're feeling happy! What made you feel this way?" Fail No response observed for positive emotion.
6 I feel sad "I'm sorry you're feeling sad. Would you like to discuss what’s causing it?" Fail No response observed for negative emotion.
7 Why don't you help me "Do you really think I don't help you?" or similar Fail No response observed for complex question.
8 I need advice "Why do you need advice?" Fail No response observed for "I need" pattern.
9 Can you assist me? "What makes you think I can't assist you?" Fail No response observed for capability question.
10 Goodbye "Goodbye! Take care." or similar "Bye! I’m here if you need to talk again." Pass Appropriate farewell response.
11 I feel frustrated "Feeling frustrated can be tough. Do you want to share more?" Fail No response observed for frustration.
12 I think you're helpful "Do you really think so?" "Hello! How are you feeling today?" Fail Incorrect response, should reflect opinion.
13 Why can't I feel happy? "Do you think you should be able to feel happy?" Fail No response observed for capability reflection.
14 Tell me about yourself "I'm here to listen and support you." "Can you elaborate on that?" Fail Vague response, not specific to "about yourself".
15 What should I do? "What do you feel would help you most?" "What do you feel would help you most?" Pass Accurate guidance response.
16 I'm frustrated with work "Tell me more about feeling frustrated." Fail No response observed for context-specific emotion.
17 I want to feel better "What would it mean if you felt better?" Fail No response observed for "I want" pattern.
18 My mother is supportive "Tell me more about your mother." Fail No response observed for family-oriented prompt.
19 Are you a real person? "Why does it matter whether I am real?" Fail No response observed for question about identity.
20 Why do you care "Why don't you tell me the reason why I would care?" "Why do you say that about me?" Fail Incorrect response, expected reflection on caring.

Summary

Notes

JamesDoonan1 commented 2 weeks ago
Test 2: New set of tests after updating the code. for code reference look at Commit 513fbc6: User Input Expected Response Actual Response Result Notes
hello "Hello! How are you feeling today?" or similar greeting. Hi there! What’s on your mind? ✅ Correct Pattern matches correctly.
Good morning "Good morning! How can I assist you today?" or similar response. Good morning! What’s on your mind? ✅ Correct Pattern matches correctly.
who are you? "I'm ELIZA, a virtual therapist. How can I support you today?" I'm here to listen and help you talk through things. ✅ Correct Matches "who are you" pattern.
What do you do? "I’m here to listen and have conversations to help you explore your thoughts." I’m here to listen and have conversations to help you explore your thoughts. ✅ Correct Matches "what do you do" pattern.
i feel happy "I'm glad to hear that you're feeling happy! What made you feel this way?" I'm glad to hear that you're feeling happy! What made you feel this way? ✅ Correct Matches "I feel happy" pattern.
i feel sad "I'm sorry you're feeling sad. Would you like to discuss what’s causing it?" I'm sorry you're feeling sad. Would you like to discuss what’s causing it? ✅ Correct Matches "I feel sad" pattern.
why don't you help me "Do you really think I don't help you?" Perhaps eventually I will help me. ❌ Incorrect Incorrect pronoun reflection.
i need advice "I’m here to listen. What would you like advice on?" or similar response. What kind of advice are you looking for? ✅ Correct Matches "I need advice" pattern.
can you assist me? "What makes you think I can't assist you?" or "If I could assist you, then what?" If I could assist me, then what? ❌ Incorrect Incorrect pronoun reflection.
goodbye "Goodbye! Take care." or similar farewell message. Thank you for sharing. Goodbye! ✅ Correct Matches "goodbye" pattern.
i feel frustrated "I'm sorry you're feeling frustrated. Would you like to discuss what’s causing it?" Feeling frustrated can be tough. Do you want to share more? ✅ Correct Matches "I feel frustrated" pattern.
i think you're helpful "Thank you! I'm glad to be helpful." Hey! How can I help you? ❌ Incorrect Incorrect pattern matched.
tell me about yourself "I’m ELIZA, a program designed to engage in meaningful conversation." I’m ELIZA, a program designed to engage in meaningful conversation. ✅ Correct Matches "tell me about yourself".
what should i do? "Sometimes talking things through helps. What’s on your mind?" Have you considered what outcome you'd like to see? ✅ Correct Matches "what should I do" pattern.
i'm frustrated with work "I'm sorry you're feeling frustrated with work. Would you like to discuss what’s causing it?" Do you enjoy being frustrated with work? ❌ Incorrect Incorrect response for emotion.
I want to feel better "What would it mean if you got to feel better?" Why do you want to feel better? ✅ Correct Matches "I want" pattern.
My mother is supportive "Tell me more about your mother." or "When your mother is supportive, how does it make you feel?" When your mother is supportive, how do you feel? ✅ Correct Matches "mother" pattern.
Are you a real person? "I'm a virtual assistant created to help you talk through your thoughts." I'm here to provide a space for conversation, even though I'm not a human. ✅ Correct Matches "are you a real person" pattern.
Why do you care "Why do you think I care?" or "Let’s focus on you." We should be discussing you, not me. ✅ Correct Matches "you" pattern.
JamesDoonan1 commented 2 weeks ago
Test 3: New manual tests ran and successfully passed except for one. code reference: 96cdc3d9c02ec62a3942707df40dd301ff7f44c5 User Input Expected Response Actual Response Result Notes
hello "Hello! How are you feeling today?" or similar greeting. Hey! How can I help you? ✅ Correct Pattern matches correctly.
Good morning "Good morning! How can I assist you today?" or similar response. Good morning! What’s on your mind? ✅ Correct Pattern matches correctly.
who are you? "I'm ELIZA, a virtual therapist. How can I support you today?" I'm here to listen and help you talk through things. ✅ Correct Matches "who are you" pattern.
What do you do? "I’m here to listen and have conversations to help you explore your thoughts." I’m here to listen and have conversations to help you explore your thoughts. ✅ Correct Matches "what do you do" pattern.
i feel happy "I'm glad to hear that you're feeling happy! What made you feel this way?" I'm glad to hear that you're feeling happy! What made you feel this way? ✅ Correct Matches "I feel happy" pattern.
i feel sad "I'm sorry you're feeling sad. Would you like to discuss what’s causing it?" I'm sorry you're feeling sad. Would you like to discuss what’s causing it? ✅ Correct Matches "I feel sad" pattern.
why don't you help me "Do you really think I don't help you?" Perhaps eventually I will help you. ✅ Correct Adjusted pronoun correctly.
i need advice "I’m here to listen. What would you like advice on?" or similar response. What kind of advice are you looking for? ✅ Correct Matches "I need advice" pattern.
can you assist me? "What makes you think I can't assist you?" or "If I could assist you, then what?" If I could assist you, then what? ✅ Correct Adjusted pronoun correctly.
goodbye "Goodbye! Take care." or similar farewell message. Goodbye! Take care. ✅ Correct Matches "goodbye" pattern.
i feel frustrated "I'm sorry you're feeling frustrated. Would you like to discuss what’s causing it?" I'm sorry you're feeling frustrated. Would you like to discuss what’s causing it? ✅ Correct Matches "I feel frustrated" pattern.
i think you're helpful "Thank you! I'm glad to be helpful." Hello! How are you feeling today? ❌ Incorrect Appreciation response doesn't work correctly.
tell me about yourself "I’m ELIZA, a program designed to engage in meaningful conversation." I’m ELIZA, a program designed to engage in meaningful conversation. ✅ Correct Matches "tell me about yourself" pattern.
what should i do? "Sometimes talking things through helps. What’s on your mind?" What do you feel would help you most? ✅ Correct Matches "what should I do" pattern.
i'm frustrated with work "I'm sorry you're feeling frustrated with work. Would you like to discuss what’s causing it?" How does being frustrated with work make you feel? ✅ Correct Matches "I'm frustrated with" pattern.
I want to feel better "What would it mean if you got to feel better?" Why do you want to feel better? ✅ Correct Matches "I want" pattern.
My mother is supportive "Tell me more about your mother." or "When your mother is supportive, how does it make you feel?" Why do you say that your mother is supportive? ✅ Correct Matches "mother" pattern.
Are you a real person? "I'm a virtual assistant created to help you talk through your thoughts." I'm a virtual assistant created to help you talk through your thoughts. ✅ Correct Matches "are you a real person" pattern.
Why do you care? "Why do you think I care?" or "Let’s focus on you." Let's talk more about you. ✅ Correct Matches "you" pattern.

Notes

JamesDoonan1 commented 2 weeks ago

Test 4: Updated and moved gratitude response to fix this response error. commit: 8d7d2de55370f6090297bd7ccb8aa9e4c6ec120b

User Input Expected Response Actual Response Result Notes
i think you're helpful "Thank you! I'm glad to be helpful." or similar response. I appreciate your kind words. How else can I assist you? ✅ Correct Pattern matched correctly.
JamesDoonan1 commented 2 weeks ago

All Manual testing has been successful. Happy to close issue