Vignana-Jyothi / kp-learnings

Curiosity & Learnings
GNU General Public License v3.0
1 stars 0 forks source link

[GenAI] Roberta model training #14

Open head-iie-vnr opened 4 months ago

head-iie-vnr commented 4 months ago

When I gave shorter context the confidence was higher.

Test data

test_data = [
    {
     "context": "Mohandas Karamchand Gandhi was born on October 2, 1869, in Porbandar, a small town in present-day Gujarat, India.", 
     "question": "When was Mahatma Gandhi born?"},
    {
     "context": "Mohandas Karamchand Gandhi was born on October 2, 1869, in Porbandar, a small town in present-day Gujarat, India.", 
     "question": "Where was Gandhi born?"},
    # Add more test examples
]

Output

question answer score When was Mahatma Gandhi born? October 2, 1869 0.957528 Where was Gandhi born? Porbandar 0.731315

head-iie-vnr commented 4 months ago

when I gave larger context for the same questions & changed name the answer was same but confidence decreased

question answer score When was Mahatma Gandhi born? October 2, 1869 0.906785 Where was Mahatma Gandhi born? Porbandar 0.389754 Where was Gandhi born? Porbandar 0.396170 Where was Mohandas Karamchand Gandhi born? Porbandar 0.416316 Where was he born? Porbandar 0.384240