search

anuj-ti / report

0 stars 0 forks source link

Question: Who is Arleif? #1

Open anuj-ti opened 1 year ago

anuj-ti commented 1 year ago

Problem: Only 3-4 docs are fetched, and from them it returns no info found 50% of time.

id: 80841191d7d9693ee2cd884328b819a9

Question: Who is Arleif Braganza?" Answer: "The documents do not provide information on who Arleif Braganza is."

Intermidiate Steps: 

[
    " mailto:arleif.braganza@devfactory.com[[.underline]#Arleif Braganza#]",
    " mailto:arleif.braganza@devfactory.com[[.mark]#[.underline]#Arleif Braganza##]",
    " mailto:arleif.braganza@devfactory.com[[.underline]#Arleif Braganza#]"
]

Chunks:

"1Q_G6PhJjO6vgVONx7wMxS78ZMDQDUt1uMLAVwblp2qA_0",     
"1edVCFrXMV78D2wjLfUeWGKNdy_cCEkDk76H5aQ1qbuo_0",     
"1UnqEzdncJ8Bu2hzAgudJWzsPgyZfntFMQ1GL5ACZn28_0"

After retrying

id: 1bd4625c6c46ed2bc6348ace40226197

Question: "Who is Arleif?" Answer: "Arleif Braganza is likely an individual associated with DevFactory, as indicated by the email address arleif.braganza@devfactory.com."

Interidiate Steps:

[
    " None",
    " mailto:arleif.braganza@devfactory.com[[.underline]#Arleif Braganza#]",
    " mailto:arleif.braganza@devfactory.com[[.mark]#[.underline]#Arleif Braganza##]",
    " mailto:arleif.braganza@devfactory.com[[.underline]#Arleif Braganza#]"
]

Chunks:

    "1Q_G6PhJjO6vgVONx7wMxS78ZMDQDUt1uMLAVwblp2qA_0",
    "1edVCFrXMV78D2wjLfUeWGKNdy_cCEkDk76H5aQ1qbuo_0",
    "1UnqEzdncJ8Bu2hzAgudJWzsPgyZfntFMQ1GL5ACZn28_0",
    "1qjEWZUbyG2PzEgVii_6W-w3FZYUobOcMT599VVlwXnk_8"

The chunks and the intermediate steps are almost the same, thus we are losing info at combined step. Also the Technical SME info is not being extracted.