A central, open resource for data and tools related to chain-of-thought reasoning in large language models. Developed @ Samwald research group: https://samwald.info/
The COT of id 3 is partially the COT of id 2. Something is mixed up...
{
"id":"2"
"ref_id":""
"question":"One pencil weighs 28.3 grams. How much do 5.0 pencils weigh?"
"type":"number"
"choices":[]
"context":""
"cot":[
0:
"We multiply 28.3 by 5.0 and get 141.5."
]
"answer":[
0:
"141.5"
]
"generated_cot":[]
"feedback":[]
}
{
"id":"3"
"ref_id":""
"question":"Zoe was unboxing some of her old winter clothes. She found 8.0 boxes of clothing and inside each box there were 4.0 scarves and 6.0 mittens. How many pieces of winter clothing did Zoe have total?"
"type":"number"
"choices":[]
"context":""
"cot":[
0:
"We multiply 28.3 by 5.0 and get 141.5. add 4.0 to 6.0 and get 10.0."
1:
"Then we multiply 8.0 by 10.0 and get 80.0."
]
"answer":[
0:
"80.0"
]
"generated_cot":[]
"feedback":[]
}
The COT of id 3 is partially the COT of id 2. Something is mixed up...
{ "id":"2" "ref_id":"" "question":"One pencil weighs 28.3 grams. How much do 5.0 pencils weigh?" "type":"number" "choices":[] "context":"" "cot":[ 0: "We multiply 28.3 by 5.0 and get 141.5." ] "answer":[ 0: "141.5" ] "generated_cot":[] "feedback":[] }
{ "id":"3" "ref_id":"" "question":"Zoe was unboxing some of her old winter clothes. She found 8.0 boxes of clothing and inside each box there were 4.0 scarves and 6.0 mittens. How many pieces of winter clothing did Zoe have total?" "type":"number" "choices":[] "context":"" "cot":[ 0: "We multiply 28.3 by 5.0 and get 141.5. add 4.0 to 6.0 and get 10.0." 1: "Then we multiply 8.0 by 10.0 and get 80.0." ] "answer":[ 0: "80.0" ] "generated_cot":[] "feedback":[] }