Skip to content

mawps dataset cot incorrect #138

Description

@KonstantinHebenstreit

The COT of id 3 is partially the COT of id 2. Something is mixed up...

{
"id":"2"
"ref_id":""
"question":"One pencil weighs 28.3 grams. How much do 5.0 pencils weigh?"
"type":"number"
"choices":[]
"context":""
"cot":[
0:
"We multiply 28.3 by 5.0 and get 141.5."
]
"answer":[
0:
"141.5"
]
"generated_cot":[]
"feedback":[]
}

{
"id":"3"
"ref_id":""
"question":"Zoe was unboxing some of her old winter clothes. She found 8.0 boxes of clothing and inside each box there were 4.0 scarves and 6.0 mittens. How many pieces of winter clothing did Zoe have total?"
"type":"number"
"choices":[]
"context":""
"cot":[
0:
"We multiply 28.3 by 5.0 and get 141.5. add 4.0 to 6.0 and get 10.0."
1:
"Then we multiply 8.0 by 10.0 and get 80.0."
]
"answer":[
0:
"80.0"
]
"generated_cot":[]
"feedback":[]
}

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions