Dear scholar,
Because the evaluator offline zip file is for testdev_balanced question. But the GQA official website only provide valid_all_questions. and the corresponding choices.json
The new dev “testdev_balanced_questions.json” doesn’t provide its choices.json. So how to attain the choices.json or generate it???