The evaluation on test-dev and test-standard keeps 'submitted' status but doesn't show results

Visual Question Answering Challenge 2020
1

hi,
I submitted result files to test-dev and test-standard evaluation and the server keeps the ‘submitted’ status without returning any result. I have lost my chance in test-standard today? Could you please check it?
Thanks

2

Hi @yixuan_qiao, Sorry for the inconvenience. It is fixed now!

3

your people works very hard. Thanks a lot :slight_smile:

4

My submissions for test-dev always keep the “submitted” status for hours in the last 2 weeks，it is quite disturbing, hope you guys can fix it, thanks.

5

Hi @Donnie_Darco,

Sorry for the inconvenience and it is fixed.

7

My aforementioned problems occurs again, hope you guys can fix it, thanks

8

so am i, :slightly_frowning_face:

9

it is broken again, hope you guys can fix it, thx

10

Hi @yixuan_qiao, @Donnie_Darco, It is fixed now the submissions will be evaluated soon!

11

Thanks for your help

12

hi, it is broken again?

13

Hi @yixuan_qiao, It should be working now. Sorry for the troubles.

14

just in time, thanks a lot

16

hi, it is broken again?

17

Hi @Donnie_Darco, sorry for the inconvenience. It is fixed and the submissions should be evaluated in few mins.

18

Hi, aforementioned problem occurs again.

19

Hi @gkwon,
This is fixed and you submission should be evaluated soon.

20

Hi, submitted to test-dev and got the following error:

FileNotFoundError: [Errno 2] No such file or directory: ‘/tmp/tmp9ornef7n/compute/submission_files/submission_85838/822d5f62-5ffa-410a-8883-fd538426c127.json’

Thanks!

21

Ummmm… It seems the server broke down again, my submissions keeps “submitted”.
Could someone please fix it ? Thanks a lot.

2 Likes
22

Hi, seems the server is broken again