Status now updating from "submitted"

koding.coding · April 21, 2019, 12:17am

Hi,
The status of my test-standard submission is the same since the last 1hr. Am I doing something wrong?

Thanks.

Winyi · April 21, 2019, 4:13am

the same here。i have submitted for 2hours，and there is no result file.

rishabh · April 21, 2019, 4:51am

Hi @koding.coding @Winyi,

The issue is resolved now and the submissions will be processed soon. Thank you for reporting it.

zengzhaoyang · May 10, 2019, 8:58am

Hi rishabh,

This issue appears again. Could you solve it？

Thanks.

rishabh · May 10, 2019, 4:23pm

Hi @zengzhaoyang,

Thanks for reporting the issue and sorry for the inconvenience caused. We’ve resolved it and the submission is evaluated now.

rishabh · May 10, 2019, 4:24pm

Hi @Winyi,

Thanks for reporting the issue and sorry for the inconvenience caused. We’ve resolved it and the submission is evaluated now.

Saransh_Goyal · May 16, 2019, 3:31am

Status is fixed at Submitted and evaluation isn’t starting.

cdr380 · May 16, 2019, 3:29pm

I’m seeing the same thing, status never updates from submitted, usually it goes to running fairly quickly.

qma · May 16, 2019, 4:40pm

Hi @rishabh
I encountered the same problem, status got stuck at ‘Submitted’. Is it because the VQA challenge 2019 is over? Is it still possible to do evaluations here for other research purposes? Thanks!

cdr380 · May 16, 2019, 5:03pm

Hi @qma, I assume it’s not because of that, I had one quickly evaluated yesterday. I also just had one run just now, though 2 I had submitted before it (and now 1 after) have not…

rishabh · May 16, 2019, 5:24pm

Hi @Saransh_Goyal, @cdr380, @qma,

The submissions are evaluated now. Please take a look at the results file. Thanks for reporting the issue.

Yes, the issue is fixed and it’ll run fairly quickly now.

No, it wasn’t because of it. The submissions are still open for the Dev and Test-Standard Phase throughout the year. Only the Test-Challenge phase submissions are closed.

Please feel free to report/ping us here if you face further problems. We’ll be happy to help.

qma · May 16, 2019, 5:38pm

Thanks @rishabh for the lightning reply. Indeed the results come out, you are amazing

qma · May 20, 2019, 11:31am

Hey @rishabh, there are problems with evaluation again today: one of my jobs has been ‘running’ for hours, and others jobs’ status got stuck at ‘Submitted’…Could you look into it? Thanks.

rishabh · May 20, 2019, 7:24pm

Hi @qma,

The evaluation is finished now for your submissions. Please check the results. Thanks for reporting it.

playerkk · June 3, 2019, 5:31pm

Hi @rishabh, my recent two submissions have been stuck at “Submitted” for more than an hour. I was wondering if you could take a look. Thanks!

rishabh · June 3, 2019, 6:25pm

Hi @playerkk, The submissions are evaluated now. Please check the results.

Zhicheng_Huang · July 9, 2019, 1:09am

@rishabh

The issue appears again, can you help me to solve it? Thanks

rishabh · July 9, 2019, 4:36am

Hi @Zhicheng_Huang,
Thanks for reporting it. It is fixed now.

Zhicheng_Huang · July 16, 2019, 12:36am

@rishabh
Thanks for your help, but now the issue appears again.

rishabh · July 16, 2019, 2:48am

Hi @Zhicheng_Huang,

Thanks for reporting it again, the issue is fixed now.