Submission running over 80 mins


#1

Evening,

I submitted an image at approximately 1852hrs (GMT+1) and it has been running for 2 hours. I was under the impression that if the test went over 80 mins you would receive the results for the tests completed and he rest would be failures.

Maybe a bug? I can’t stop the test to get the error code.

Any help appreciated and if its possible to recover the score for his submission all the better!

Regards


#2

Hi, I’ve checked your submission and there is a bug on our side indeed. I will manually update your results tomorrow and investigate the bug as well.


#3

Thanks alot, hopefully something easily fixable.


#4

I’ve uploaded the score you obtained on your submission yesterday. Unfortunately this bug is really hard to fix and to be honest I spent all of last week fixing it, thought i did, but clearly didn’t…
I’ll let you know as soon as I find a fix.


#5

Some update: I’ve fixed the bug and sent an updated version of the scripts to EvalAI, it should be uploaded in the coming days. I will let you know once it’s live.

EDIT: this is now fixed and you can submit images that will run to the time limit


#6

This should be fixed now.


#7

Thanks! I shall try again


#8

Hello. I am having a similar problem in the fastMRI challenge.

Could you please help me out?


#9

Hi, this was a competition specific issue (ie: not related to evalai), therefore we cannot help with the fastMRI challenge and I would recommend posting an issue on their forum instead.