This is regarding the LVIS challenge 2021. But could apply to others as well.
The evaluation servers are meant to help us get scores for technical reports and also get some confidence that we are submitting the right format of submissions.
We can see that multiple people are facing the issue of submissions not evaluating/showing “None”.
Is it not possible to have a size limit on the submission file? Or any other guideline we can follow which can assure us that our submission will get evaluated in x time.
This is a critical issue I feel. If you have ever faced this issue as a participant can you comment here? Would help get more support for this issue.