Hi, EvalAI Team.
We created a new challenge " NumerSense Challenge." We have some problems that 1)the results are not shown on the leaderboard and 2) the submission status is always “Failed.”
The stderr file says
ORGINIAL EXCEPTION: No such relation between Challenge Phase and DatasetSplit specified by Challenge Host
Traceback (most recent call last):
File “/code/scripts/workers/submission_worker.py”, line 513, in run_submission
File “/usr/local/lib/python3.7/site-packages/django/db/models/manager.py”, line 82, in manager_method
return getattr(self.get_queryset(), name)(*args, **kwargs)
File “/usr/local/lib/python3.7/site-packages/django/db/models/query.py”, line 408, in get
challenges.models.ChallengePhaseSplit.DoesNotExist: ChallengePhaseSplit matching query does not exist.
The result files seem like what we expected. We are not sure how to solve this issue.
Please guide us to figure it out.