The VQA test-dev evaluation has been stuck at “Submitted” for the past few days. After the problem is resolved, all evaluation results are displayed as “Failed.” Although the results are displayed in the stdout file, it is difficult to trust the results because it is not a result file that was previously seen. The stderr file is displayed as follows.
Traceback (most recent call last):
File “/usr/local/lib/python3.7/site-packages/django/db/backends/utils.py”, line 84, in _execute
return self.cursor.execute(sql, params)
psycopg2.errors.NotNullViolation: null value in column “is_disabled” violates not-null constraint
DETAIL: Failing row contains (853979, 2023-10-26 05:16:13.884324+00, 2023-10-26 05:16:13.884355+00, {“other”: 60.85, “number”: 49.73, “yes/ no”: 86.25, “overall”: 70…, 2269, 1168, 312592, null, null).