Dear Participants,
Thanks for your submissions for this exciting challenge. We recently processed submissions on the minival phase. (and future submissions will be processed much faster).
If your submission failed on the minival phase, it is because you have used an outdated base docker. We have recently updated the base docker to include code that calculates the evaluation metrics. If you pull the base docker igibson/behavior_challenge_2021:latest again and rebuild your submission docker, it will pass the minival phase.
We apologize for the inconvenience.
Best,
BEHAVIOR organizers