Hi,
I’m trying to self-host an eval.ai instance and I’m wondering what’s the best way to extract a zip file from test_annotation_file and user_submission_file in the evaluate() worker function.
Should I do it manually, or is there a setting to have it done automatically ?
If manually, should I extract it in the same directory as the zip file and then clean up the extracted files later ?
Also, is it possible to run eval.ai locally with ElasticMQ in production mode ?
Hi @sophro, you’ll have to implement the unzipping logic in your evaluation script. We don’t provide support for automatic unzipping of annotation files.
If manually, should I extract it in the same directory as the zip file and then clean up the extracted files later ?
Yes
Also, is it possible to run eval.ai locally with ElasticMQ in production mode ?
We use elastic mq locally for testing but I think you should be able to get it working with production elasticMQ