Unverified Commit 3f0294a3 authored by Benjamin Beyret's avatar Benjamin Beyret Committed by GitHub
Browse files

final submission guidelines

parent 3f45a6af
# Final Submission Guidelines
As the end of the competition approaches we would like to provide guidance on the final submission process and evaluation. You will be able to submit two agents for the final testing. The first will be your best agent from the current track (this will be submitted automatically and there is nothing for you to do), and the second is an agent of your choice that you can submit to the track ‘Submission 2 (optional)’. We will run both your submissions on the final test set and your final result will be the best overall score out of these agents.
If you want to be considered for the WBA prize then you should submit a short write-up explaining how your entry is biologically inspired following the submission guidelines. Full details [here](https://www.easychair.org/cfp/AAI2019WBA).
The deadline for submissions (to either track) and to the **WBA prize** is 23:59:59 1st November (Anywhere on Earth time). Please note that there may be heavier than usual traffic close to the deadline so we encourage you to submit early if possible.
In order to submit to the second phase please refer to [the submission page on evalAI](https://evalai.cloudcv.org/web/challenges/challenge-page/396/submission). Note that **there is no evaluation on this track**, you only upload a docker image that we will automatically retrieve at the time of final evaluation. **The status on the EvalAI website will show as “Running”, you can ignore this.** You can make up to 20 submissions but only the latest one will be used.
As was previously announced, the final evaluation test set is very similar to the one used throughout the competition, but contains extra tests, all minor variations of those in the current test set. This is to prevent overfitting to the exact tests on the current leaderboard.
To reiterate, the final evaluation process is the following:
- We will take your best submission (total score) from the “Competition phase” track. If several agents returned the same score equal to your best one, we only consider the last one submitted chronologically.
- We will also take your latest submission on the “Submission 2 (optional)” track, if you have submitted there, and evaluate it along with the former.
We will then take the best of the two in terms of “total” score, and use this as your final submission for both global and categories ranking.
Results and prizes will be announced once we have been able to run the final tests.
Good Luck!
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment