MIT ARCLab Prize for AI Innovation in Space 2024 Leaderboard (including private submission)

Current leaderboard (as of February 16th, 4 PM EST):
1st : Colt
2nd : Hawaii2024
3rd : FuturifAI
4th : Astrokinetix (AKX rel 9)
5th : Baseline Heuristic Solution (MIT ARCLab - Host)
6th : K-PAX
7th : SoloLearn
8th : AXOLTL LLC
9th : Baseline Machine Learning Solution (MIT ARCLab - Host)
10th : False Anomaly
11th : Works On My Machine
12th : uoa_arcprize

Please note that this leaderboard has been updated to remove entries evaluated on the old test set (submission submitted more than 22 days ago). Private submissions that are not displayed on the EvalAI leaderboard have also been taken into account.

1 Like

Current leaderboard (as of February 23rd, 4 PM EST):
1st : Hawaii2024
2nd : Colt
3rd : K-PAX
4th : AXOLTL LLC
5th : FuturifAI
6th : Astrokinetix (AKX rel 9)
7th : Rocinante
8th : Go4Aero
9th : Baseline Heuristic Solution (MIT ARCLab - Host)
10th : SoloLearn
11th : Baseline Machine Learning Solution (MIT ARCLab - Host)
12th : False Anomaly
13th : Works On My Machine
14th : uoa_arcprize

Please note that this leaderboard has been updated to remove entries evaluated on the old test set (submission submitted more than 29 days ago). Private submissions that are not displayed on the EvalAI leaderboard have also been taken into account.

Current leaderboard (as of March 2nd, 3:30AM EST):
1st : Hawaii2024
2nd: Colt
3rd : K-PAX
4th : Rocinante
5th : AXOLTL LLC
6th : False Anomaly
7th : FuturifAI
8th : Go4Aero
9th : Astrokinetix (AKX rel 2)
10th : Baseline Heuristic Solution (MIT ARCLab - Host)
11th : SoloLearn
12th : Baseline Machine Learning Solution (MIT ARCLab - Host)
13th : BearlyDataScience
14th : space-player
15th : Works On My Machine
16th : uoa_arcprize

Please note that this leaderboard has been updated to remove entries evaluated on the old test set. Private submissions that are not displayed on the EvalAI leaderboard have also been taken into account.

In the challenge description it says that

The submissions will be run on a subset of the test dataset. The metrics and overall scores will be displayed on the leaderboard. At the end of the competition phase, the submissions will be evaluated on the full test dataset.

Does this (forum) leaderboard already include the evaluations on the full test set, or is it based on the scores of the partial test set?

This (forum) leaderboard is based on the same partial test set as the EvalAI leaderboard and not on the full test set.

Current leaderboard (as of March 9th, 12:30AM EST):
1st : Hawaii2024
2nd: Colt
3rd : K-PAX
4th : Go4Aero
5th : MiseryModel
6th : AXOLTL LLC
7th : Rocinante
8th : False Anomaly
9th : FuturifAI
10th : Astrokinetix
11th : Baseline Heuristic Solution (MIT ARCLab - Host)
12th : BY4Pol
13th : SoloLearn
14th : BearlyDataScience
15th : Baseline Machine Learning Solution (MIT ARCLab - Host)
16th : GEOPoLId
17th : space-player
18th : Works On My Machine
19th : uoa_arcprize

Please note that this leaderboard has been updated to remove entries evaluated on the old test set. Private submissions that are not displayed on the EvalAI leaderboard have also been taken into account.

Current leaderboard (as of March 16th, 2:00AM EST):
1st : Hawaii2024
2nd: Colt
3rd : MiseryModel
4th : K-PAX
5th : Millennial-IUP
6th : Go4Aero
7th : QR_Is
8th : AXOLTL LLC
9th : False Anomaly
10th : Rocinante
11th : FuturifAI
12th : Digantara
13th : JTMA
14th : Astrokinetix
15th : Rymdgruppen
16th : LDCI
17th : BirdBrain
18th : Baseline Heuristic Solution (MIT ARCLab - Host)
19th : BY4Pol
20th : SoloLearn
21st : BearlyDataScience
22nd : Baseline Machine Learning Solution (MIT ARCLab - Host)
23rd : GEOPoLId
24th : space-player
25th : Works On My Machine
26th : uoa_arcprize
27th : brAIhe

Please note that this leaderboard has been updated to remove entries evaluated on the old test set. Private submissions that are not displayed on the EvalAI leaderboard have also been taken into account.

Here is the final leaderboard for Phase I of the competition:
1st : Millennial-IUP
2nd : Hawaii2024
3rd : MiseryModel
4th : QR_Is
5th : FuturifAI
6th : Go4Aero
7th : K-PAX
8th : Colt
9th : Yzzzz
10th : Astrokinetix
11th : BirdBrain
12th : Esho
13th : Rocinante
14th : Rymdgruppen
15th : AXOLTL LLC
16th : SoloLearn
17th : Digantara
18th : BY4Pol
19th : LDCI
20th : Mercury
21st : JTMA
22nd : Waikiki
23rd : False Anomaly
24th : BearlyDataScience
25th : LML2024
26th : GEOPoLId
27th : brAIhe
28th : Turion Space
29th : Works On My Machine
30th : uoa_arcprize
31st : SASSy

All successful submissions (including private submissions that are not displayed on the EvalAI leaderboard) have been taken into account.

Thank you once again for your participation and congratulations to all teams!