-
Notifications
You must be signed in to change notification settings - Fork 11
VORC 2020 Results
The following table includes the overall VORC results for each team. The "Total" is the sum of the rank scores for each task (less is better).
| Team | Affiliation | Total | Ranking |
|---|---|---|---|
| TeamCCOM1 | University of New Hampshire | 8 | 1 |
| the_italian_job | None | 9 | 2 |
| bumblebee | National University of Singapore | 12 | 3 |
| gt-mrg | Georgia Institute of Technology | 13 | 4 |
| teamKanaloa | University of Hawaii at Manoa | 18 | 5 |
1This team resubmitted their solution a few days after the deadline because we were unable to run their code with CUDA support. The team submitted a non-CUDA alternative.
The following table includes the results for each of the four VORC tasks. The rank score for each task is derived from the task score as described in the VORC Competition and Task Descriptions document.
| Team | Station keeping | Wayfinding | Perception | Gymkhana |
|---|---|---|---|---|
| bumblebee | 5 | 2 | 2 | 3 |
| gt-mrg | 3 | 1 | 4.5 | 4.5 |
| TeamCCOM | 2 | 3 | 1 | 2 |
| teamKanaloa | 4 | 5 | 4.5 | 4.5 |
| the_italian_job | 1 | 4 | 3 | 1 |
The table below reports the overall score for each team on each of the four VORC 2020 tasks. Each task score represents the summary of task performance over two trial runs for each task. The details of how each task is scored are available in the VORC Competition and Task Descriptions document.
| Team | Station keeping | Wayfinding | Perception | Gymkhana #1 / #2 |
|---|---|---|---|---|
| bumblebee | 85.91 | 61.79 | 3.87 | Average(210.082311, MAX_ERROR) |
| gt-mrg | 6.38 | 2.24 | 10.00 | MAX_ERROR |
| TeamCCOM | 5.56 | 115.03 | 2.94 | 30.27 |
| teamKanaloa | 82.26 | 217.17 | 10.00 | MAX_ERROR |
| the_italian_job | 4.63 | 139.78 | 4.12 | 18.23 |
The scores for each of two runs for each of the four tasks are reported below.
| Team | Run 0 | Run 1 |
|---|---|---|
| bumblebee | 138.71 | 33.11 |
| gt-mrg | 5.90 | 6.85 |
| TeamCCOM | 4.88 | 6.23 |
| teamKanaloa | 15.99 | 148.54 |
| the_italian_job | 4.50 | 4.77 |
| Team | Run 0 | Run 1 |
|---|---|---|
| bumblebee | 4.25 | 119.31 |
| gt-mrg | 2.95 | 1.53 |
| TeamCCOM | 3.11 | 226.96 |
| teamKanaloa | 259.18 | 175.16 |
| the_italian_job | 259.18 | 20.37 |
| Team | Run 0 | Run 1 |
|---|---|---|
| bumblebee | 4.01 | 3.72 |
| gt-mrg | 10.00 | 10.00 |
| TeamCCOM | 4.42 | 1.45 |
| teamKanaloa | 10.00 | 10.00 |
| the_italian_job | 6.70 | 1.54 |
| Team | Run 0 | Run 1 |
|---|---|---|
| bumblebee | 210.08 | MAX |
| gt-mrg | MAX | MAX |
| TeamCCOM | 32.33 | 28.22 |
| teamKanaloa | MAX | MAX |
| the_italian_job | 17.30 | 19.15 |
All logs are available. See this tutorial for instructions.
For Phase 1 of the VORC, teams were tasked with creating a video to demonstrate their ability to setup, provision and run the VORC environment. This first step, "Hello World", showed that teams are well on their way to being able to submit full solutions for the next step, Phase 2: VORC.
Below are links to the 13 videos submitted by student and faculty teams from universities around the world.
| Team | Affiliation | Video URL |
|---|---|---|
| Team VAUV | Vellore Institute of Technology, Vellore | https://youtu.be/_Trv5yEweSk |
| Unmet Dependencies | IISER Bhopal | https://youtu.be/9IcSVguX2hU |
| Atlan | National Institute of Technology, Trichy | https://youtu.be/esZIIGo7MEI |
| Bumblebee | National University of Singapore | https://youtu.be/9RlwZYHTH7I |
| MTS AUV-ZHCET | Aligarh Muslim University | https://www.youtube.com/watch?v=S0Tsddfq03k |
| Marine Robotics Group | Georgia Institute of Technology | https://youtu.be/PjFq6o-yWI4 |
| Team Kanaloa | University of Hawaii at Manoa | https://youtu.be/atX9Y4k0Ii0 |
| Turings | Panjab University, Chandigarh, India | https://youtu.be/KGHz_JULBCE |
| Beasa | NIT Hamirpur | https://youtu.be/6lSMHizbulE |
| TheItalianJob | -- | https://youtu.be/7vhpnX0CiEU |
| CCOM | University of New Hampshire | https://www.youtube.com/watch?v=HuS56nY9CQU |
| Orbit | NIT Hamirpur | https://www.youtube.com/watch?v=gqZHyribsQA&feature=youtu.be |
| Noodle Buckwheat | -- | https://vimeo.com/483429175 |