Skip to content

VORC 2020 Results

Carlos Agüero edited this page Dec 22, 2020 · 9 revisions

Phase 2: VORC

Overall Results

The following table includes the overall VORC results for each team. The "Total" is the sum of the rank scores for each task (less is better).

Team Affiliation Total Ranking
TeamCCOM University of New Hampshire 8 1
the_italian_job -- 9 2
bumblebee National University of Singapore 12 3
gt-mrg Georgia Tech 13 4
teamKanaloa University of Hawaii 18 5

Ranking by Task

The following table includes the results for each of the four VORC tasks. The rank score for each task is derived from the task score as described in the VORC Competition and Task Descriptions document.

Team Station keeping Wayfinding Perception Gymkhana
bumblebee 5 2 2 3
gt-mrg 3 1 4.5 4.5
TeamCCOM 2 3 1 2
teamKanaloa 4 5 4.5 4.5
the_italian_job 1 4 3 1

Scoring by Task

The table below reports the overall score for each team on each of the four VORC 2020 tasks. Each task score represents the summary of task performance over two trial runs for each task. The details of how each task is scored are available in the VORC Competition and Task Descriptions document.

Team Station keeping Wayfinding Perception Gymkhana #1 / #2
bumblebee 85.91 61.79 3.87 Average(210.082311, MAX_ERROR)
gt-mrg 6.38 2.24 10.00 MAX_ERROR
TeamCCOM 5.56 115.03 2.94 30.27
teamKanaloa 82.26 217.17 10.00 MAX_ERROR
the_italian_job 4.63 139.78 4.12 18.23

Individual Task Scores

The scores for each of two runs for each of the four tasks are reported below.

Station keeping

Team Run 0 Run 1
bumblebee 138.71 33.11
gt-mrg 5.90 6.85
TeamCCOM 4.88 6.23
teamKanaloa 15.99 148.54
the_italian_job 4.50 4.77

Wayfinding

Team Run 0 Run 1
bumblebee 4.25 119.31
gt-mrg 2.95 1.53
TeamCCOM 3.11 226.96
teamKanaloa 259.18 175.16
the_italian_job 259.18 20.37

Perception

Team Run 0 Run 1
bumblebee 4.01 3.72
gt-mrg 10.00 10.00
TeamCCOM 4.42 1.45
teamKanaloa 10.00 10.00
the_italian_job 6.70 1.54

Gymkhana

Team Run 0 Run 1
bumblebee 210.08 MAX
gt-mrg MAX MAX
TeamCCOM 32.33 28.22
teamKanaloa MAX MAX
the_italian_job 17.30 19.15

Logs

All logs are available. See this tutorial for instructions.

Phase 1: Hello World

For Phase 1 of the VORC, teams were tasked with creating a video to demonstrate their ability to setup, provision and run the VORC environment. This first step, "Hello World", showed that teams are well on their way to being able to submit full solutions for the next step, Phase 2: VORC.

Below are links to the 13 videos submitted by student and faculty teams from universities around the world.

Team Affiliation Video URL
Team VAUV Vellore Institute of Technology, Vellore https://youtu.be/_Trv5yEweSk
Unmet Dependencies IISER Bhopal https://youtu.be/9IcSVguX2hU
Atlan National Institute of Technology, Trichy https://youtu.be/esZIIGo7MEI
Bumblebee National University of Singapore https://youtu.be/9RlwZYHTH7I
MTS AUV-ZHCET Aligarh Muslim University https://www.youtube.com/watch?v=S0Tsddfq03k
Marine Robotics Group Georgia Institute of Technology https://youtu.be/PjFq6o-yWI4
Team Kanaloa University of Hawaii at Manoa https://youtu.be/atX9Y4k0Ii0
Turings Panjab University, Chandigarh, India https://youtu.be/KGHz_JULBCE
Beasa NIT Hamirpur https://youtu.be/6lSMHizbulE
TheItalianJob -- https://youtu.be/7vhpnX0CiEU
CCOM University of New Hampshire https://www.youtube.com/watch?v=HuS56nY9CQU
Orbit NIT Hamirpur https://www.youtube.com/watch?v=gqZHyribsQA&feature=youtu.be
Noodle Buckwheat -- https://vimeo.com/483429175
Clone this wiki locally