Getting started with Codabench

Codabench is an upgraded version of the CodaLab Competitions platform, allowing you to create either competitions or benchmarks. A benchmark is essentially an ever-lasting competition with multiple tasks, for which a participant can make multiple entries in the result table.

This getting started tutorial shows a simple example of how to create a competition. Advanced users should check fancier examples and the full documentation. If you simply wish to participate in a benchmark or competition, go to Participating in a benchmark.

1. Getting ready

   • Create a Codabench account (if not done yet)
   • Download the sample competition bundle and the sample submission.
   • Do not unzip them.

2. Create a competition

   • From the front page of Codabench, in the top menu, go to the Benchmark > Management
   • Click the green Upload button at the top right.
   • Upload the (zipped) sample competition bundle => this will create your competition.

3. Make changes

   • Click on the Edit gray button at the top to enter the editor.
   • Make small changes
     • Change the logo in the Details tab to another png of jpg file.
     • Change the end date in the Phases tab: if the competition is terminated, you will not be able to make submissions.
     • Save your changes and verify that they have become effective.

4. Make a submission

   • In your competition page, go to the tab My submissions
   • Submit the (zipped) sample submission bundle you downloaded.
   • When your submission finishes, go to the Result tab to check if it shows up on the leaderboard.
     • Warning: in some competitions, submissions successfully processed do not automatically get pushed to the leaderboard

5. Publish your competition

   • If you want to make your competition visible to all, you must publish it by checking the Publish box at the very bottom of the editor Details page.
   • After you publish your competition, it should now be visible when you are not logged in, at the URL of your competition page.

You are done with this simple tutorial. Next, check the more advanced tutorial.

You can also check out this blog post: How to create your first benchmark on Codabench.