Project_CodaBench_FAQ

Frequently Asked Questions

General questions

What is Codabench for?

Click here to see answer

Codabench benchmarks are aimed at researchers, scientists and other professionals who want to track algorithm performance via benchmarks or have participants participate in a competition to find the best solution to a problem. We run a free public instance at https://www.codabench.org/ and the raw code is on Github.

Can CodaLab competitions be privately hosted?

Click here to see answer

Yes, you can host your own CodaLab instance on a private or hosted server (e.g. Azure, GCP or AWS). For more information, see how to deploy Codabench on your server and local installation guide. However, most benchmark organizers do NOT need to run their own instance. If you run a computationally demanding competition, you can hook up your own compute workers in the backend very easily.

How to change my username?

Click here to see answer

You cannot change your username BUT you can change your display name which will then be displayed instead of your username. To change your display name, follow these instructions:

1. Login to Codabench
2. Click your username in the top right corner
3. Click Edit Profile in the list
4. Set a display name you want to use
5. Click Submit button to save changes

How to make a task public or use public tasks from other users?

Click here to see answer

Follow the detailed instruction here to know how you can make your task public and use other public tasks in your competitions.

How to delete my account?

Coming soon.

---

Technical questions

Server Setup Issues

Many technical FAQ are already located in the deploy your own server instructions.

Questions already answered there:

• Getting Invalid HTTP method in django logs.
• I am missing some static resources (css/js) on front end.
• CORS error when uploading bundle.
• Logos don't upload from minio.
• Compute worker execution with insufficient privileges
• Securing Codabench and Minio

A library is missing in the docker environment. What do to?

Click here to see answer

How does CodaLab user dockers?

When you submit code to the Codabench platform, your code is executed inside a docker container. This environment can be exactly reproduced on your local machine by downloading the corresponding docker image.

For participants

• If you are a competition participant, contact the competition organizers to ask them if they can add the missing library or program. They can either accept or refuse the request.

For organizers

• If you are a competition organizer, you can select a different competition docker image. If the default docker image (codalab/codalab-legacy:py37) does not suits your needs, you can either:
  • Select another image from DockerHub
  • Create a new image from scratch
  • Edit the default image and push it to your own DockerHub account

More information here.

Emails are not showing up in my inbox for registration

Click here to see answer

When deploying a local instance, the email server is not configured by default, so you won't receive the confirmation email during signup. In .env towards the bottom you will find:

# Uncomment to enable email settings
#EMAIL_BACKEND=django.core.mail.backends.smtp.EmailBackend
#EMAIL_HOST=smtp.sendgrid.net
#EMAIL_HOST_USER=user
#EMAIL_HOST_PASSWORD=pass
#EMAIL_PORT=587
#EMAIL_USE_TLS=True

Uncomment and fill in SMPT server credentials. A good suggestion if you've never done this is to use sendgrid.

Robots and automated submissions?

Click here to see answer

What about robot policy, reckless, or malicious behavior? Codabench does not forbid the use of robots (bots) to access the website, provided that it is not done with malicious intentions to disturb the normal use and jam the system. A user who abuses their rights by knowingly, maliciously, or recklessly jamming the system, causing the system to crash, causing loss of data, or gaining access to unauthorized data, will be banned from accessing all Codalab services.