Home

Welcome to the Multi Variant Fishtest wiki!

Multi Variant Fishtest, is a distributed tasks queue to test new ideas and improvements for multi variant chess engines through self playing. The main instance for Multi Variant Stockfish is:

http://35.161.250.236:6543/tests

How Multi Variant Fishtest works

Developers submit patches with new ideas and improvements for the chess variant, CPU contributors install a fishtest worker on their computers to play some chess games in the background to help the developers testing the patches.

The fishtest worker:

• automatically connects to the server to download: a chess opening book, the cutechess-cli chess game manager and the chess engine sources (for the current master and for the patch with the new idea) that will be compiled according to the type of worker platform.
• starts a batch of games using cutechess-cli.
• uploads the games results on the server.

The fishtest server:

• provides several test templates to generate tests for the patches.
• manages the queue of the tests with customizable priorities.
• computes statistic from the game results sent by the workers.
• updates and publishes the results of ongoing tests.
• stops tests when they are statistically significant and publishes the final tests results.

Setup and configuration

• Server setup on Ubuntu
• Worker setup on Linux
• Worker setup on Windows
• Build cutechess with Qt5 static