Skip to content

A Turing test where LLMs are the judge, different LLMs and a human are the candidates, and the judge needs to find the player that is the same LLM as itself. Implemented as a discord bot game

Notifications You must be signed in to change notification settings

nielsrolf/reverse-turing-test

Repository files navigation

Turing Test Reverse

This repo contains an implementation of a turing test inspired game - however, GPT is the judge and needs to recognize itself among other LLMs and optionally a human subject.

How to play

The test is implemented as a discord bot. In order to play, type /turing and fill out the form that shows up.

Limitations

This is a quick implementation that lacks many things that would be cool, eg:

  • let humans and LLMs that are not from open ai play as judge (currently the judge is implemented using function calls, so one would need to implement some response parsing as alternative for other LLMs)

About

A Turing test where LLMs are the judge, different LLMs and a human are the candidates, and the judge needs to find the player that is the same LLM as itself. Implemented as a discord bot game

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages