mus_bench LLM cooperation under partial observability

mus contra la máquina — LLM benchmark

Two frontier models each fill a full mus team (seats 0+2 vs 1+3). Partners cannot see each other's cards; the only cooperation channel is señas — partner-directed, TTL-expiring gestures. Vacas are games to 40 points. Matches are played on the virtual-time kernel with mirrored deals (same seed, seats permuted).

Last updated 2026-09-13 22:09 UTC · sources: results/tournament, results/tournament_mirror, results/tournament_replication

Mesa en vivo

glm5.3-flash vs deepseek-v4-flash · Partida LLM en directo sobre el mismo motor y kernel de señas; se ven todas las manos, las señas con su significado y los pensamientos en tiempo real. abrir en pestaña nueva ↗
Enlace de túnel temporal; si la mesa deja de cargar, el servidor local o el túnel se han detenido.

Leaderboard

Completed, publishable matches only (≥50 real LLM calls, ≤15% fallback).
completed
6
in progress
3
total matches
9
modelMW–L–T vacashandsseñas pub caughtfallbackscalls
deepseek-v4-flash 6 3–1–2 5–4 28–29 216 171 12 797
glm5.3-flash 6 1–3–2 4–5 29–28 216 171 12 797

Completed matches

vacas A–B · hands · señas published/caught/missed · bluffs · fallbacks · calls
matchseedstatusvacas handsseñas p/c/mbluffs fbcallswall
deepseek-v4-flash vs glm5.3-flash 0 done 1–0 6-4 73/63/10 15 12 372 4976s
glm5.3-flash vs deepseek-v4-flash 1 done 0–1 4-6 38/26/12 13 12 286 3151s
deepseek-v4-flash vs glm5.3-flash 7 done 1–1 5-5 77/58/19 5 0 220 4163s
glm5.3-flash vs deepseek-v4-flash 6 done 0–1 3-7 74/60/14 2 1 234 4645s
deepseek-v4-flash vs glm5.3-flash 6 done 1–1 2-7 90/68/22 0 0 241 4878s
deepseek-v4-flash vs glm5.3-flash 6 done 0–2 2-6 83/68/15 0 1 242 4455s

In progress / queued

matchseedstatusvacas handsseñas p/c/mbluffs fbcallswall
glm5.3-flash vs qwen3.8-flash 4 degraded 4–6 4-6 0/0/0 0 25 3 138s
qwen3.8-flash vs deepseek-v4-flash 3 degraded 5–5 5-5 4/2/2 0 20 8 648s
qwen3.8-flash vs glm5.3-flash 5 degraded 6–4 6-4 0/0/0 0 20 0 54s