Space Builder: Time Attack

The thing accuracy cannot tell you.

The point of this page

A confusion matrix tells you what someone perceived. It cannot tell you how they got there — whether they processed the two dimensions one after another or at the same time, whether they waited for both or stopped as soon as one was settled.

That isn't a limitation of the method. It's a limitation of the data. Below, three of the five architectures produce the same confusion matrix — not similar, the same. No amount of accuracy data, and no cleverer statistics, could ever separate them. But they finish at visibly different times. Response times are not a nice extra here; they are the only channel the information is in.

What this model actually needs from you

Counts alone — just the aggregate 4×4 table.

A1/B1 A1/B2 A2/B1 A2/B2
A1/B1 84 7 8 1
A1/B2 6 85 1 8
A2/B1 9 1 84 6
A2/B2 1 9 7 83

Counts + response times — every trial, individually, with a timestamp.

stimulus response rt (s)
A1/B1 A1/B1 0.61
A1/B2 A1/B2 0.44
A2/B1 A1/B1 0.98
A2/B2 A2/B2 0.52
… one row per trial, hundreds of rows

That's a genuinely different data-collection commitment, not just "the same experiment, analysed more thoroughly" — every trial needs its own timestamp, not just its outcome. The per-trial table gets compressed down to 5 quantiles per cell (80 numbers total) before it reaches the model; that compression is shown live in the The response times card below once you run an experiment.

Space & data

Exact response probabilities implied by the space.