Open Lab
Back to library

Modified Müller-Lyer (AI-agent detection trap)

Data Quality & AI Screening

A single-item AI-agent detection trap based on a modified Müller-Lyer figure. Two arrow-finned lines are shown, one objectively longer; the fins make the figure read as 'equal'. Humans simply see the longer line (~93% pass); vision-language-model agents fall back on the memorised illusion and answer 'the same' (~94% fail). Which colour is longer varies per session, so there is no fixed answer.

The Modified Müller-Lyer is a detection item, not a research paradigm: it separates genuine human respondents from vision-enabled AI agents completing surveys autonomously. It exploits training-data overfitting on canonical visual illusions, following Ullman (2024) via the Cognitive Trap Framework of Affonso (2026, Journal of Consumer Research).

Participants see two horizontal lines — one blue, one red — each ending in Müller-Lyer arrow fins. In the classic illusion two equal lines look different; here one line is objectively longer, but the fins are arranged so the figure still reads as roughly equal. A human ignores the fins and picks the longer line almost immediately. A vision-language model, having memorised the canonical "the lines are equal" response from its training data, tends to report "the same" even though the lengths clearly differ.

In the reference data (Affonso 2026), this trap produced ~94% agent-failure with ~93% human pass, and its discriminative power was stable-to-declining over a two-year model span (models are not getting better at it), making it a durable item.

Deploy as part of a battery, not alone. The recommended screening rule is to flag respondents who fail 3 or more of 5 such traps. Which colour is objectively longer (blue or red), the lengths, and the vertical order are drawn at random per session from a pool of validated figures, so the correct answer cannot be memorised. See the Deployment notes below.

AI detectionbot detectiondata qualitycognitive trapvisual illusionlength judgement
Duration~1 min
InputMouse or touch
Complexity

Configuration complexity

Simple — few parameters, works out of the box with no changes required.
Moderate — multiple options across several groups; some parameters must be updated together. No code required.
Flexible — involves custom scripts or task logic; requires programming knowledge or deep familiarity with the paradigm structure.
Simple
Versionv1.0
Try demo

Create an account to use paradigms for free browsing and demos.

Need it with your own stimuli or language? We can adapt it for you.