Turing test
Chatbot evaluation method
A Turing test is a measure of machine intelligence proposed by mathematician Alan Turing in 1950.
In its classic form, a human judge converses with both a human and a computer through text; if the judge cannot reliably distinguish which is which, the machine is said to have passed.
The test has become a cultural touchstone for discussions about artificial intelligence, though critics argue it measures only the appearance of intelligence rather than genuine understanding.
The chatbot failed the Turing test when it couldn't handle sarcasm.
One who questions formally
- respondentOne who gives answers
- dialogueSpoken exchange between parties
- questioningSeeking answers through inquiry
- text-basedConveyed through writing
natural language · chatbot · terminal · transcript · exchange · prompt · response · judge
Standard for comparison
- assessmentFormal evaluation of worth
- criteriaStandards for judgment
- measurementDetermining size or amount
- evaluationDetermining worth or quality
validation · pass · fail · judge · interrogator · baseline · standard · metric
Capacity for subjective experience
- awarenessState of perceiving reality
- cognitionMental knowledge acquisition
- mindSeat of consciousness
- intelligenceMental ability, cognitive capacity
understanding · self-awareness · thought · perception · qualia · philosophy of mind · consciousness · thinking machine
Adaptive resemblance to another
- deceptionIntentional misleading of others
- impersonationPretending to be another
- simulationImitation of real processes
- pretenseDeceptive outward show
convincing · indistinguishable · passing · fooling · masquerade · emulation · imitation game · believability
Mid-twentieth century year
- imitation gameMachine intelligence assessment
- artificial intelligenceMachines mimicking human thought
- machine intelligenceAutomated cognitive capability
- ColossusImmense statue or figure
interrogator
One who questions formally
- respondentOne who gives answers
- dialogueSpoken exchange between parties
- questioningSeeking answers through inquiry
text-based · natural language · chatbot · terminal · transcript · exchange · prompt · response · judge · conversation partner
benchmark
Standard for comparison
- assessmentFormal evaluation of worth
- criteriaStandards for judgment
- measurementDetermining size or amount
evaluation · validation · pass · fail · judge · interrogator · baseline · standard · metric · scoring
sentience
Capacity for subjective experience
intelligence · understanding · self-awareness · thought · perception · qualia · philosophy of mind · consciousness · thinking machine · sapience
mimicry
Adaptive resemblance to another
- deceptionIntentional misleading of others
- impersonationPretending to be another
- simulationImitation of real processes
pretense · convincing · indistinguishable · passing · fooling · masquerade · emulation · imitation game · believability · plausibility
1950
Mid-twentieth century year
- imitation gameMachine intelligence assessment
- artificial intelligenceMachines mimicking human thought
- machine intelligenceAutomated cognitive capability
Turing testCAPTCHA
Automated humanness verification
biometric authentication · liveness detection · human · natural · human mind