AI & Decisions ยท 2 minute read
Why Humanlike AI Can Feel More Trustworthy
Warm language, a name and a natural conversation can make software feel more understanding or reliable than its tested performance supports.
A normal situation
A chatbot remembers the tone of the conversation, apologises and explains an answer confidently. It starts to feel as if it understands the situation in the same way a person would.
What is happening?
Humanlike cues make interaction easier, but they can also encourage us to infer human abilities, intentions or understanding that have not actually been tested.
A pleasant interface and a capable system are not the same thing. Trust should depend on what the system can access, verify and do reliably for the task.
The useful lens
Anthropomorphism
This does not prove that one bias caused the decision. It is a useful lens for asking a better question and checking the evidence.
Evidence note: Anthropomorphism is the attribution of humanlike properties, intentions, emotions, or mental states to nonhuman agents. It is a well-established psychological phenomenon, but it is not automatically a cognitive error: humanlike models can sometimes be useful. The risk appears when humanlike cues are treated as evidence for capabilities, understanding, accuracy, consciousness, or motives that have not actually been demonstrated.
