"Is there water in the fridge?"
"Yes."
"Where? I don't see it."
"In the cells of the eggplant."
-- Terry Winograd,
In human language, wants and desires are always underspecified. It is impossible to list all caveats, all limitations, exceptions.
Language alone, and the current "AI" large language models cannot ever be "psychic" and divine our intentions. There will always be frustrating communication gaps. Barath Raghavan and Bruce Schneier have proposed yet another AI benchmark to measure the gap between the human's unambiguous intentions and the AI's responses or actions. When we define and measure, we can start to understand better what is needed and engineer solutions.
To measure is to know.
"I often say that when you can measure what you are speaking about, and express it in numbers, you know something about it; but when you cannot measure it, when you cannot express it in numbers, your knowledge is of a meagre and unsatisfactory kind; it may be the beginning of knowledge, but you have scarcely, in your thoughts, advanced to the stage of science, whatever the matter may be."
-- Lord Kelvin (William Thomson)
No comments:
Post a Comment