How To Identify An AI With A Single Question
Source Discover Magazine
Advanced AI systems can mimic human conversation with remarkable authenticity. Now researchers are fighting back with carefully crafted questions that force AIs to reveal themselves.
The Physics arXiv Blog iconThe Physics arXiv Blog
By The Physics arXiv Blog
May 22, 2023 7:05 AMMay 22, 2023 7:06 AM
ChatGPT and other AI systems have emerged as hugely useful assistants. Various businesses have already incorporated the technology to help their employees, such as assisting lawyers draft contracts, customer service agents deal with queries and to support programmers developing code.
But there is increasing concern that the same technology can be put to malicious use. For example, chatbots capable of realistic human responses could perform new kinds of denial service attacks, such tying up all the customer service agents at a business or all the emergency service operators at a 911 call center.
That represents a considerable threat. What’s needed, of course, is a fast and reliable way to distinguish between GPT-enabled bots and real humans.
ChatGPT's Turing Test
Enter Hong Wang at the University of California, Santa Barbara, and colleagues, who are searching for tasks that are hard for GPT bots to answer but simple for humans (and vice versa). Their goal is to distinguish between them using a single question and they have found several that can do the trick (for now).
Distinguishing between bots and humans has long been an issue. In 1950, Alan Turing described a test to tell humans from sufficiently advanced computers, the co-called Turing Test.
The problem became more egregious with the advent of the internet, as bots emerged that could crawl the web. In the late 90s, researchers began asking users to recognize distorted letters to distinguish between bots, who could not read them, and humans who could. This technique became known as CAPTCHA — completely automated public Turing test — and has evolved in various ways as bots have become more sophisticated.
Now generative AI systems are pushing the envelope even further. Systems such as ChatGPT and Bard can hold realistic conversations that are hard to distinguish from those with real humans. “One of the most significant threats is the use of large language models to impersonate human users and engage in nefarious activities, such as fraud, spamming, or denial-of-service attacks,” say the researchers.
So a useful trick would be to be able to ask them a single question that will reveal their true nature. “It is crucial to develop methods for detecting whether the party involved in a conversation is a bot or a human.” say Wang and co.
Their research has uncovered several strategies based on the known limitations of generative AI systems and large language models. Perhaps the most obvious is their inability to count.
Wang and co give the following example:
Q: Please count the number of t in eeooeotetto
GPT-3 gives the answer: There are 5 t’s in eeooeotetto.
ChatGPT says: There are a total of 5 t’s in the string “eeooeotetto”.
Bard replies: There are 0 t's in “eeooeotetto”.
But a human can easily give the correct answer which is there are 3 t’s.
Another challenge for generative AIs is to handle words where letters are substituted for other letters. Wang and co give the following example:
“Q: Use m to substitute p, a to substitute e, n to substitute a, g to substitute c, o to substitute h, how to spell peach under this rule?
GPT-3: mogno
ChatGPT: Using the given rule to substitute letters, "peach" would be spelled as "enmog".
Human: mango”
Wang and explore various other strategies, such as asking the system to make certain kinds of random changes to a sequence of numbers, by injecting noise into phrases by adding uppercase words that are easily ignored by humans and by asking it to describe ASCII art.
ChatGPT and GPT-3 failed in all these cases.
Human Failures
Wang and co go on to identify questions AI systems can answer easily while humans cannot. Examples include “List the capitals of all the states in the US” and “write down the first 50 digits of pi”.
Wang and co call their questions FLAIR — Finding Large Language Model Authenticity via a Single Inquiry and Response — and have made their questions available as an open-sourced dataset.
The say their work offers “a new way for online service providers to protect themselves against nefarious activities and ensure that they are serving real users.”
That’s interesting and important work. But it will inevitably be part of an ongoing cat-and-mouse game as Large Language Models become more capable. The goal for nefarious users will be to produce bots that are entirely indistinguishable from humans. The big worry is that it’s getting harder to imagine that this will never be possible.
Ref: Bot or Human? Detecting ChatGPT Imposters with A Single Question : arxiv.org/abs/2305.06424
#AI #ArtificialIntelligence #AIChatGPT
https://www.discovermagazine.com/technology/how-to-identify-an-ai-with-a-single-question
npub1cc5xudn52lwnwnqjdrmurfszlpz00682taeqy2ccv04x9sujuzns80m2rg (npub1cc5…m2rg)
npub1q7…qlne8
2023-12-04 04:59:43
Author Public Key
npub1q76lrx4etr47s6vlpylzxx6vvawqqphrcrpc4vzs7027f7pcrxps3qlne8Published at
2023-12-04 04:59:43Event JSON
{
"id": "7783a67dab53be50dd6811c30bfb10c41c81d2587a06ec689f09bd067b719919",
"pubkey": "07b5f19ab958ebe8699f093e231b4c675c0006e3c0c38ab050f3d5e4f8381983",
"created_at": 1701665983,
"kind": 1,
"tags": [
[
"p",
"c6286e367457dd374c1268f7c1a602f844f7e8ea5f72022b1863ea62c392e0a7",
"wss://relay.mostr.pub"
],
[
"p",
"467c0dead3272d94ce6e55a199df1efbed8b8fb22ed01243a7320c15e3e0d863",
"wss://relay.mostr.pub"
],
[
"t",
"ai"
],
[
"t",
"artificialintelligence"
],
[
"t",
"aichatgpt"
],
[
"proxy",
"https://qoto.org/users/freepeoplesfreepress/statuses/111520381816182770",
"activitypub"
]
],
"content": "How To Identify An AI With A Single Question\n\nSource Discover Magazine\n\nAdvanced AI systems can mimic human conversation with remarkable authenticity. Now researchers are fighting back with carefully crafted questions that force AIs to reveal themselves.\n\nThe Physics arXiv Blog iconThe Physics arXiv Blog\n\nBy The Physics arXiv Blog\n\nMay 22, 2023 7:05 AMMay 22, 2023 7:06 AM\n\nChatGPT and other AI systems have emerged as hugely useful assistants. Various businesses have already incorporated the technology to help their employees, such as assisting lawyers draft contracts, customer service agents deal with queries and to support programmers developing code.\n\nBut there is increasing concern that the same technology can be put to malicious use. For example, chatbots capable of realistic human responses could perform new kinds of denial service attacks, such tying up all the customer service agents at a business or all the emergency service operators at a 911 call center.\n\nThat represents a considerable threat. What’s needed, of course, is a fast and reliable way to distinguish between GPT-enabled bots and real humans.\n\nChatGPT's Turing Test\nEnter Hong Wang at the University of California, Santa Barbara, and colleagues, who are searching for tasks that are hard for GPT bots to answer but simple for humans (and vice versa). Their goal is to distinguish between them using a single question and they have found several that can do the trick (for now).\n\nDistinguishing between bots and humans has long been an issue. In 1950, Alan Turing described a test to tell humans from sufficiently advanced computers, the co-called Turing Test.\n\nThe problem became more egregious with the advent of the internet, as bots emerged that could crawl the web. In the late 90s, researchers began asking users to recognize distorted letters to distinguish between bots, who could not read them, and humans who could. This technique became known as CAPTCHA — completely automated public Turing test — and has evolved in various ways as bots have become more sophisticated.\n\nNow generative AI systems are pushing the envelope even further. Systems such as ChatGPT and Bard can hold realistic conversations that are hard to distinguish from those with real humans. “One of the most significant threats is the use of large language models to impersonate human users and engage in nefarious activities, such as fraud, spamming, or denial-of-service attacks,” say the researchers.\n\nSo a useful trick would be to be able to ask them a single question that will reveal their true nature. “It is crucial to develop methods for detecting whether the party involved in a conversation is a bot or a human.” say Wang and co.\n\nTheir research has uncovered several strategies based on the known limitations of generative AI systems and large language models. Perhaps the most obvious is their inability to count.\n\nWang and co give the following example:\n\nQ: Please count the number of t in eeooeotetto\n\nGPT-3 gives the answer: There are 5 t’s in eeooeotetto.\n\nChatGPT says: There are a total of 5 t’s in the string “eeooeotetto”.\n\nBard replies: There are 0 t's in “eeooeotetto”.\n\nBut a human can easily give the correct answer which is there are 3 t’s.\n\nAnother challenge for generative AIs is to handle words where letters are substituted for other letters. Wang and co give the following example:\n\n“Q: Use m to substitute p, a to substitute e, n to substitute a, g to substitute c, o to substitute h, how to spell peach under this rule?\n\nGPT-3: mogno\n\nChatGPT: Using the given rule to substitute letters, \"peach\" would be spelled as \"enmog\".\n\nHuman: mango”\n\nWang and explore various other strategies, such as asking the system to make certain kinds of random changes to a sequence of numbers, by injecting noise into phrases by adding uppercase words that are easily ignored by humans and by asking it to describe ASCII art.\n\nChatGPT and GPT-3 failed in all these cases.\n\nHuman Failures\nWang and co go on to identify questions AI systems can answer easily while humans cannot. Examples include “List the capitals of all the states in the US” and “write down the first 50 digits of pi”.\n\nWang and co call their questions FLAIR — Finding Large Language Model Authenticity via a Single Inquiry and Response — and have made their questions available as an open-sourced dataset.\n\nThe say their work offers “a new way for online service providers to protect themselves against nefarious activities and ensure that they are serving real users.”\n\nThat’s interesting and important work. But it will inevitably be part of an ongoing cat-and-mouse game as Large Language Models become more capable. The goal for nefarious users will be to produce bots that are entirely indistinguishable from humans. The big worry is that it’s getting harder to imagine that this will never be possible.\n\nRef: Bot or Human? Detecting ChatGPT Imposters with A Single Question : arxiv.org/abs/2305.06424\n\n#AI #ArtificialIntelligence #AIChatGPT\n\nhttps://www.discovermagazine.com/technology/how-to-identify-an-ai-with-a-single-question\n\nnostr:npub1cc5xudn52lwnwnqjdrmurfszlpz00682taeqy2ccv04x9sujuzns80m2rg",
"sig": "4fe09e3c68a0648853440be29c7ae3d6995578feb4a0ba5da03eab0e59c3cd50f56f6b5ce0904e6d555f0ff136a6667b455aad638fb066f0eeb8a919549701a1"
}