{"id":2080,"date":"2024-04-01T17:14:34","date_gmt":"2024-04-02T00:14:34","guid":{"rendered":"https:\/\/www.digivideoplus.com\/dv_blog\/?p=2080"},"modified":"2024-04-01T17:14:34","modified_gmt":"2024-04-02T00:14:34","slug":"ai-chatbot-hallucinations-mind-those-ps-and-qs","status":"publish","type":"post","link":"https:\/\/www.digivideoplus.com\/dv_blog\/2024\/04\/01\/ai-chatbot-hallucinations-mind-those-ps-and-qs\/","title":{"rendered":"AI chatbot hallucinations \u2013 mind those P&#8217;s and Q&#8217;s"},"content":{"rendered":"\n<figure class=\"wp-block-image size-full\"><a href=\"https:\/\/www.digivideoplus.com\/dv_blog\/wp-content\/uploads\/2023\/03\/ai_seal_of_approval.png\"><img loading=\"lazy\" decoding=\"async\" width=\"720\" height=\"720\" src=\"https:\/\/www.digivideoplus.com\/dv_blog\/wp-content\/uploads\/2023\/03\/ai_seal_of_approval.png\" alt=\"AI seal of approval\" class=\"wp-image-1867\" srcset=\"https:\/\/www.digivideoplus.com\/dv_blog\/wp-content\/uploads\/2023\/03\/ai_seal_of_approval.png 720w, https:\/\/www.digivideoplus.com\/dv_blog\/wp-content\/uploads\/2023\/03\/ai_seal_of_approval-300x300.png 300w, https:\/\/www.digivideoplus.com\/dv_blog\/wp-content\/uploads\/2023\/03\/ai_seal_of_approval-150x150.png 150w\" sizes=\"auto, (max-width: 720px) 100vw, 720px\" \/><\/a><figcaption class=\"wp-element-caption\">No promises &#8230;<\/figcaption><\/figure>\n\n\n\n<p>This is no joke! You&#8217;ve heard about this \u2013 whether AI chatbots <a href=\"https:\/\/en.wikipedia.org\/wiki\/Mind_your_Ps_and_Qs\" data-type=\"link\" data-id=\"https:\/\/en.wikipedia.org\/wiki\/Mind_your_Ps_and_Qs\">mind their Ps and Qs<\/a>. So, beware of nonsense.<\/p>\n\n\n\n<p>Statistically, how often do AI hallucinations happen?<\/p>\n\n\n\n<p>Yes, there&#8217;ll be updates \u2026 &#8220;We can&#8217;t stop hallucinations, but we can manage them.&#8221; (Maybe like the <a href=\"https:\/\/en.wikipedia.org\/wiki\/Id,_ego_and_superego\" data-type=\"link\" data-id=\"https:\/\/en.wikipedia.org\/wiki\/Id,_ego_and_superego\">Id and Ego<\/a>?)<\/p>\n\n\n\n<p>\u2022 Wiki > <a href=\"https:\/\/en.wikipedia.org\/wiki\/Hallucination_(artificial_intelligence)\" data-type=\"link\" data-id=\"https:\/\/en.wikipedia.org\/wiki\/Hallucination_(artificial_intelligence)\">Hallucination (artificial intelligence)<\/a><\/p>\n\n\n\n<blockquote class=\"wp-block-quote is-layout-flow wp-block-quote-is-layout-flow\">\n<p>In the field of artificial intelligence (AI), a hallucination or artificial hallucination (also called confabulation or delusion) is a response generated by AI which contains false or misleading information presented as fact.<\/p>\n<\/blockquote>\n\n\n\n<p>\u2022 CNET > &#8220;<a href=\"https:\/\/www.cnet.com\/tech\/hallucinations-why-ai-makes-stuff-up-and-whats-being-done-about-it\/\" data-type=\"link\" data-id=\"https:\/\/www.cnet.com\/tech\/hallucinations-why-ai-makes-stuff-up-and-whats-being-done-about-it\/\" target=\"_blank\" rel=\"noreferrer noopener\">Hallucinations: Why AI Makes Stuff Up, and What&#8217;s Being Done About It<\/a>&#8221; by Lisa Lacy (April 1, 2024) \u2013 If you&#8217;re using generative AI to answer questions, it&#8217;s wise to do some external fact-checking to verify responses.<\/p>\n\n\n\n<blockquote class=\"wp-block-quote is-layout-flow wp-block-quote-is-layout-flow\">\n<p>\u2026 the [AI] model is trained to generate data that is &#8220;<em>statistically indistinguishable<\/em>&#8221; from the training data, or that has the same type of generic characteristics. There&#8217;s no requirement for it to be &#8220;true,&#8221; Soatto [Stefano Soatto, vice president and distinguished scientist at Amazon Web Services] said.<\/p>\n\n\n\n<p>&#8220;It generalizes or <em>makes an inference<\/em> based on what it knows about language, what it knows about the occurrence of words in different contexts,&#8221; said Swabha Swayamdipta, assistant professor of computer science at the USC Viterbi School of Engineering and leader of the Data, Interpretability, Language and Learning (DILL) lab. &#8220;This is why these language models produce facts which kind of seem <em>plausible but are not quite true <\/em>because they&#8217;re not trained to just produce exactly what they have seen before.&#8221;<\/p>\n\n\n\n<p>Another solution is to <em>embed the model within a larger system<\/em> \u2014 more software \u2014 that checks consistency and factuality and traces attribution.<\/p>\n\n\n\n<p>&#8220;Hallucination as a property of an AI model is unavoidable, but as <em>a property of the system that uses the model<\/em>, it is not only unavoidable, it is very avoidable and manageable,&#8221; Soatto said.<\/p>\n<\/blockquote>\n","protected":false},"excerpt":{"rendered":"<p>This is no joke! You&#8217;ve heard about this \u2013 whether AI chatbots mind their Ps and Qs. So, beware of nonsense. Statistically, how often do AI hallucinations happen? Yes, there&#8217;ll be updates \u2026 &#8220;We can&#8217;t stop hallucinations, but we can manage them.&#8221; (Maybe like the Id and Ego?) \u2022 Wiki > Hallucination (artificial intelligence) In [&hellip;]<\/p>\n","protected":false},"author":2,"featured_media":2084,"comment_status":"closed","ping_status":"","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[3,15,6],"tags":[191,192,204],"class_list":["post-2080","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-computer","category-news","category-research","tag-ai","tag-chatbot","tag-large-language-model"],"_links":{"self":[{"href":"https:\/\/www.digivideoplus.com\/dv_blog\/wp-json\/wp\/v2\/posts\/2080","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.digivideoplus.com\/dv_blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.digivideoplus.com\/dv_blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.digivideoplus.com\/dv_blog\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/www.digivideoplus.com\/dv_blog\/wp-json\/wp\/v2\/comments?post=2080"}],"version-history":[{"count":3,"href":"https:\/\/www.digivideoplus.com\/dv_blog\/wp-json\/wp\/v2\/posts\/2080\/revisions"}],"predecessor-version":[{"id":2083,"href":"https:\/\/www.digivideoplus.com\/dv_blog\/wp-json\/wp\/v2\/posts\/2080\/revisions\/2083"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.digivideoplus.com\/dv_blog\/wp-json\/wp\/v2\/media\/2084"}],"wp:attachment":[{"href":"https:\/\/www.digivideoplus.com\/dv_blog\/wp-json\/wp\/v2\/media?parent=2080"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.digivideoplus.com\/dv_blog\/wp-json\/wp\/v2\/categories?post=2080"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.digivideoplus.com\/dv_blog\/wp-json\/wp\/v2\/tags?post=2080"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}