{"id":10951,"date":"2024-09-23T08:54:22","date_gmt":"2024-09-23T12:54:22","guid":{"rendered":"https:\/\/resources.evans-legal.com\/?p=10951"},"modified":"2024-09-23T08:57:07","modified_gmt":"2024-09-23T12:57:07","slug":"butler-co-order-for-generative-ai","status":"publish","type":"post","link":"https:\/\/resources.evans-legal.com\/?p=10951","title":{"rendered":"Butler Co. Order for Generative AI"},"content":{"rendered":"\n<p>The Court of Common Pleas of Butler County has issued the first general administrative order in Pennsylvania (and one of the first in the U.S.) governing court filings produced using &#8220;generative artificial intelligence&#8221; (also known as &#8220;large language models,&#8221; such as ChatGPT).  The order requires that filings include an affidavit attesting that generative AI was not used in the perparation of the filing or, if AI was used, that &#8220;each and every citation to the law or the record in the filing has been verified by a human being as authentic and accurate.&#8221;  &#8220;Use of Generative Artificial Intelligence; MsD No. 2024-40258&#8221; (9\/10\/2024), <a href=\"https:\/\/www.pacodeandbulletin.gov\/Display\/pabull?file=\/secure\/pabulletin\/data\/vol54\/54-38\/1332.html\" target=\"_blank\" rel=\"noreferrer noopener\">54 Pa.B. 5980<\/a> (9\/21\/2024).<\/p>\n\n\n\n<p>Large language models are known to &#8220;hallucinate&#8221; or fabricate legal citations when asked to write legal briefs. In one publicized instance, a lawyer used ChatGPT to prepare a brief and was sanctioned when the brief contained citations to non-existent cases. &#8220;<a href=\"https:\/\/www.nytimes.com\/2023\/05\/27\/nyregion\/avianca-airline-lawsuit-chatgpt.html\" target=\"_blank\" rel=\"noreferrer noopener\">Here&#8217;s What Happens When Your Lawyer Uses ChatGPT<\/a>,&#8221; <em>New York Times<\/em> (5\/27\/2023). One study of general-purpose &#8220;chatbots&#8221; found that they hallucinated between 58% and 82% of the time on legal queries and, in a more recent study, legal AI tools from LexisNexis and Thomson Reuters (Westlaw) still produced incorrect information (or hallucinated&#8221;) a significant amount of the time (17% and 34%, respectively). &#8220;<a href=\"https:\/\/hai.stanford.edu\/news\/ai-trial-legal-models-hallucinate-1-out-6-or-more-benchmarking-queries\" target=\"_blank\" rel=\"noreferrer noopener\">A New Study Reveals the Need for Benchmarking and Public Evaluation of AI Tools in the Law<\/a>,&#8221; <em>Stanford University Human-Centered Artificial Intelligence<\/em> (5\/23\/2024).<\/p>\n\n\n\n<p>So practitioners should use care when using AI tools for legal research or first drafts of pleadings or documents.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>The Court of Common Pleas of Butler County has issued the first general administrative order in Pennsylvania (and one of the first in the U.S.) governing court filings produced using &#8220;generative artificial intelligence&#8221; (also known as &#8220;large language models,&#8221; such &hellip; <a class=\"more-link\" href=\"https:\/\/resources.evans-legal.com\/?p=10951\">Continue reading <span class=\"meta-nav\">&rarr;<\/span><\/a><\/p>\n","protected":false},"author":6,"featured_media":0,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"pmpro_default_level":"","footnotes":""},"categories":[29,36],"tags":[530],"class_list":["post-10951","post","type-post","status-publish","format-standard","hentry","category-news-items","category-regulations","tag-local-rules","pmpro-has-access"],"_links":{"self":[{"href":"https:\/\/resources.evans-legal.com\/index.php?rest_route=\/wp\/v2\/posts\/10951","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/resources.evans-legal.com\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/resources.evans-legal.com\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/resources.evans-legal.com\/index.php?rest_route=\/wp\/v2\/users\/6"}],"replies":[{"embeddable":true,"href":"https:\/\/resources.evans-legal.com\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=10951"}],"version-history":[{"count":4,"href":"https:\/\/resources.evans-legal.com\/index.php?rest_route=\/wp\/v2\/posts\/10951\/revisions"}],"predecessor-version":[{"id":10966,"href":"https:\/\/resources.evans-legal.com\/index.php?rest_route=\/wp\/v2\/posts\/10951\/revisions\/10966"}],"wp:attachment":[{"href":"https:\/\/resources.evans-legal.com\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=10951"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/resources.evans-legal.com\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=10951"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/resources.evans-legal.com\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=10951"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}