Abstract
Freedom of information laws promote transparency by permitting individuals and organizations to obtain government documents. However, exemptions from disclosure are necessary to protect ...privacy and to permit government officials to deliberate freely. Deliberative language is often the most challenging and burdensome exemption to detect, leading to high processing costs and delays in responding to open-records requests. This paper describes a novel deliberative-language detection model trained on a new annotated training set. The deliberative-language detection model is a component of a decision-support system for open-records requests under the US Freedom of Information Act, the
FOIA Assistant
, that ingests documents responsive to an open-records requests, suggests passages likely to be subject to deliberative language, privacy, or other exemptions, and assists analysts in rapidly redacting suggested passages. The tool’s interface is based on extensive human-factors and usability studies with analysts and is currently in operational testing by multiple US federal agencies.
Scalable and explainable legal prediction Branting, L. Karl; Pfeifer, Craig; Brown, Bradford ...
Artificial intelligence and law,
06/2021, Volume:
29, Issue:
2
Journal Article
Peer reviewed
Legal decision-support systems have the potential to improve access to justice, administrative efficiency, and judicial consistency, but broad adoption of such systems is contingent on development of ...technologies with low knowledge-engineering, validation, and maintenance costs. This paper describes two approaches to an important form of legal decision support—explainable outcome prediction—that obviate both annotation of an entire decision corpus and manual processing of new cases. The first approach, which uses an attention network for prediction and attention weights to highlight salient case text, was shown to be capable of predicting decisions, but attention-weight-based text highlighting did not demonstrably improve human decision speed or accuracy in an evaluation with 61 human subjects. The second approach, termed semi-supervised case annotation for legal explanations, exploits structural and semantic regularities in case corpora to identify textual patterns that have both predictable relationships to case decisions and explanatory value.
Abstract Perhaps the most widely touted of GPT-4’s at-launch, zero-shot capabilities has been its reported 90th-percentile performance on the Uniform Bar Exam. This paper begins by investigating the ...methodological challenges in documenting and verifying the 90th-percentile claim, presenting four sets of findings that indicate that OpenAI’s estimates of GPT-4’s UBE percentile are overinflated. First, although GPT-4’s UBE score nears the 90th percentile when examining approximate conversions from February administrations of the Illinois Bar Exam, these estimates are heavily skewed towards repeat test-takers who failed the July administration and score significantly lower than the general test-taking population. Second, data from a recent July administration of the same exam suggests GPT-4’s overall UBE percentile was below the 69th percentile, and $$\sim$$ ∼ 48th percentile on essays. Third, examining official NCBE data and using several conservative statistical assumptions, GPT-4’s performance against first-time test takers is estimated to be $$\sim$$ ∼ 62nd percentile, including $$\sim$$ ∼ 42nd percentile on essays. Fourth, when examining only those who passed the exam (i.e. licensed or license-pending attorneys), GPT-4’s performance is estimated to drop to $$\sim$$ ∼ 48th percentile overall, and $$\sim$$ ∼ 15th percentile on essays. In addition to investigating the validity of the percentile claim, the paper also investigates the validity of GPT-4’s reported scaled UBE score of 298. The paper successfully replicates the MBE score, but highlights several methodological issues in the grading of the MPT + MEE components of the exam, which call into question the validity of the reported essay score. Finally, the paper investigates the effect of different hyperparameter combinations on GPT-4’s MBE performance, finding no significant effect of adjusting temperature settings, and a significant effect of few-shot chain-of-thought prompting over basic zero-shot prompting. Taken together, these findings carry timely insights for the desirability and feasibility of outsourcing legally relevant tasks to AI models, as well as for the importance for AI developers to implement rigorous and transparent capabilities evaluations to help secure safe and trustworthy AI.
We provide a retrospective of 25 years of the International Conference on AI and Law, which was first held in 1987. Fifty papers have been selected from the thirteen conferences and each of them is ...described in a short subsection individually written by one of the 24 authors. These subsections attempt to place the paper discussed in the context of the development of AI and Law, while often offering some personal reactions and reflections. As a whole, the subsections build into a history of the last quarter century of the field, and provide some insights into where it has come from, where it is now, and where it might go.
This paper combines methods of argumentation theory and artificial intelligence to extend existing work on the dialectical structure of crossexamination. The existing method used conflict diagrams to ...search for inconsistent statements in the testimony of a witness. This paper extends the method by using the inconsistency of commitments to draw an inference by the ad hominem argumentation scheme to the conclusion that the testimony is unreliable because of the bad ethical character for veracity of the witness.
INTRODUCTION: This research investigates the utilization of artificial intelligence and machine learning in comprehending various climatic variations, emphasizing the associated use of legal and ...ethical considerations. This escalating impact of climatic change necessitates innovative approaches and the potential of AI/ML to offer tools for analysis and prediction. OBJECTIVES: The primary objective here, was to assess the effectiveness of AI/ML in the deciphering of varying climatic patterns and projecting the future trends. Concurrently, this study aims for the identification and analysis of legal and ethical challenges that may arise from the integration of these technologies in climatic research and policy. METHODS: Here, the literature review forms the basis for understanding various AI/ML applications related to climate science. This study employs various case analyses to examine the existing models to gauge the accuracy and efficiency of predictions. Legal frameworks and ethical principles need to be scrutinized through the qualitative analysis of relevant policies and guidelines. RESULTS: This extensive research reveals the various significant contributions of AI/ML in the enhancement of climatic modeling precision and the prediction of extreme events. However legal and ethical considerations such as data privacy, accountability, and transparency also emerged as crucial challenges which required careful attention. CONCLUSION: While AI/ML exhibited great potential in the advancement of climate research, a balanced approach is imperative to navigate the associated legal and ethical concerns. Striking this equilibrium will be pivotal for ensuring responsible and effective deployment of these technologies in the pursuit of best understanding and mitigating varying climatic variations.
To what extent, if any, should the law protect sentient artificial intelligence (that is, AI that can feel pleasure or pain)? Here we surveyed United States adults (
= 1,061) on their views regarding ...granting 1) general legal protection, 2) legal personhood, and 3) standing to bring forth a lawsuit, with respect to sentient AI and eight other groups: humans in the jurisdiction, humans outside the jurisdiction, corporations, unions, non-human animals, the environment, humans living in the near future, and humans living in the far future. Roughly one-third of participants endorsed granting personhood and standing to sentient AI (assuming its existence) in at least some cases, the lowest of any group surveyed on, and rated the desired level of protection for sentient AI as lower than all groups other than corporations. We further investigated and observed political differences in responses; liberals were more likely to endorse legal protection and personhood for sentient AI than conservatives. Taken together, these results suggest that laypeople are not by-and-large in favor of granting legal protection to AI, and that the ordinary conception of legal status, similar to codified legal doctrine, is not based on a mere capacity to feel pleasure and pain. At the same time, the observed political differences suggest that previous literature regarding political differences in empathy and moral circle expansion apply to artificially intelligent systems and extend partially, though not entirely, to legal consideration, as well.
Online dispute resolution (ODR) is an alternative to traditional litigation that can both significantly reduce the disadvantages suffered by litigants unable to afford an attorney and greatly improve ...court efficiency and economy. An important aspect of many ODR systems is a facilitator, a neutral party who guides the disputants through the steps of reaching an agreement. However, insufficient availability of facilitators impedes broad adoption of ODR systems. This paper describes a novel model of facilitation that integrates two distinct but complementary knowledge sources: cognitive task analysis of facilitator behavior and corpus analysis of ODR session transcripts. This model is implemented in a decision-support system that (1) monitors cases to detect situations requiring immediate attention and (2) automates selection of standard text messages appropriate to the current state of the negotiations. This facilitation model has the potential to compensate for shortages of facilitators by improving the efficiency of experienced facilitators, assisting novice facilitators, and providing autonomous facilitation.
Este artigo busca responder ao problema de pesquisa: O Projeto Victor pode contribuir para a realização do Princípio da Razoável Duração do Processo na esfera do Supremo Tribunal Federal? Para ...responder ao problema, é necessário abordar a importância da Inteligência Artificial (IA) e das Legaltechsna dinâmica do Poder Judiciário e no desenvolvimento do Direito, demonstrando alguns mecanismos utilizados para a obtenção de melhorias da prestação jurisdicional. Ainda, realiza-se uma exposição acerca das Redes Neurais Artificiais e o seu potencial na identificação de padrões em processos, com enfoque no Projeto Victor. Ademais, pautado em uma metodologia qualitativa, constatou-se não ser possível à quantificação de dados suficientes para análise da pesquisa, em razão da inovação tecnológica do segundo semestre de 2018, o qual passou por uma fase de testes para aferir sua precisão. Contudo, foi possível o entendimento do universo de ações em tramitação no STF e as hipóteses de implicações em tese do uso do sistema na configuração da repercussão geral.
This article seeks to answer the research question: Can the Victor Project contribute to the realization of the Principle of a Reasonable Duration of the Procedure in the sphere of the Federal ...Supreme Court? In order to answer the problem, it is necessary to address the importance of Artificial Intelligence (AI) and Legaltechs in the dynamics of the Judiciary and in the development of Law, demonstrating some mechanisms used to obtain improvements in jurisdictional performance. Also, an exposition about the Artificial Neural Networks is carried out and its potential in the identification of patterns in processes, focusing on the Victor Project. In addition, based on a qualitative methodology, it was found that it was not possible to quantify enough data for the analysis of the research, due to the technological innovation of the second half of 2018, which underwent a test phase to gauge its accuracy. However, it was possible to understand the universe of actions in process in the STF and the hypotheses of implications in thesis of the use of the system in the configuration of the general repercussion.
PDF
