Predicting judicial decisions of the European Court of Human Rights: a Natural Language Processing perspective
By Nikolaos Aletras, Dimitrios Tsarapatsanis, Daniel Preotiuc-Pietro, Vasileios Lampos. PeerJ Computer Science, 2016
723 citations recorded by the source corpus.
Recent advances in Natural Language Processing and Machine Learning provide us with the tools to build predictive models that can be used to unveil patterns driving judicial decisions. This can be useful, for both lawyers and judges, as an assisting tool to rapidly identify cases and extract patterns which lead to certain decisions. This paper presents the first systematic study on predicting the outcome of cases tried by the European Court of Human Rights based solely on textual content. We formulate a binary classification task where the input of our classifiers is the textual content extracted from a case and the target output is the actual judgment as to whether there has been a violation of an article of the convention of human rights. Textual information is represented using contiguous word sequences, i.e., N-grams, and topics. Our models can predict the court’s decisions with a strong accuracy (79% on average). Our empirical analysis indicates that the formal facts of a case are the most important predictive factor. This is consistent with the theory of legal realism suggesting that judicial decision-making is significantly affected by the stimulus of the facts. We also observe that the topical content of a case is another important feature in this classification task and explore this relationship further by conducting a qualitative analysis.
Subfields: Economics and Econometrics, Law, Political Science and International Relations
View Paper: https://www.semanticscholar.org/paper/a929a3d92e305f4ef22ad9e52d264e7782394bd4
How researchers see this paper
The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.
In Economics and Econometrics
In Law
- Maosong Sun
- Cunchao Tu
- Zhiyuan Liu
- Chaojun Xiao
- Ilias Chalkidis
- Ion Androutsopoulos
- Manos Fergadiotis
- Prodromos Malakasiotis
In Political Science and International Relations
- Maosong Sun
- Cunchao Tu
- Zhiyuan Liu
- Chaojun Xiao
- Ilias Chalkidis
- Ion Androutsopoulos
- Haoxiang Zhong
- Tianyang Zhang
Citations in the corpus
- CAIL2018: A Large-Scale Legal Dataset for Judgment Prediction (2018, methodology): “With the development of machine learning algorithms, some works take LJP as a text classification task and propose to extract efficient features from fact descriptons (Liu and Chen, 2017; Sulea et al., 2017; Aletras et al., 2016; Lin et al., 2012; Liu and Hsieh, 2006).”
- Learning to Predict Charges for Criminal Cases with Legal Basis (2017, methodology): “The target can be which party will the outcome side with (Aletras et al., 2016), or whether the present court will affirm or reverse the decision of a lower court (Katz et al., 2016).”
- Paragraph-level Rationale Extraction through Regularization: A case study on European Court of Human Rights Cases (2021, methodology): “3 The New ECtHR Dataset The court ( EC t HR ) hears allegations regarding breaches in human rights provisions of the European Convention of Human Rights ( ECHR ) by European states (Fig.”
- Legal requirements on explainability in machine learning (2020, background): “In the context of the European Court of Human Rights, Aletras et al. (2016) consider the three elements of interest (description of the situation, the applicable laws and the arguments of the parties) as a text in order to predict if a given article of the European Convention of Human Rights has…”
- A general approach for predicting the behavior of the Supreme Court of the United States (2016, background): “ decisions, our work contributes to a growing number of articles which either highlight or apply the tools of machine learning to some class of prediction problems in law or legal studies (e.g., [5], [33], [34], [35], [36], [37], [38], [39], [40]). We encourage additional applied machine learning re”
- Neural Legal Judgment Prediction in English (2019, methodology): “Here, we focus on legal judgment prediction , where given a text describing the facts of a legal case, the goal is to predict the court’s outcome (Aletras et al., 2016; S¸ulea et al., 2017; Luo et al., 2017; Zhong et al., 2018; Hu et al., 2018).”
- How Does NLP Benefit Legal System: A Summary of Legal Artificial Intelligence (2020, methodology): “Based on these datasets, researchers began exploring NLP-based solutions to a variety of LegalAI tasks, such as Legal Judgment Prediction (Aletras et al., 2016; Luo et al., 2017; Zhong et al., 2018; Chen et al., 2019), Court View Generation (Ye et al., 2018), Legal Entity Recognition and…”
- LexGLUE: A Benchmark Dataset for Legal Language Understanding in English (2021, background): “…of legal tasks (Chalkidis and Kampas, 2018; Aletras et al., 2019, 2020; Zhong et al., 2020b; Bommarito et al., 2021), from judgment prediction (Aletras et al., 2016; Sim et al., 2016; Katz et al., 2017; Zhong et al., 2018; Chalkidis et al., 2019a; Malik et al., 2021), information extraction…”