An evaluation of score-based likelihood ratios for glass data

Thumbnail Image
Date
2021-01-01
Authors
Veneri, Federico
Ommen, Danica
Major Professor
Danica Ommen
Advisor
Committee Member
Journal Title
Journal ISSN
Volume Title
Publisher
Authors
Research Projects
Organizational Units
Organizational Unit
Statistics
As leaders in statistical research, collaboration, and education, the Department of Statistics at Iowa State University offers students an education like no other. We are committed to our mission of developing and applying statistical methods, and proud of our award-winning students and faculty.
Journal Issue
Is Version Of
Versions
Series
Department
Statistics
Abstract

The likelihood ratio (LR) provides a numerical statement of the evidential strength in a forensic setting, but requires knowing a complex probability model, particularly for pattern and impression evidence. A proposed alternative relies on using similarity scores to develop score-based likelihood ratios (SLR). Different methods to compute evidential strength have been proposed and evaluated under different metrics. This project considers the model-based LR and SLR already present in the literature and focuses on a less-discussed aspect, dependence on the data used to estimate LRs and SLRs. We discovered that there is no clear winner that outperforms all other methods through our simulation studies. On average, distance-based methods of computing scores resulted in less discriminating power and a higher rate of misleading evidence for KNM. Machine learning methods of computing scores produce highly discriminating evidential values, but requires an additional sample to train. Our results also show that non-parametric estimation of score distributions can lead to non-monotonic behavior of the SLR and even counter-intuitive results. We also present evidence that the methods we studied are susceptible to performance issues when the split into training, testing and validation is modified, and resulting SLRs could even lead examiners to make different conclusions.

Comments
Description
Keywords
Citation
DOI
Source
Subject Categories
Copyright
Fri Jan 01 00:00:00 UTC 2021