Industrial and Manufacturing Systems Engineering, Statistics
Journal or Book Title
IEEE Transactions on Instrumentation and Measurement
Most standard statistical methods treat numerical data as if they were real (infinite-number-of-decimal-places) observations. The issue of quantization or digital resolution can render such methods inappropriate and misleading. This article discusses some of the difficulties of interpretation and corresponding difficulties of inference arising in even very simple measurement contexts, once the presence of quantization is admitted. It then argues (using the simple case of confidence interval estimation based on a quantized random sample from a normal distribution as a vehicle) for the use of statistical methods based on "rounded data likelihood functions" as an effective way of handling the matter.
© 2005 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works.
Vardeman, Stephen B. and Lee, Chiang-Sheng, "Likelihood-based statistical estimation from quantized data" (2005). Industrial and Manufacturing Systems Engineering Publications. 142.