Psychometrics and diagnostics of Italian cognitive screening tests: a systematic review

Abstract

Background: Cognitive screening tests (CSTs) are crucial to neuropsychological diagnostics, and thus need to be featured by robust psychometric and diagnostic properties. However, CSTs happen not to meet desirable statistical standards, negatively affecting their level of recommendations and applicability. This study aimed at (a) providing an up-to-date compendium of available CSTs in Italy, (b) report their psychometric and diagnostic properties, and (c) address related limitations. Methods: This review was implemented by consulting Preferred Reporting Items for Systematic Reviews and Meta-Analyses and pre-registered on the International Prospective Register of Systematic Reviews. Standardization and usability studies focusing on norms, validity, reliability, or sensitivity/specificity (and derived metrics) in adults were considered for eligibility. Quality assessment was performed by means of an ad hoc checklist collecting information on sampling, psychometrics/diagnostics, norming, and feasibility. Results: Sixty studies were included out of an initial N = 683. Identified CSTs (N = 40) were classified into general, domain-, and disease-specific (N = 17, 7, and 16, respectively), the latter being less statistically robust than remaining categories. Validity and reliability evidence was provided for 29 and 26 CSTs, respectively, sensitivity/specificity for 20 and norms for 33. Prevalence- and post-test-based diagnostic metrics were seldomly represented; factorial structures, ceiling/floor effects, and acceptability rarely investigated; content, face, and ecological validity never assessed. Discussion: Although available Italian CSTs overall met basic psychometric/diagnostic requirements, their statistical profile often proved to be poor on several properties that are desirable for clinical applications, with a few exceptions among general and domain-specific ones.