#dataevaluation
JMIR Formative Res: The Spectrum & Clinical Tools for Reliable Assessment (SPECTRA) Evidence Stack for Adult Neurodivergence Assessment: Framework Development and Synthetic Data Evaluation #Neurodivergence #PsychologicalAssessment #MentalHealth #ClinicalTools #DataEvaluation
The Spectrum & Clinical Tools for Reliable Assessment (SPECTRA) Evidence Stack for Adult Neurodivergence Assessment: Framework Development and Synthetic Data Evaluation
Background: Psychological assessment of adult neurodivergence relies on multi-informant data that frequently disagree; discrepancies may reflect masking, context-dependent expression, or limited self-insight rather than measurement error. Objective: This paper specifies the SPECTRA (Spectrum & Clinical Tools for Reliable Assessment) Evidence Stack, a rule-based, neuroaffirmative architecture that preserves cross-informant discrepancies as interpretable evidence rather than collapsing them into opaque scores, producing quality flags, convergence profiles, evidence-strength bands, and reason codes. Methods: This is a design specification, not a validation study: no clinical participants were involved. Framework behavior was evaluated on 250 author-generated synthetic records through a 4-condition, prespecified rule-configuration comparison and a threshold-perturbation sensitivity analysis. Stochastic generation and score jitter were controlled by a recorded random seed. Results: With the disclosed code, version, and seed, the reference run was reproducible: mean evidence strength was 0.60 for the full-stack configuration, 0.53 for the no-quality comparator, 0.54 for the no-convergence comparator, and 0.50 for the baseline comparator, with the ordering A > C > B > D preserved in all 12 threshold-perturbation scenarios. These descriptive differences verify the behavior of the 4 specified configurations; they are not causal estimates of the isolated effects of individual layers. An extended sensitivity analysis covering all 22 reference-configuration parameters (one-at-a-time ±10%, a 1000-sample Latin hypercube joint perturbation of ±20%, and tipping-point sweeps of the band cutoffs) showed that the ordering was preserved in 38 of 44 single-parameter scenarios but not under joint perturbation (278/1000, 27.8% of samples); the caution cap and the high-band cutoff were the dominant drivers of band assignment. The reference configuration is fully disclosed and independently runnable. Conclusions: Within the disclosed reference configuration, the SPECTRA Evidence Stack produced reproducible, conditionally assigned evidence-strength outputs that preserved cross-informant discrepancy as interpretable evidence and made uncertainty visible through bands, flags, and reason codes; the ordering of the 4 rule configurations was preserved in most single-parameter scenarios but not under joint perturbation, and the parameters most influential for band assignment (the caution cap and the high-band cutoff) were identified for priority calibration. Diagnostic accuracy, criterion validity, reliability, and clinical utility are not evaluated here and are reserved for a subsequent clinical validation study, for which a prespecified calibration protocol is now provided.
dlvr.it
November 12, 2026 at 10:33 PM
Implementing Data Evaluation: A Resource Toolkit For Institutions (New From Make #Data Count) makedatacount.org/read-our-blo...
#dataevaluation #toolkits
@makedatacount.bsky.social
Implementing data evaluation: A resource toolkit for institutions - Make Data Count
DOI: 10.60804/5x77-bq53
makedatacount.org
October 27, 2025 at 5:28 PM
New on the blog! In an interview with Veronique Kiermer @verokiermer.bsky.social, Chief Scientific Officer for @plos.org, she provides insight into their approach to data sharing, visibility and evaluation.

👉 Read the post: makedatacount.org/read-our-blo...

#dataevaluation #datasharing
December 2, 2025 at 4:03 PM
UNC Chapel Hill's collaboration with Buncombe County reveals promising preliminary data showing that START significantly reduces recidivism and out-of-home placements.

Learn more here!

#BuncombeCounty #NC #RecidivismReduction #CitizenPortal #CommunitySupport #DataEvaluation
UNC Chapel Hill joining Buncombe County to evaluate START; preliminary results show reduced recidivism, staff said
County staff told the board UNC Chapel Hill has been contracted to support START data collection and that preliminary comparison data indicate START involvement substantially reduced recidivism and out-of-home placement compared with non-START cases.
citizenportal.ai
July 27, 2026 at 7:06 PM
Vermont lawmakers are diving deep into the critical impact of youth suspensions on substance abuse, seeking the data that could reshape support for struggling young people.

Click to read more!

#VT #YouthIntervention #VermontYouth #DataEvaluation #SubstanceAbuse #CitizenPortal
Panel evaluates effectiveness of youth substance abuse program and suspension lengths
Participants discuss assessing program efficacy and suspension implementation by the DMV.
citizenportal.ai
February 28, 2025 at 11:28 PM
Towards Understanding Bias in Synthetic Data for Evaluation
Bhaskar Mitra, Emine Yilmaz et al.
Paper
Details
#BiasInSyntheticData #DataEvaluation #AITransparency
June 23, 2025 at 9:02 AM