Assessing Evaluation Performance and Use: Test-Retest Reliability of Standardized Instruments

Two studies were conducted to determine the stability of self-assessment of evaluation performance and use over a six-week period. Two instruments, the Evaluation Performance Questionnaire (EPQ) and the Evaluation Utilization Questionnaire (EUQ) were developed to assess internal evaluation of community mental health centers (CMHCs). One hundred one evaluators of CMHCs were surveyed in Study 1, and 175 directors and evaluators were surveyed in Study 2; response rates were 54% and 60%, respectively. Test-retest reliability coefftcients were calculated for total and subscale scores, and scale means were compared across time. Results show that the EPQ and EUQ provide reliable information about the level and scope of evaluation activity and the use of evaluation information within community mental health centers. The value of these tools for research, administration, evaluation, and practice is discussed.