Assessing Evaluation Performance and Use: Test-Retest Reliability of Standardized Instruments

Karen E. Kirkhart; Robert O. Morgan; Joan Sincavage

doi:10.1177/0193841X9101500406

Assessing Evaluation Performance and Use: Test-Retest Reliability of Standardized Instruments

Karen E. Kirkhart, Robert O. Morgan, Joan Sincavage

School of Social Work

Research output: Contribution to journal › Article › peer-review

2 Scopus citations

Abstract

Two studies were conducted to determine the stability of self-assessment of evaluation performance and use over a six-week period. Two instruments, the Evaluation Performance Questionnaire (EPQ) and the Evaluation Utilization Questionnaire (EUQ) were developed to assess internal evaluation of community mental health centers (CMHCs). One hundred one evaluators of CMHCs were surveyed in Study 1, and 175 directors and evaluators were surveyed in Study 2; response rates were 54% and 60%, respectively. Test-retest reliability coefftcients were calculated for total and subscale scores, and scale means were compared across time. Results show that the EPQ and EUQ provide reliable information about the level and scope of evaluation activity and the use of evaluation information within community mental health centers. The value of these tools for research, administration, evaluation, and practice is discussed.

Original language	English (US)
Pages (from-to)	482-502
Number of pages	21
Journal	Evaluation Review
Volume	15
Issue number	4
DOIs	https://doi.org/10.1177/0193841X9101500406
State	Published - Aug 1991

ASJC Scopus subject areas

Arts and Humanities (miscellaneous)
Social Sciences(all)

Access to Document

10.1177/0193841X9101500406

Fingerprint Dive into the research topics of 'Assessing Evaluation Performance and Use: Test-Retest Reliability of Standardized Instruments'. Together they form a unique fingerprint.

Cite this

@article{436543a82b8440a683c05023c1ab2cfd,

title = "Assessing Evaluation Performance and Use: Test-Retest Reliability of Standardized Instruments",

abstract = "Two studies were conducted to determine the stability of self-assessment of evaluation performance and use over a six-week period. Two instruments, the Evaluation Performance Questionnaire (EPQ) and the Evaluation Utilization Questionnaire (EUQ) were developed to assess internal evaluation of community mental health centers (CMHCs). One hundred one evaluators of CMHCs were surveyed in Study 1, and 175 directors and evaluators were surveyed in Study 2; response rates were 54% and 60%, respectively. Test-retest reliability coefftcients were calculated for total and subscale scores, and scale means were compared across time. Results show that the EPQ and EUQ provide reliable information about the level and scope of evaluation activity and the use of evaluation information within community mental health centers. The value of these tools for research, administration, evaluation, and practice is discussed.",

author = "Kirkhart, {Karen E.} and Morgan, {Robert O.} and Joan Sincavage",

note = "Funding Information: 2. The larger study, {"}Improving the Capability of CMHCs for Self-Evaluation,{"} was supported by the National Institute of Mental Health through a grant to the Human Interaction Research Institute (Grant No. R01 MH 33540; Drs. Edward M. Glaser and Karen E. Kirkhart, coprincipal investigators). Copyright: Copyright 2016 Elsevier B.V., All rights reserved.",

year = "1991",

month = aug,

doi = "10.1177/0193841X9101500406",

language = "English (US)",

volume = "15",

pages = "482--502",

journal = "Evaluation Review",

issn = "0193-841X",

publisher = "SAGE Publications Inc.",

number = "4",

}

TY - JOUR

T1 - Assessing Evaluation Performance and Use

T2 - Test-Retest Reliability of Standardized Instruments

AU - Kirkhart, Karen E.

AU - Morgan, Robert O.

AU - Sincavage, Joan

N1 - Funding Information: 2. The larger study, "Improving the Capability of CMHCs for Self-Evaluation," was supported by the National Institute of Mental Health through a grant to the Human Interaction Research Institute (Grant No. R01 MH 33540; Drs. Edward M. Glaser and Karen E. Kirkhart, coprincipal investigators). Copyright: Copyright 2016 Elsevier B.V., All rights reserved.

PY - 1991/8

Y1 - 1991/8

N2 - Two studies were conducted to determine the stability of self-assessment of evaluation performance and use over a six-week period. Two instruments, the Evaluation Performance Questionnaire (EPQ) and the Evaluation Utilization Questionnaire (EUQ) were developed to assess internal evaluation of community mental health centers (CMHCs). One hundred one evaluators of CMHCs were surveyed in Study 1, and 175 directors and evaluators were surveyed in Study 2; response rates were 54% and 60%, respectively. Test-retest reliability coefftcients were calculated for total and subscale scores, and scale means were compared across time. Results show that the EPQ and EUQ provide reliable information about the level and scope of evaluation activity and the use of evaluation information within community mental health centers. The value of these tools for research, administration, evaluation, and practice is discussed.

AB - Two studies were conducted to determine the stability of self-assessment of evaluation performance and use over a six-week period. Two instruments, the Evaluation Performance Questionnaire (EPQ) and the Evaluation Utilization Questionnaire (EUQ) were developed to assess internal evaluation of community mental health centers (CMHCs). One hundred one evaluators of CMHCs were surveyed in Study 1, and 175 directors and evaluators were surveyed in Study 2; response rates were 54% and 60%, respectively. Test-retest reliability coefftcients were calculated for total and subscale scores, and scale means were compared across time. Results show that the EPQ and EUQ provide reliable information about the level and scope of evaluation activity and the use of evaluation information within community mental health centers. The value of these tools for research, administration, evaluation, and practice is discussed.

UR - http://www.scopus.com/inward/record.url?scp=84973751586&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84973751586&partnerID=8YFLogxK

U2 - 10.1177/0193841X9101500406

DO - 10.1177/0193841X9101500406

M3 - Article

AN - SCOPUS:84973751586

VL - 15

SP - 482

EP - 502

JO - Evaluation Review

JF - Evaluation Review

SN - 0193-841X

IS - 4

ER -

Assessing Evaluation Performance and Use: Test-Retest Reliability of Standardized Instruments

Abstract

ASJC Scopus subject areas

Access to Document

Other files and links

Cite this