Program evaluation competencies for prospective school counseling practitioners

There is a well-articulated rationale in the literature for the routine implementation of program evaluation by school counselors and thus, a desire within the profession to develop program evaluation competencies among pre-service school counselors. In this article, existing school counselor program evaluation competencies mentioned in the literature were critically overviewed. For this purpose, the school counseling publications between 2000 and 2017 were reviewed to identify on school counselor competencies in program evaluation. These articles are summarized and analyzed based on Stevahn, King, Ghere & Minnema’s competency taxonomy to better understand the current situation. The literature revealed that to date, school counseling literature has focused primarily on technical competencies in program evaluation. In addition to that, some other important program evaluation skills such as interpersonal relationships and professional/ethical issues in program evaluation have not been explored in the literature.

Okul psikolojik danışmanı adaylarının program değerlendirme yeterlilikleri

Program değerlendirme, bir okul psikolojik danışmanının sahip olması gereken mesleki yeterliliklerden biri olarak geçmektedir ve önemi artan şekilde vurgulanmaktadır. Bu makalede, program değerlendirme konusunda, psikolojik danışma alanyazınında işaret edilen yeterlilikler eleştirel bir bakış açısıyla gözden geçirilmiştir. Bu amaçla, 2000-2017 yılları arasında, alanyazına giren konu hakkındaki makaleler taranmıştır. Bu makalelerde önerilen okul psikolojik danışmanı program değerlendirme yeterlilikleri, Stevahn, King, Ghere & Minnema’nın yeterlilik taksonomisi temel alınarak özetlenmiş ve analiz edilmiştir. Bu derleme çalışmasının bulgularına göre, okul psikolojik danışma alanyazınında, program değerlendirme yeterlilikleri konusunda sayıca çok sınırlı çalışma vardır ve bu çalışmalarda ise sadece teknik yeterliliklere değinilmiştir. Bunun yanı sıra, kişilerarası ilişkiler ve program değerlendirmede etik/profesyonel konular gibi bazı önemli program değerlendirme yeterliliklerinin üzerinde hiç durulmamıştır.

PDF

___

American School Counselor Association (ASCA). (2012). The ASCA national model: A framework for school counseling programs (3rd ed.). Alexandria, VA: Author.

Astramovich, R. L. (2017). Program evaluation interest and skills of school counselors. Professional School Counseling, 20(1), 54-64.

Astramovich, R. L., & Coker, J. K. (2007). Program evaluation: The accountability bridge model for counselors. Journal of Counseling & Development, 85(2), 162–172.

Astramovich, R. L., Coker, J. K., & Hoskins, W. J. (2005). Training school counselors in program evaluation. Professional School Counseling, 9(1), 49–54.

Cooper, S. (2014). Transformative evaluation: Organizational learning through participative practice. The Learning Organization, 21(2), 146-157.

Council for Accreditation of Counseling and Related Educational Programs (CACREP). (2016). 2016 CACREP standards. Retrieved from http://www.cacrep.org/wp-content/uploads/2016/06/2016-Standards-withGlossary-rev-2.2016.pdf

Davidson, E. J. (2015). Question-driven methods or method-driven questions? How we limit what we learn by limiting what we ask. Journal of MultiDisciplinary Evaluation, 11(24), i-x.

Dewey, J. D., Montrosse, B. E., Schröter, D. C., Sullins, C. D., & Mattox, J. R. (2008). Evaluator competencies: What's taught versus what's sought? American Journal of Evaluation, 29(3), 268-287.

Dimmitt, C., Carey, J., & Hatch, T. (2007). Evidence-based school counseling: Making a difference with datadriven practices. Thousand Oaks, CA: Corwin Press.

Galport, N., & Azzam, T. (2016). Evaluator training needs and competencies: A gap analysis. American Journal of Evaluation, 38(1), 80-100.

Ghere, G., King, J., Stevahn, L., & Minnema, J. (2006). A professional development unit for reflecting on program evaluation competencies. American Journal of Evaluation, 27(1), 108-123.

King, J. A., & Stevahn, L. (2015). Competencies for program evaluators in light of adaptive action: What? So what? Now what? In J.W. Altschuld & M. Engle (Eds.), Accreditation, certification, and credentialing: Relevant concerns for U.S. evaluators: New Directions for Evaluation (pp. 21-37). Hoboken, NJ: John Wiley & Sons Publishing.

King, J. A., Stevahn, L., Ghere, G., & Minnema, J. (2001). Toward a taxonomy of essential evaluator competencies. American Journal of Evaluation, 22(2), 229-247.

Kirkhart, K. (1981). Defining evaluator competencies: New light on an old issue. American Journal of Evaluation, 2(2), 188-192.

Leviton, L. C. (2001). Presidential address: Building evaluation’s collective capacity. American Journal of Evaluation, 22(1), 1-12.

Lusky, M. B., & Hayes, R. L. (2001). Collaborative consultation and program evaluation. Journal of Counseling & Development, 79(1), 26–38.

Maras, M. A., Coleman, S. L., Gysbers, N. C., Herman, K. C., & Stanley, B. (2013). Measuring evaluation competency among school counselors. Counseling Outcome Research and Evaluation, 4(2), 99-111.

Mertens, D. M. (1994). Training evaluators: Unique skills and knowledge. New Directions for Program Evaluation, (62), 17-27.

Morris, M. (1994). The role of single evaluation courses in evaluation training. New Directions for Program Evaluation, (62), 51–60.

Morris, M., & Clark, B. (2013). You want me to do WHAT? Evaluators and the pressure to misrepresent findings. American Journal of Evaluation, 34(1), 57-70.

Patton, M. Q. (2008). Utilization focused evaluation: The new century text (4th Ed.). London: Sage Publications.

Patton, M. Q. (2010). Future trends in evaluation. In M. Segone (Ed.), From policies to results. Developing capacities for country monitoring and evaluation systems (pp. 44–57). New York, NY: UNICEF.

Patton, Q. M. (1997). Utilization focused evaluation: The new century text (3rd Ed.). London: Sage Publications.

Perrin, B. (2005). How can information about the competencies required for evaluation be useful. The Canadian Journal of Program Evaluation, 20(2), 169-188.

Rossman, G. B., & Rallis, S. F. (2000). Critical inquiry and use as action. New Directions for Evaluation, 88, 55-69.

Sink, C. A. (2009). School counselors as accountability leaders: Another call for action. Professional School Counseling, 13, 68-74.

Sink, C. A., & Lemich, G. (2018). Program evaluation in doctoral-level counselor education preparation: Concerns and recommendations. American Journal of Evaluation, 39(4), 496–510.

Stevahn, L., King, J. A., Ghere, G., & Minnema, J. (2005). Establishing essential competencies for program evaluators. American Journal of Evaluation, 26(1), 43–59.

Stuffllebeam, D. L. (1983). The CIPP model for program evaluation. In G. F. Madaus, M. Scriven, & D. L.

Stuffllebeam (Eds.), Evaluation models: Viewpoints on educational and human services evaluation (pp. 117- 141 ). Norwell, MA: Kluwer .

Topdemir, C. M. (2010). School counselor accountability practices: A national study. Unpublished Doctoral dissertation, University of South Florida, USA.

Trevisan, M. S. (2002). Evaluation capacity in K-12 school counseling programs. American Journal of Evaluation, 23(3), 291-305.

Trevisan, M.S. (2000). The status of program evaluation expectations in state school counselor certification requirements. American Journal of Evaluation, 21(1), 81-94.

Weiss, C. H. (1998). Evaluation: Methods for studying programs and policies. London, Prentice Hall.

Wilcox, Y., & King, J. A. (2013). A professional grounding and history of the development and formal use of evaluator competencies. The Canadian Journal of Program Evaluation, 28(3), 1.

Young, A., & Kaffenberger, C. (2011). The beliefs and practices of school counselors who use data to implement comprehensive school counseling programs. Professional School Counseling, 15(2), 67-76.