Eight Outcome Models / Evaluation Methodology / Issue Archive / The Evaluation Exchange / Evaluation / HFRPRobert Penna and William Phillips from the Rensselaerville Institute’s Center for Outcomes describe eight models for applying outcome- based thinking. Over the past decade, outcomes has moved from being just a buzzword in the nonprofit, government, and foundation worlds to becoming a full- fledged movement. As the outcomes movement and outcome- based decision making have grown, many models or frameworks for applying this thinking have emerged. ![]() ![]() ![]() Evaluation is a methodological area that is closely related to, but distinguishable from more traditional social research. Evaluation utilizes many of the same methodologies used in traditional social research, but because. Qual Manag Health Care. 2006 Oct-Dec;15(4):279-84. Quality outcomes and program evaluation in nursing education: an overview of the journey. Matthiesen V(1), Wilhelm C. Author information: (1)West Suburban. Program evaluation is a systematic method for collecting, analyzing, and using information to answer questions about projects, policies and programs, particularly about their effectiveness and efficiency. Outcomes-Based Project Evaluation for Soroptimist Clubs. The program begins on the club level, where award amounts vary. Club-level recipients become eligible for additional awards at other levels of the organization. Types of Program Evaluation. SYSTEMATIC PLAN FOR PROGRAM EVALUATION AND ASSESSMENT OF OUTCOMES. Standard VI The program has an identified plan for systematic program evaluation and assessment of educational outcomes. CRITERION 18: Written planning for. Outcomes may easily be achieved through processes independent of the program and an evaluation of those outcomes would suggest program success when in fact. A program logic model would need to be assessed or designed in. Conducting Outcomes Evaluation in Empowerment Programs: A Workshop Susan Hegland & Lesia Oesterreich Department of Human Development & Family Studies Iowa State University Ames, Iowa April 2002. While evaluators and practitioners have benefited greatly from the development of various tools to guide outcomes thinking, understanding the unique advantages of each model and how to select the right one is challenging for many. Responding to this challenge, the Rensselaerville Institute’s Center for Outcomes published in 2. Outcome Frameworks: An Overview for Practitioners, a book that offers insights into which model might be appropriate to the particular needs of a program at a given point in time. It captures what the outcomes movement means, where it came from, the major models now in use, and the movement’s probable future. The models described in Outcome Frameworks fall into three main categories: program planning and management, program and resource alignment, and program reporting. In addition, most models can be used as an evaluation tool. Program Planning/Management Tools. Program planning or management tools are outcome models that assist in an effort’s proposal, funding, and implementation phases. They illustrate the logic, theory of change, and anticipated flow of an intervention, providing markers against which both incremental and ultimate progress may be measured. Logic models, the most widely used of these models, provide a graphic overview of a program, outlining the outcomes to be accomplished along with how they are to be achieved and for what groups. A logic model generally includes the target group, the resources to be used, activities, and objectives. Best used for describing a program in the broadest strokes, it can be an extremely useful tool, particularly at the earliest stages of a project. Model 2: Outcome Funding Framework. This model stresses key shifts in the thinking that traditionally has influenced human service programs. It encourages funders to think like investors. The model also uses milestones, or sequential steps toward achieving ultimate targets, to allow for ongoing assessment and mid- course program corrections. Model 3: Results- Based Accountability (RBA). This model starts with the desired ends and works backward toward the means to achieve them. RBA first describes what a desired result would look like, then defines that result in measurable terms, and, finally, uses those measures to gauge success or failure. How will we recognize it? What will it take to get there? This model distinguishes between population accountability and program accountability. ![]() Its inclusion of the crosswalk, a tool for matching RBA with other outcome models, is a unique and useful aspect of the framework. Model 4: Targeting Outcomes of Programs (TOP). This model is based on a hierarchy of sequential steps in planning, implementing, and evaluating programs. How should it be conducted? What are the benefits delivered? Program and Resource Alignment Tools. Program and resource alignment tools ensure that resources and effort are expended in support of organizational goals; one such is the Balanced Scorecard, explained below: Model 5: Balanced Scorecard. Initially designed as a corporate management framework, the balanced scorecard synthesizes multiple measures, reflecting a range of processes, and links them to a consistent and mutually reinforcing whole. The model’s use of a resource or target matrix makes it particularly well suited to organizational alignment. Program Reporting Tools. Program reporting tools allow organizations to capture and communicate the fullness of the results they have achieved. They include the following: Model 6: Scales and Ladders. This model offers a matrix- based system popularly associated with the implementation of the Results Oriented Management and Accountability system within community- service- block grant- funded programs. The model’s essential concept centers on a series of anchored scales and their placement within a matrix that describes different states or conditions of client status along a continuum. Model 7: Results Mapping. Results mapping is an outcome- based evaluation tool that systematically captures anecdotal evidence and uses the information to present a results- based conclusion. Model 8: Program Results Story. Currently under development, this approach applies the power of the story format to capture organizations’ achievements and present them in a results- based format. Overview of Eight Outcome Models. Model. Description. Key Concepts. Strong Points. Well Suited For. 1. Logic Model Diagrammatic representation of a program, showing what it is supposed to do, with whom, and why. Inputs, outputs, outcomes; arrows show relationships between elements in the model Easy to use; provides easily understood representation of program’s theory of change. Program overview; presentations; program and evaluation planning. Outcome Funding Framework Key management focus on the achievement of specific, sequential results for customers of services; emphasis on results, not activity Investor return, results, customers, milestones, performance targets, outcome statement Highly disciplined approach that serves both program investors and implementers; Web- based software has strengthened usability Government and philanthropic grantmaking; program and organization management. Results- Based Account- ability. Real- time approach that describes what desired results look like, defines results in measurable terms, and uses measures to drive action plans for improvement Results, experience, indicators, baselines, strategy, action plan and budget, accountability. Thorough system for planning community- change efforts and improvements in program, agency, or system performance; uses lay language and provides direct link to budgeting; useful for integrating different outcome systems. Project planning and start- up; development of community report cards; program/agency improvement plans and budgets; grantmaking and evaluation design 4. Targeting Outcomes of Programs Tracking progress toward achievement targets; evaluating degree to which programs impact targeted conditions Knowledge, attitude, skills, and aspiration; process, outcome, and impact evaluation Fairly easy to use; helps integrate program development and evaluation; implementers and managers can use same concepts. Program design and evaluation. Balanced Scorecard. Business- based model designed to provide integrated management and accounting for multiple variables impacting organization performance by connecting them to a set of performance indicators. Strategy, alignment, short- and long- term objectives; financial and nonfinancial measures; lagging and leading indicators; performance measures and drivers; internal and external indices of success. Allows for a graphic assessment of the degree to which an organization’s resources and efforts support its goals. Monitoring either a single program with several associated initiatives or multiple programs within an organization; analyzing alignment of resources and initiatives to strategic targets. Scales and Ladders. Graphic tool that centers around a series of scales and their placement within a matrix designed to illustrate progress along a continuum of stages Scales; mutually exclusive, multiple, and floating indicators. Places a client, community, or program on a continuum; shows incremental and relative progress, stabilization, or decline; individual data together tell a complete story; behaviorally anchored description of levels of change Demonstration of aggregate progress; measuring concepts that are not easily quantified. Results Mapping. Outcome- based evaluation tool designed to systematically capture otherwise nonquantifiable anecdotal evidence. Causal and synchronistic attribution; levels and milestones. Way to systemize, standardize, gather, and utilize lessons embedded in anecdotal information Turning anecdotal information into a useful tool for program presentation, evaluation, and assessment. Program Results Story. Uses stories to capture organizations’ achievements and present them in a results- based format Results, stories, anecdotal evidence. Easily understood approach for presenting results; brings outcomes to human interest level; captures and conveys richness of information Presenting program and results to multiple audiences. The Rensselaerville Institute is a national nonprofit specializing in outcome- tool creation and assisting government, foundations, and nonprofits to put them into practice. The program logic model: What, why and how? Retrieved June 8, 2. Mac. Namara, C. Guidelines and framework for designing basic logic model. Y., & Phillips, W. Outcome funding: A new approach to targeted grantmaking. Rensselaerville, NY: The Rensselaerville Institute. Friedman, M. The results accountability implementation guide. Retrieved June 8, 2. Bennett, C., & Rockwell, K. Targeting outcomes of programs (TOP): An integrated approach to planning and evaluation. Washington, DC: Cooperative State Research, Education, and Extension Service. Learn more about it at citnews. TOP. 7 Kaplan, R. The balanced scorecard: Translating strategy into action. Boston: Harvard Business School Press. Learn more about it at www. Pacific Institute for Research and Evaluation. Contact the authors for more information on this approach. Robert M. Penna, Ph. D. Senior Consultant. Tel: 5. 18- 4. 38- 7. Email: rmpc. 52@aol.
0 Comments
Leave a Reply. |
AuthorWrite something about yourself. No need to be fancy, just an overview. Archives
September 2016
Categories |