Evaluation Chapter 13 Identifying and Selecting the Evaluation Questions and Criteria Identifying Useful Sources for Evaluation Questions: The Divergent Phase Identifying Questions, Concerns, and Information Needs of Stakeholders Using Evaluation Approaches as Heuristics Using Research and Evaluation Work in the Program Field Using Professional Standards, Checklists, Guidelines, and Criteria Developed or Used Elsewhere Asking Expert Consultants to Specify Questions or Criteria Using the Evaluator's Professional Judgment Summarizing Suggestions from Multiple Sources Selecting The Questions, Criteria, And Issues To Be Addressed: The Convergent Phase Who Should Be Involved in the Convergent Phase? How Should the Convergent Phase Be Carried Out? Specifying the Evaluation Criteria and Standards Absolute Standards Relative Standards Remaining Flexible during the Evaluation: Allowing New Questions, Criteria, and Standards to Emerge Chapter 14 Planning How to Conduct the Evaluation Developing the Evaluation Plan Selecting Designs for the Evaluation Identifying Appropriate Sources of Information Identifying Appropriate Methods for Collecting Information Determining Appropriate Conditions for Collecting Information: Sampling and Procedures Determining Appropriate Methods and Techniques for Organizing, Analyzing, and Interpreting Information Determining Appropriate Ways to Report Evaluation Findings Work Sheets to Summarize an Evaluation Plan Specifying How the Evaluation Will Be Conducted: The Management Plan Estimating and Managing Time for Conducting Evaluation Tasks Analyzing Personnel Needs and Assignments Estimating Costs of Evaluation Activities and Developing Evaluation Budgets Establishing Evaluation Agreements and Contracts Planning and Conducting the Metaevaluation The Development of Metaevaluation and Its Use Today Some General Guidelines for Conducting Metaevaluations A Need for More Metaevaluation PART IV Practical Guidelines for Conducting and Using Evaluations Chapter 15 Collecting Evaluative Information: Design, Sampling, and Cost Choices Using Mixed Methods Evaluation Controversies over Methodology A Definition and Discussion of Mixed Methods Designs for Collecting Descriptive and Causal Information Descriptive Designs Case Studies Cross-Sectional Designs Time-Series Designs Causal Designs Experimental Designs Quasi-Experimental Designs Mixed Method Designs Sampling Sample Size Selecting a Random Sample Using Purposive Sampling Cost Analysis Cost Benefit Analysis Cost-Effectiveness Studies Chapter 16 Collecting Evaluative Information: Data Sources and Methods, Analysis and Interpretation Common Sources and Methods for Collecting Information Existing Documents and Records Identifying Sources and Methods for Original Data Collection: A Process Observations Surveys Interviews Focus Groups Tests and Other Methods for Assessing Knowledge and Skill Planning and Organizing the Collection of Information Technical Problems in Data Collection Analysis of Data and Interpretation of Findings Data Analysis Interpreting Data Chapter 17 Reporting Evaluation Results: Maximizing Use and Understanding Purposes of Evaluation Reporting and Reports Different Ways of Reporting Important Factors in Planning Evaluation Reporting Accuracy, Balance, and Fairness Tailoring Reports to Their Audience(s) Timing of Evaluation Reports Strategies to Communicate and Persuade Appearance of the Report Human and Humane Considerations in Reporting Evaluation Findings Delivering Negative Messages Key Components of a Written Report Executive Summary Introduction to the Report Focus of the Evaluation Brief Overview of the Evaluation Plan and Procedures Presentation of Evaluation Results Conclusions and Recommendations Minority Reports or Rejoinders Appendices Suggestions for Effective Oral Reporting A Checklist for Good Evaluation Reports How Evaluation Information Is Used Models of Use Steps To Take To Influence Evaluation Use Reporting and Influence Chapter 18 The Future Of Evaluation The Future of Evaluation Predictions Concerning the Profession of Evaluation A Vision for Evaluation Conclusion Appendix A References Author Index Subject Index.