Personal Reflection

I am surprised to read that the implementation phase is sometimes overlooked in the ISD process.  Implementation is when the students are introduced to the instruction.  In addition, evaluations are performed to assess the participant's impressions of the training and whether the training has met it's objectives.  I am impressed by the fact that the 'four level' model for course evaluation created by Donald Kirkpatrick in 1959 is still used in the evaluative process today. It is only until recently that a fifth methodology called return on investment or ROI has been added to the methodology.  Created by Dr. Jack Phillips this evaluative process weighs the benefits of the training against the costs.  I am also suprised to discover that there are other models of assessment including:

Daniel Stufflebeam's CIPP Model (Context, Input, Process, Product)

Robert Stake's Responsive Evaluation Model

Robert Stake's Congruence-Contingency Model

Kaufman's Five Levels of Evaluation

CIRO (Context, Input, Reaction, Outcome)

PERT (Program Evaluation and Review Technique)

Alkins' UCLA Model

Michael Scriven's Goal-Free Evaluation Approach

Provus's Discrepancy Model

Eisner's Connoisseurship Evaluation Models

Illuminative Evaluation Model

Portraiture Model

and also the American Evaluation Association

Though not always included in a ISD training program, it is one important aspect that should not be overlooked.  The feedback from the participant as well the knowledge of knowing that objectives were met assures the designer that the training was complete. 

Kirkpatrick, D. (1959). Kirkpatrick's learning and training evaluation theory. Retrieved from http://www.businessballs.com/kirkpatricklearningevaluationmodel.htm