12.17.2008

Flipping Kirkpatrick

Donald Kirkpatrick's Four Levels of Evaluation was introduced in the late fifties:
  1. Reaction - how the learners react to the learning process
  2. Learning - the extent to which the learners gain knowledge and skills
  3. Performance (behavior) - capability to perform the learned skills while on the job
  4. Results (impact) - includes such items as monetary, efficiency, moral, etc.
Because of its age and with all the new technology advances, it is often criticized nowadays for being too old and simple. Yet, almost five decades after its introduction, there has not been a viable option to replace it. And I think the reason why is that because Kirkpatrick basically nailed it, but presented it wrong. Rather than being just an evaluation tool, it should have been presented as both a planning and evaluation tool. To do this, it needs one simple adjustment. . . flip it upside-down! That is, rearrange the steps into a "backwards planning" tool by starting with the end in mind:

Thus, planing and analysis needs to work backward by identifying:

  1. the desired impact (outcome or result) that will improve the performance of the business
  2. the level of performance the learners must be able to do to create the impact
  3. the knowledge and skills they need to learn in order to perform
  4. what they need to perceive in order to learn (the need to learn)
Planning it backwards will help to ensure there is a circular causality:

The learners' perception of the need to learn should motivate them to learn, which in turn causes the desired performance that drives the impact desired by our customer (client). This causality should continue in a circular fashion in that the results achieved should now drive the performers' perceptions of the need to learn more and perform better in order to achieve even better results. Of course this assumes that not only the customer understands the level of impact achieved, but also the performers/learners' perception on how close they came to achieving the desired result.

5 comments:

Clark said...

I like this, and agree that starting with the impact and working backwards is a good strategy (cf Tony Karrer's recent post about a case study). Like you should start ID from your objective. I note that a client (small software firm in Redmond :) touched on something I like: level 0. Are they even 'there', or are they voting with their feet and staying away in droves?

Donald Clark said...

Clark, I like the level 0 -- in order to get their perception or reaction you have to first get them in the learning environment.

Terrence Seamon said...

Brilliant, Don.

I will blog about this.

Regards,

Terry

Unknown said...

Great post! Have translated it into Chinese.
http://www.traininginn.com/bbs/viewthread.php?tid=317&page=1&extra=page%3D1#pid524

Terrence Seamon said...

OK here's the link:

http://learningvoyager.blogspot.com/2008/12/trainings-effectiveness.html

Terry