EdTech 505: Defining Evaluation

Considering Two Definitions of Evaluation (from B&T text)

1)The purpose of evaluation is "to determine whether and to what degree the objects have been or are being achieved" (p. 4)

2) "Evaluation is the systematic process of collecting and analyzing data in order to make a decision" (p. 4)

My response to a peer on our discussion board:

I had a bit of trouble discerning between the two definitions because I thought they could be interpreted in different ways.  In the text's discussion that followed the two examples, the authors pointed out that the first definition is more of an objective "okay, here's where things are".  The second definition seems to encompass "okay, here's where things are and here's where you may want to go".  To me, the second definition is more productive because it's concerned with the bigger picture, the next steps, and with making an impact.  It doesn't just take a snapshot in time and leave it at that.

I agree with everything in your interpretation of the definitions except for the part "the evaluator may be collecting and analyzing data to help stakeholders design project goals, unlike the other definition in which evaluation occurs after the goals are set".  I my opinion, it would not be wise to put the cart before the horse and establish goals AFTER evaluation.  What are they evaluating in that case?  To me, a big part of evaluation is measuring the success of the objectives, which are in essence, a breakdown of the project goals.  Those should be embedded in the initial design of the project.

Now, it makes sense that after evaluation the stakeholders may decide to alter their goals or redefine their program.  In that case, they may want to do the implementation and evaluation process all over again with those revisions.  Here is where your great summary of the purpose of a systematic process comes into play.  After making decisions (definition #2), the program design is tweaked, and the evaluation process can be replicated so that, as you say,"an inconsistent process cannot be blamed for results".  In my understanding, the difference in the two definitions is not the ordering of setting goals and evaluating but rather to what degree there (if at all) "next steps" are proposed.  Not sure if I have that right, though!