Return to the list of Formative Evaluation IDAs | Return to the IDA Library Home Page


Instructional Design Activity: Formative Evaluation


 

Overall Instructor Rating: Satisfactory

Ratings explanation:

  • Exemplary - A model answer in almost every way (this is given out very rarely).
  • Satisfactory - Very well done; you've met the expectations of the assignment. There are some minor problems, so read my feedback well.
  • Marginal Pass - You pass, but there are lots of issues to consider. Read my feedback very carefully and be sure you understand the points/issues I raise.
  • Not satisfactory, redo and resubmit - The assignment was not completed appropriately. I am concerned that you do not understand the process well enough yet. To get credit for the assignment, you need to redo it, most probably on another topic. Read and consider my feedback very carefully before redoing.

Instructor's Overall Feedback:

Good overall -- you seem to understand the fundamentals of formative evaluation.

 


The objective of this activity is to plan for the formative evaluation of your instruction. As stated by Dick, Carey, and Carey (2001): "Formative evaluation is the process designers use to obtain data that can be used to revise their instruction to make it more efficient and effective. The emphasis in formative evlauation is on the collection and analysis of data and the revision of the instruction" (p. 284-285).

Using the lesson you have described in the IDA on lesson design, complete the Formative Evaluation Planning Worksheet. Using the table below, describe:

  • Who will do the ongoing evaluation;
  • What is being evaluated;
  • When the evaluation should occur; and
  • How the evaluation will be conducted (i.e. tools you will use)

Be sure to refer to Dick, Carey, and Carey Chapter 10 for specific information that can be gathered from experts (e.g. subject-matter, learning, and learner) and learners in different formative evaluation situations (e.g. one-to-one, small-group, and field trials).

 


Formative Evaluation Planning Worksheet

Write the instructional objectives of your lesson here (it can be more than one):

Your final response:

Older adult volunteers will demonstrate ability to use mouse to get around computer environment and understand its basic functions.

The instructor's feedback to this step:

Well stated.


Write your objective using the correct form. Click here for advice on writing objectives.


HTML formatting reminder: You can embed HTML tags directly in your responses. This will be help your buddies and the instructor view your information in a more readable fashion. For example, if you want a paragraph break somewhere, just enter <p>:

I will have the experts review the lesson on three levels:
<p>
1. content; 2. technical accuracy; 3. quality of instruction.
<p>
The content review will help ensure that no mistakes were made in the information provided to the learners.

Who
What
When
How
Experts (subject-matter, learning, learner)

Your final response:

I will have the experts review this lesson for four levels:

1. appropriateness; 2. accuracy; 3. content; 4. quality of instruction.

The appropriateness review will help us know if the instructional materials are suitable for the audience and the subject matter. The accuracy review will let us know if we have errors in directions for using the mouse and its functions. The content review will help us know if any mistakes were made in the information we provided for the learners. Finally, the quality of instruction review will let us know if the instruction is as effective and efficient as possible.

 

Your final response:

Will want to have these four reviews done as soon as the instructional lesson design is conceived and conceptualized. We want this evaluation prior to the small group evaluations so the results of those evaluations will be as accurate as possible and not muddied by errors.

Your final response:

The experts will walk through the instruction and, using their own specific checklist, they will evaluate the instruction. In addition they will take any notes on the instruction that they feel relevant and will discuss them prior to completing the walk-through.

The instructor's feedback to this step:

Excellent!

Learners: one-to-one

Your final response:

Four individual learners will be selected for this review, they will evaluate the learnibility of the lesson. Each of these learners will be older adults who are novice computer users.

Your final response:

These learners will be brought in after the initial instruction ideas are formulated and sketched out.

Your final response:

These learners will review the instruction with the designer. The learners will be asked to walk through the instruction and discuss any instruction that is unclear or confusing. Following the run-through, each learner will be asked to fill out an evaluation sheet about different aspects of the instruction. They will also be asked to provide feedback on how the instruction could be improved.

The instructor's feedback to this step:

Very good. You need to also assess students' learning of the objective.

Learners: small-group

Your final response:

The small group will consist of 10 learners (about the size of one learning group), they will evaluate the learnability of the lesson. Each of these learners will be older adults who are novice computer users.

Your final response:

The small group learners will be brought in after a final "prototype" for instruction is created.

Your final response:

These learners will follow a similar process as the one on one learners did although the designer is much less involved with the instruction. The group evaluates the instruction on their own and is also given the same evaluation sheets as the one on one learners. Following the completion of those evaluation forms the group is encouraged to discuss the instruction as a group, concentrating on lingering errors in the instruction as well as any parts that may still seem confusing or unclear.

The instructor's feedback to this step:

Same feedback. Be sure to include an assessment of the students' learning of the learning objective.

Learners: field trial

Your final response:

The field trial learners will also be a group of 10 people. They will actually be older adult volunteers who will use this instruction once it is complete.

Your final response:

The field test learners will be brought in once the instructional design is completed.

Your final response:

The evaluation will be once again similar to the one on one and small group learners. The field test learners will go through the lesson by themselves, without the involvement of the designer, and will then be asked to fill out the evaluation form provided. In addition they too will participate in a group discussion of problems they may have run into while going through the lesson. This will give them a chance to provide individual evaluations, for those who are shy and would prefer to remain anonymous as well as bounce questions and concerns off learners in their same situation in the group discussion.

The instructor's feedback to this step:

Good plan (with the same caveat).