Return to the list of Formative Evaluation IDAs | Return to the IDA Library Home Page


Instructional Design Activity: Formative Evaluation


 

Overall Instructor Rating: Satisfactory

Ratings explanation:

  • Exemplary - A model answer in almost every way (this is given out very rarely).
  • Satisfactory - Very well done; you've met the expectations of the assignment. There are some minor problems, so read my feedback well.
  • Marginal Pass - You pass, but there are lots of issues to consider. Read my feedback very carefully and be sure you understand the points/issues I raise.
  • Not satisfactory, redo and resubmit - The assignment was not completed appropriately. I am concerned that you do not understand the process well enough yet. To get credit for the assignment, you need to redo it, most probably on another topic. Read and consider my feedback very carefully before redoing.

Instructor's Overall Feedback:

You did a good job here. You seem to understand the process very well.

 


The objective of this activity is to plan for the formative evaluation of your instruction. As stated by Dick, Carey, and Carey (2001): "Formative evaluation is the process designers use to obtain data that can be used to revise their instruction to make it more efficient and effective. The emphasis in formative evlauation is on the collection and analysis of data and the revision of the instruction" (p. 284-285).

Using the lesson you have described in the IDA on lesson design, complete the Formative Evaluation Planning Worksheet. Using the table below, describe:

  • Who will do the ongoing evaluation;
  • What is being evaluated;
  • When the evaluation should occur; and
  • How the evaluation will be conducted (i.e. tools you will use)

Be sure to refer to Dick, Carey, and Carey Chapter 10 for specific information that can be gathered from experts (e.g. subject-matter, learning, and learner) and learners in different formative evaluation situations (e.g. one-to-one, small-group, and field trials).

 


Formative Evaluation Planning Worksheet

Write the instructional objectives of your lesson here (it can be more than one):

Your final response:

Given a document created in MS Word, the SWBAT demonstrate how to format text by changing fonts, font style, font color and font size.

The instructor's feedback to this step:

This has all the elements of a well written objective. Nice Job.


Write your objective using the correct form. Click here for advice on writing objectives.


HTML formatting reminder: You can embed HTML tags directly in your responses. This will be help your buddies and the instructor view your information in a more readable fashion. For example, if you want a paragraph break somewhere, just enter <p>:

I will have the experts review the lesson on three levels:
<p>
1. content; 2. technical accuracy; 3. quality of instruction.
<p>
The content review will help ensure that no mistakes were made in the information provided to the learners.

Who
What
When
How
Experts (subject-matter, learning, learner)

Your final response:

I will have the experts review the lesson on three levels:

1. content;

2. technical accuracy;

3. quality of instruction;

The content review will help ensure that no mistakes were made in the information given to the learners; that all aspects of text formatting are covered in the instruction; and the lesson items are presented in a logical order.

The technical accuracy review will inform the instructor of any errors in the step-by-step guide for reformatting

The quality of instruction review will check for the proper amount of student participation and application of acquired skills.

 

Your final response:

Each of the experts will receive a packet of materials and handouts as well as the lesson plans for the instruction.

Expert peer review will be conducted at least two weeks before the implementation of the lesson to allow time for the instructor to make the proper revisions to the instruction before submitting to the learners for their evaluation.

Your final response:

The review will be conducted through the use of checklists,interviews, and group discussions with the experts.

The instructor's feedback to this step:

Good, this is well done.

Learners: one-to-one

Your final response:

Three sample learners will be selected for the evaluation of the "learnability" of the instruction. The learners will be selected based on their level of prior knowledge of the topic: novice, average, experienced.

Your final response:

The one-on-one sessions will occur as soon as the subject matter experts (SME) have completed their review.

Your final response:

The designer will sit with each learner as they go through the instruction, marking areas in the instruction where it appears to be confusing, incorrect or unnecessary, etc. The designer will answer questions as they come up.

After each learner has completed the instruction the designer will interview them. The learner will assist with clarifying the instruction.

Attitudes will also be assessed by interacting with the learners through discussions of the instructional process used.

The instructor's feedback to this step:

Good, this is well done.

Learners: small-group

Your final response:

The small-group learners will be evaluating the "learnability" of the instruction. A group of 5-6 learners most closely matching the target audience will be selected for this round of evaluation.

Your final response:

The small-group session will occur after the SME and the one-on-one feedback and revisions have been incorporated into the instruction prototype.

Your final response:

The designer will use observations, interviews, and post-instruction assessments (checklists) to determine the effectiveness of the instruction. An attitudinal survey will also be utilized.

The instructor's feedback to this step:

Good, this is well done.

Learners: field trial

Your final response:

The learners in the field test will be evaluating the "learnability" of the instruction.

The learners in the field test will be the actual learners who will be using the instruction once it is completed.

Your final response:

The field test will occur after feedback from the experts, one-on-one and small-groups has been given, and all changes and revisions have been made.

Your final response:

The field trial will take place in the actual setting where the instruction will be used on a regular basis.

As with the small group, post-instruction assessments (surveys, checklists)as well as interviews with the instructor and learners will be conducted.

The instructor's feedback to this step:

Good, this is well done.