Return to the list of Formative Evaluation IDAs | Return to the IDA Library Home Page


Instructional Design Activity: Formative Evaluation


 

Overall Instructor Rating: Satisfactory

Ratings explanation:

  • Exemplary - A model answer in almost every way (this is given out very rarely).
  • Satisfactory - Very well done; you've met the expectations of the assignment. There are some minor problems, so read my feedback well.
  • Marginal Pass - You pass, but there are lots of issues to consider. Read my feedback very carefully and be sure you understand the points/issues I raise.
  • Not satisfactory, redo and resubmit - The assignment was not completed appropriately. I am concerned that you do not understand the process well enough yet. To get credit for the assignment, you need to redo it, most probably on another topic. Read and consider my feedback very carefully before redoing.

Instructor's Overall Feedback:

Hi Cheng-Yu: You wrote: ---- Will have the experts review the lesson on three levels: 1. content 2. quality of instruction. ---- You only listed 2 levels. Was accuracy your third level? For the small group test you wrote: ---- After learners finished the instruction process, use questionnaire and interview to collect information. ---- You stated that you were measuring learnability. What aspects of the instruction would you attempt to evaluate with some of your questions in the questionnaires and interviews to get at how effective your instructon is regarding learnability? For example, the sequencing of the content might be important to evaluate. Did the learners find it sequenced appropriately, or did they find it difficult in some areas because instruction required for one skill was presented out of order. For the field test: Same thing as small group, what aspects of the instruction would you examine to determine effectiveness. Post-instruction test scores? How confident are learners that they can perform these skills without assistance? Performance test - as part of the final assessment you score the learners' web pages based on a checklist of criteria that represents accomplishment of the objectives. Please update these areas and resubmit it to me. Dr. Law

 


The objective of this activity is to plan for the formative evaluation of your instruction. As stated by Dick, Carey, and Carey (2001): "Formative evaluation is the process designers use to obtain data that can be used to revise their instruction to make it more efficient and effective. The emphasis in formative evlauation is on the collection and analysis of data and the revision of the instruction" (p. 284-285).

Using the lesson you have described in the IDA on lesson design, complete the Formative Evaluation Planning Worksheet. Using the table below, describe:

  • Who will do the ongoing evaluation;
  • What is being evaluated;
  • When the evaluation should occur; and
  • How the evaluation will be conducted (i.e. tools you will use)

Be sure to refer to Dick, Carey, and Carey Chapter 10 for specific information that can be gathered from experts (e.g. subject-matter, learning, and learner) and learners in different formative evaluation situations (e.g. one-to-one, small-group, and field trials).

 


Formative Evaluation Planning Worksheet

Write the instructional objectives of your lesson here (it can be more than one):

Your final response:

Learners will be able to utilize dreamweaver to generate a web page that includes text with different fonts and colors, pictures, tables, and background images.

The instructor's feedback to this step:

No specific feedback given on this step.


Write your objective using the correct form. Click here for advice on writing objectives.


HTML formatting reminder: You can embed HTML tags directly in your responses. This will be help your buddies and the instructor view your information in a more readable fashion. For example, if you want a paragraph break somewhere, just enter <p>:

I will have the experts review the lesson on three levels:
<p>
1. content; 2. technical accuracy; 3. quality of instruction.
<p>
The content review will help ensure that no mistakes were made in the information provided to the learners.

Who
What
When
How
Experts (subject-matter, learning, learner)

Your final response:

Will have the experts review the lesson on three levels: 1. content 2. quality of instruction. The content review will help ensure that no mistakes were made in the information provided to the learners. Also, review the quality of instruction to make sure the properness of the instruction procedure and effectiveness.

Will have the experts review the lesson on three levels: 1. content 2. quality of instruction. The content review will help ensure that no mistakes were made in the information provided to the learners. Also, review the quality of instruction to make sure the properness of the instruction procedure and effectiveness.

 

Your final response:

First time will reviewed right after lesson design finished, and the second time will occurred before learners: small group evaluation.

First time will reviewed right after lesson design finished, and the second time will occurred before learners: small group evaluation.

Your final response:

The review will be conducted through questionnaire and interviews with the experts. The questionnaire collects information about each part of the instruction. The interviews will take place after the review is completed to clarify any information.

The review will be conducted through questionnaire and interviews with the experts. The questionnaire collects information about each part of the instruction. The interviews will take place after the review is completed to clarify any information.

The instructor's feedback to this step:

No specific feedback given on this step.

Learners: one-to-one

Your final response:

3 sample learners will be selected for the evaluation of the effectiveness of the instruction. The learners will be selected based on their level of computer operation experiences include novice, average, and experienced.

3 sample learners will be selected for the evaluation of the effectiveness of the instruction. The learners will be selected based on their level of computer operation experiences include novice, average, and experienced.

Your final response:

The one-on-one sessions will occur early in the process — after lesson design finished.

The one-on-one sessions will occur early in the process — after lesson design finished.

Your final response:

The designer will sit with each learner as they go through the instruction, marking areas in the instruction where it appears to be confusing, answering questions the learners pose as they complete the instruction. An interview will be conducted after each learner has gone through the instruction to answer any questions and to clarify any information.

The designer will sit with each learner as they go through the instruction, marking areas in the instruction where it appears to be confusing, answering questions the learners pose as they complete the instruction. An interview will be conducted after each learner has gone through the instruction to answer any questions and to clarify any information.

The instructor's feedback to this step:

No specific feedback given on this step.

Learners: small-group

Your final response:

As with the one-on-one sessions, the small group of learners will be evaluating the "learnability" of the instruction. A group of 5-6 learners most closely matching the target audience will be selected for this round of evaluation.

As with the one-on-one sessions, the small group of learners will be evaluating the "learnability" of the instruction. A group of 5-6 learners most closely matching the target audience will be selected for this round of evaluation.

Your final response:

The small group session will occur after the prototypes of the instruction are created.

The small group session will occur after the prototypes of the instruction are created.

Your final response:

After learners finished the instruction process, use questionnaire and interview to collect information.

After learners finished the instruction process, use questionnaire and interview to collect information.

The instructor's feedback to this step:

No specific feedback given on this step.

Learners: field trial

Your final response:

Again, the learners in the field test will be evaluating the "learnability" of the instruction. The learners in the field test will be the actual learners who will be using the instruction once it is completed.

Again, the learners in the field test will be evaluating the "learnability" of the instruction. The learners in the field test will be the actual learners who will be using the instruction once it is completed.

Your final response:

After the whole course design procedure completed.

After the whole course design procedure completed.

Your final response:

The evaluation will take place in the actual setting where the instruction will be used on a regular basis. After instruction, use questionnaire to measure the effectiveness of the instruction.

The evaluation will take place in the actual setting where the instruction will be used on a regular basis. After instruction, use questionnaire to measure the effectiveness of the instruction.

The instructor's feedback to this step:

No specific feedback given on this step.