Return to the list of Formative Evaluation IDAs | Return to the IDA Library Home Page


Instructional Design Activity: Formative Evaluation


 

Overall Instructor Rating: Satisfactory

Ratings explanation:

  • Exemplary - A model answer in almost every way (this is given out very rarely).
  • Satisfactory - Very well done; you've met the expectations of the assignment. There are some minor problems, so read my feedback well.
  • Marginal Pass - You pass, but there are lots of issues to consider. Read my feedback very carefully and be sure you understand the points/issues I raise.
  • Not satisfactory, redo and resubmit - The assignment was not completed appropriately. I am concerned that you do not understand the process well enough yet. To get credit for the assignment, you need to redo it, most probably on another topic. Read and consider my feedback very carefully before redoing.

Instructor's Overall Feedback:

(Feedback given by Younghee Woo, IT doctoral student; concurred by Lloyd Rieber.) This is good. I have some suggestions about your formative evaluation plan, so please read that feedback below carefully.

 


The objective of this activity is to plan for the formative evaluation of your instruction. As stated by Dick, Carey, and Carey (2001): "Formative evaluation is the process designers use to obtain data that can be used to revise their instruction to make it more efficient and effective. The emphasis in formative evlauation is on the collection and analysis of data and the revision of the instruction" (p. 284-285).

Using the lesson you have described in the IDA on lesson design, complete the Formative Evaluation Planning Worksheet. Using the table below, describe:

  • Who will do the ongoing evaluation;
  • What is being evaluated;
  • When the evaluation should occur; and
  • How the evaluation will be conducted (i.e. tools you will use)

Be sure to refer to Dick, Carey, and Carey Chapter 10 for specific information that can be gathered from experts (e.g. subject-matter, learning, and learner) and learners in different formative evaluation situations (e.g. one-to-one, small-group, and field trials).

 


Formative Evaluation Planning Worksheet

Write the instructional objectives of your lesson here (it can be more than one):

Your final response:

Given the need to heighten student awareness about endangered animals throughout habitats in the U.S., students will be able to generate a slide presentation to teach about endangerment, thereby becoming a part of the solution instead of the problem.

You may also view this instructional design activity on my webpage at http://www.arches.uga.edu/~gwillson/6170/IDA5.htm

The instructor's feedback to this step:

Looks good!


Write your objective using the correct form. Click here for advice on writing objectives.


HTML formatting reminder: You can embed HTML tags directly in your responses. This will be help your buddies and the instructor view your information in a more readable fashion. For example, if you want a paragraph break somewhere, just enter <p>:

I will have the experts review the lesson on three levels:
<p>
1. content; 2. technical accuracy; 3. quality of instruction.
<p>
The content review will help ensure that no mistakes were made in the information provided to the learners.

Who
What
When
How
Experts (subject-matter, learning, learner)

Your final response:

I will have two 5th grade student experts and one teacher review three levels:

1. content

2. technical accuracy

3. quality of instruction

The content review will help ensure that no mistakes were made in the information provided to the learners. The technical accuracy review will enable us to know if we have broken links or files that cannot be accessed from the WebQuest. Finally, the quality of instruction review will let us know if the instruction format is effective and promotes student learning.

 

Your final response:

Three reviews will be completed prior to the posting of the WebQuest.

Your final response:

The reviews will be conducted through checklists and interviews with the experts. The checklist handout will act as a guide as each expert make notes to share in individual interviews.

The instructor's feedback to this step:

This looks very good, but I recommend that you make clear who are experts for reviewing the content, technical accuracy, and quality of instruction. You might need different experts for each part.

Learners: one-to-one

Your final response:

three sample learners will be selected for the evaluation of the "learnability" of the instruction. The learners will be selected based on their levels in reading and research skills: novice, average, and experienced.

Your final response:

one-on-one sessions will occur early in the process after the lesson has been developed, WebQuest posted, and changes made per expert input.

Your final response:

Each sample learner will go over each WebQuest page with the designer; the designer will note areas of confusion for learner and answer questions as they are posted by the learner in the instruction.

The instructor's feedback to this step:

This is good, but I recommend that you be more specific in how you will select participants and how you will establish rapport with participants and so on. A more specific plan will make your actual formative evaluation easier to implement and more valuable. And, you need clearer descriptions in the 'how' section.

Learners: small-group

Your final response:

The small group of learners numbering 4-6 will evaluate the learnibility of the instruction. Group members will be a cross section of the whole class and divide the WebQuest pages in order to work in pairs as they peruse all pages.

Your final response:

the small group sessions will occur after the WebQuest and accompanying activity sheets are posted.

Your final response:

Several methods will be used to gather information: A PowerPoint template with essential questions to be answered and ongoing interviews

The instructor's feedback to this step:

Great! Just add the elements to be evaluated to 'what' section.

Learners: field trial

Your final response:

The learners in the field test will evaluate the "learnability" of the instruction. The learners will be comprised of the three fifth grade homerooms.

Your final response:

The field test will occur after the designer has made corrections as noted by the experts and the design of the lesson is complete

Your final response:

The evaluation will take place in the regular classroom setting as the three homeroom classes rotate through. The learners will be assigned to one of the six U.S. biome teams. Each team will be comprised of approximately 3-4 learners. Each team of learners will have a rubric handout that gives specific requirements for each slide. They will check off each when completed. Two columns of point values will be tallied at the bottom of handout: Possible and Earned.

The instructor's feedback to this step:

I agree with Christopher. And, I recommend that you consider to add some different evaluation methods for the field trial. For collecting data in a real setting, observation of the instruction while it is happening and interviews with learners and instructor afterward will be very valuable. You also need clearer description of the elements to be evaluated.