Return to the list of Formative Evaluation IDAs | Return to the IDA Library Home Page


Instructional Design Activity: Formative Evaluation


 

Overall Instructor Rating: Satisfactory

Ratings explanation:

  • Exemplary - A model answer in almost every way (this is given out very rarely).
  • Satisfactory - Very well done; you've met the expectations of the assignment. There are some minor problems, so read my feedback well.
  • Marginal Pass - You pass, but there are lots of issues to consider. Read my feedback very carefully and be sure you understand the points/issues I raise.
  • Not satisfactory, redo and resubmit - The assignment was not completed appropriately. I am concerned that you do not understand the process well enough yet. To get credit for the assignment, you need to redo it, most probably on another topic. Read and consider my feedback very carefully before redoing.

Instructor's Overall Feedback:

Hi William: You did a nice job addressing the issues raised in the first review of this IDA. Thank you for your persistence and hard work in this class. Dr. Law Hi, William Overall, you are headed in the right direction on this IDA. However, there are several things that I would like to ask you to revise in order to make your formative evaluation plan more worthwhile. Please see my feedback below. 1. Expert part: Some of your statements need more clarification. For example, you could provide more specific information rather than “people from the school of education.” Who are these people? Are they faculty, graduate students, undergraduate students or staff members? What are they specialized in? Think about your target learners and your subject area? Who would be the best person to conduct this evaluation? Also, I am not sure whether people from the school of psychology will be helpful for this evaluation. If you need someone who has psychology background, you might want people from educational psychology, rather than general psychology. Learner experts will review the appropriateness of the material for the eventual performance context. Who would be the best evaluators for you? Can you elaborate on this a little more? 2. Overall, your “what” parts tend to address “who,” not “what.” You often missed the criteria and purpose of your evaluation with each group, which tends to make your evaluation vague. For example, in the one-to-one part, you stated, “ several nature center employees will be contacted to take part in an evaluation. The employees will come from a variety of nature centers, and therefore, they will bring different experiences to the meeting.” I found out who these individual employees are, but I do not see what you want to evaluate and what kinds of data you want to collect from these people. This tendency is consistent throughout your IDA. 3. Some of the “how” parts are weak due to the lack of data collection methods. For example, in your field testing, you mentioned that “afterwards, the audience can provide the instructor with additional feedback that could improve the presentation.” Are you going to have post-interview, survey, or informal chatting? How are you going to collect data that you need for revision? 4. As your buddy also pointed out, it is not clear to me how your one-to-one and small group evaluation would be distinctive. What are the purposes of conducting each evaluation? The formative evaluation part is very critical because it makes a program (course/instruction) ready for implementation. Please rethink about this formative evaluation part more thoroughly in terms of what you want to know, whose help you need and how you will conduct each evaluation. Please revise your IDA and resubmit it. Thank you and please let me know if you have any questions. Best, Eun Jung

 


The objective of this activity is to plan for the formative evaluation of your instruction. As stated by Dick, Carey, and Carey (2001): "Formative evaluation is the process designers use to obtain data that can be used to revise their instruction to make it more efficient and effective. The emphasis in formative evlauation is on the collection and analysis of data and the revision of the instruction" (p. 284-285).

Using the lesson you have described in the IDA on lesson design, complete the Formative Evaluation Planning Worksheet. Using the table below, describe:

  • Who will do the ongoing evaluation;
  • What is being evaluated;
  • When the evaluation should occur; and
  • How the evaluation will be conducted (i.e. tools you will use)

Be sure to refer to Dick, Carey, and Carey Chapter 10 for specific information that can be gathered from experts (e.g. subject-matter, learning, and learner) and learners in different formative evaluation situations (e.g. one-to-one, small-group, and field trials).

 


Formative Evaluation Planning Worksheet

Write the instructional objectives of your lesson here (it can be more than one):

Your final response:

Title: Evaluation for Designing a PowerPoint Presentation Objective: Nature center staff members WBAT create a PowerPoint presentation that includes pictures, text, hyperlinks, sounds, and videos.

The instructor's feedback to this step:

No specific feedback given on this step.


Write your objective using the correct form. Click here for advice on writing objectives.


HTML formatting reminder: You can embed HTML tags directly in your responses. This will be help your buddies and the instructor view your information in a more readable fashion. For example, if you want a paragraph break somewhere, just enter <p>:

I will have the experts review the lesson on three levels:
<p>
1. content; 2. technical accuracy; 3. quality of instruction.
<p>
The content review will help ensure that no mistakes were made in the information provided to the learners.

Who
What
When
How
Experts (subject-matter, learning, learner)

Your final response:

Subject Matter: Instructors experienced with PowerPoint will review the presentation for accuracy and organization. Learning Expert: People from the school of education will review the presentation for lesson quality and appropriate teaching methods. Learner Expert: People from the school of psychology will review the presentation and use their knowledge of how people learn to determine if the presentation does its best at teaching the subject matter.

Subject Matter: Instructors experienced with PowerPoint will review the presentation for accuracy and organization. Learning Expert: People from the school of education will review the presentation for lesson quality and appropriate teaching methods. Learner Expert: People from the school of psychology will review the presentation and use their knowledge of how people learn to determine if the presentation does its best at teaching the subject matter.

 

Your final response:

Subject Matter: The review will occur after a rough draft of the presentation has been completed. The rough draft will be completed at least 2 months in advance of the start date. Learning: The review will occur after the subject matter expert review of the presentation and after all appropriate revisions have been made. Learner: The review will occur after the learning expert review and after all appropriate revisions have been made. All expert appointments will be scheduled at least one month in advance by the lecturer.

Subject Matter: The review will occur after a rough draft of the presentation has been completed. Learning: The review will occur after the subject matter expert review of the presentation and after all appropriate revisions have been made. Learner: The review will occur after the learning expert review and after all appropriate revisions have been made. All expert appointments will be scheduled at least one month in advance.

Your final response:

Subject Matter: The expert will be provided with lecture notes, PowerPoint slides, and other lecture materials. The instructor will then guide the expert through the lecture plan. Learning: The expert will be provided with lecture notes, PowerPoint slides, and other lecture materials. The instructor will then guide the expert through the lecture plan. Learner: The expert will be provided with lecture notes, PowerPoint slides, and other lecture materials. The instructor will then guide the expert through the lecture plan.

Subject Matter: The expert will be provided with lecture notes, PowerPoint slides, and other lecture materials. The instructor will then guide the expert through the lecture plan. Learning: The expert will be provided with lecture notes, PowerPoint slides, and other lecture materials. The instructor will then guide the expert through the lecture plan. Learner: The expert will be provided with lecture notes, PowerPoint slides, and other lecture materials. The instructor will then guide the expert through the lecture plan.

The instructor's feedback to this step:

No specific feedback given on this step.

Learners: one-to-one

Your final response:

Several nature center employees will be contacted to take part in an evaluation. The employees will come from a variety of nature centers, and therefore, they will bring different experiences to the meeting.

Several nature center employees will be contacted to take part in an evaluation. The employees will come from a variety of nature centers, and therefore, they will bring different experiences to the meeting.

Your final response:

Appointments will be made at least one month in advance of the start date, and individual employees will meet with the instructor, who will go over the lecture.

Appointments will be made at least one month in advance, and individual employees will meet with the instructor, who will go over the lecture.

Your final response:

The instructor will present the lecture to the individual. During the presentation, the individual will use a Likert Scale to evaluate the lecture on a variety of topics. Afterwards, the individuals will provide the instructor with any additional feedback that could improve the presentation.

The instructor will present the lecture to the individual. During the presentation, the individual will use a likert scale to evaluate the lecture on a variety of topics. Afterwards, the individuals will provide the instructor with any additional feedback that could improve the presentation.

The instructor's feedback to this step:

No specific feedback given on this step.

Learners: small-group

Your final response:

A small group of nature center employees will be brought in to view and discuss the presentation.

A small group of nature center employees will be brought in to review and discuss the presentation.

Your final response:

Appointments will be made at least one month in advance, and the group of employees will meet with the instructor, who will go over the lecture.

Appointments will be made at least one month in advance, and the group of employees will meet with the instructor, who will go over the lecture.

Your final response:

The instructor will present the lecture to the group. During the presentation, the group will use a likert scale to evaluate the lecture on a variety of topics. Afterwards, the group will provide the instructor with any additional feedback that could improve the presentation.

The instructor will present the lecture to the group. During the presentation, the group will use a likert scale to evaluate the lecture on a variety of topics. Afterwards, the group will provide the instructor with any additional feedback that could improve the presentation.

The instructor's feedback to this step:

No specific feedback given on this step.

Learners: field trial

Your final response:

The instructor will visit a local nature center (Sandy Creek for example) and give the presentation on creating a complete PowerPoint Presentation. The presentation will be presented to all employees at the center.

The instructor will visit a local nature center (Sandy Creek for example) and give the presentation on creating a complete PowerPoint Presentation. The presentation will be presented to all employees at the center.

Your final response:

The presentation will be made at least one month in advance of the start date.

The presentation will be made at least one month in advance whenever the employees have time.

Your final response:

The instructor will present the lecture to the center. Afterwards, the audience can provide the instructor with additional feedback that could improve the presentation.

The instructor will present the lecture to the center. Afterwards, the audience can provide the instructor with additional feedback that could improve the presentation.

The instructor's feedback to this step:

No specific feedback given on this step.