Overall Instructor Rating: Satisfactory
Ratings explanation:
- Exemplary - A model answer in almost every way (this is given out very rarely).
- Satisfactory - Very well done; you've met the expectations of the assignment. There are some minor problems, so read my feedback well.
- Marginal Pass - You pass, but there are lots of issues to consider. Read my feedback very carefully and be sure you understand the points/issues I raise.
- Not satisfactory, redo and resubmit - The assignment was not completed appropriately. I am concerned that you do not understand the process well enough yet. To get credit for the assignment, you need to redo it, most probably on another topic. Read and consider my feedback very carefully before redoing.
Instructor's Overall Feedback:
You did a good job on this IDA. You seem to grasp the formative evaluation process well. The lesson objectives are well-stated. The timeline for conducting each evaluation steps is logical and appropriate. All the necessary components of each stage are addressed concisely.
I don’t have many notes for you except the following:
1. In the expert review part, you stated the expert review will be done “before the small group evaluation occurs.” Supposedly, expert review is the earliest step in formative evaluation if it’s going to be conducted (before one-to-one evaluation). The When description for your one-to-one evaluation reflects your understanding about this. You just need to be a little more clear here. Your How description is a good presentation of approaches to be used for different purposes.
2. In the one-to-one evaluation, the What section seem a little too general and needs to be enhanced with more details. Although “Who” information is included, there is no information concerning what aspects of the instruction will be evaluated. You mentioned something generic as “learnability”, but what does it really entail? This is a major concern in your small group and field trial as well. Another thing to note is that the focus of evaluation at different stages of formative evaluation often varies. Simply looking at a general term "learnability" could make you miss examining many important elements that should be checked carefully before the instruction goes to the final audience.
3. As for the designer’s role, it’s good to involve designers in this type of evaluation, but it could be subjective sometimes too. The ideal situation is an external evaluator also plays a part in the activity to ensure objectivity and to provide additional perspective(s).
4. In the small group evaluation, is the evaluation of learning (student mastery of lesson objectives) missing? Keep in mind that this is something crucial to be checked at this stage, and it could be the last chance to check effectiveness of the instruction before it goes to the field.
5. Your plan of field trial looks very good. The How part is particularly well done as it is very specific and clear about how different aspects of the instruction (including student mastery of objectives) will be evaluated.
The only suggestion is that you may need to clarify the sequence of final evaluation and the instruction by adjusting the order of your sentences or adding more clarifying terms.
Overall, this IDA is well-done. Thank you for your good work.
Ying
[Note from Greg: I approve of Ying's feedback.]
The objective of this activity is to plan for the formative evaluation of your instruction. As stated by Dick, Carey, and Carey (2001): "Formative evaluation is the process designers use to obtain data that can be used to revise their instruction to make it more efficient and effective. The emphasis in formative evlauation is on the collection and analysis of data and the revision of the instruction" (p. 284-285).
Using the lesson you have described in the IDA on lesson design, complete the Formative Evaluation Planning Worksheet. Using the table below, describe:
- Who will do the ongoing evaluation;
- What is being evaluated;
- When the evaluation should occur; and
- How the evaluation will be conducted (i.e. tools you will use)
Be sure to refer to Dick, Carey, and Carey Chapter 10 for specific information that can be gathered from experts (e.g. subject-matter, learning, and learner) and learners in different formative evaluation situations (e.g. one-to-one, small-group, and field trials).
Formative Evaluation Planning Worksheet
Write the instructional objectives of your lesson here (it can be more than one):
Your final response:
SWBAT identify media center materials by using the OPAC's Subject/Keyword search function.
SWBAT generate a list of titles pertaining to a specific subject/keyword.
SWBAT demonstrate understanding by pulling the identified materials from the media center shelves.
The instructor's feedback to this step:
No specific feedback given on this step.
Write your objective using the correct form. Click here for advice on writing objectives.
HTML formatting reminder: You can embed HTML tags directly in your responses. This will be help your buddies and the instructor view your information in a more readable fashion. For example, if you want a paragraph break somewhere, just enter <p>:
I will have the experts review the lesson on three levels:
<p>
1. content; 2. technical accuracy; 3. quality of instruction.
<p>
The content review will help ensure that no mistakes were made in the information provided to the learners.
Who |
What |
When |
How |
| Experts (subject-matter, learning, learner) |
Your final response:
The OPAC expert will review the lesson for content, technical accuracy, and quality of instruction. The content review will make sure that all information being presented is correct. The technical accuracy review will make sure that all steps/directions for searching Destiny and finding the desired material on shelves is correct. The quality of instruction review will decide if the instruction will be effective and efficient.
The SLMS(School Library Media Specialist) will review the lesson for content, technical accuracy, and quality of instruction. The content review will make sure that all information being presented is correct. The technical accuracy review will make sure that all steps/directions for searching Destiny and finding the desired material on shelves is correct. The quality of instruction review will decide if the instruction will be effective and efficient.
|
Your final response:
An appointment will be made with the OPAC expert to review the lesson before the small group evaluation occurs.
An appointment will be made with the SLMS to review the lesson before the small group evaluation occurs.
|
Your final response:
The OPAC expert will conduct an evaluation of the content and technical accuracy using a checklist. The quality of instruction will be evaluated by an interview. During the interview to evaluate instruction, a portion of time will be set aside to discuss the checklist used to evaluate the content and technical accuracy.
The SLMS will conduct an evaluation of the content and technical accuracy using a checklist. The quality of instruction will be evaluated by an interview. During the interview to evaluate instruction, a portion of time will be set aside to discuss the checklist used to evaluate the content and technical accuracy.
|
The instructor's feedback to this step:
No specific feedback given on this step. |
| Learners: one-to-one |
Your final response:
Three students will be selected for the evaluation of the "learnability" of the lesson. Students will be selected based on their prior knowledge and use of Destiny. Students will be selected from 5th grade and have a variety of experience using Destiny from novice to expert.
Three students will be selected for the evaluation of the "learnability" of the lesson. Students will be selected based on their prior knowledge and use of Destiny. Students will be from a variety of grade levels and have a variety of experience using Destiny from novice to expert.
|
Your final response:
The evaluation will occur after the expert has reviewed the lesson and problem areas have been revised.
The evaluation will occur after the expert has reviewed the lesson and problem areas have been revised.
|
Your final response:
The designer will observe each student as they work through the lesson. The designer will take note of areas that appear to be confusing to students and questions that students ask, while also helping to clear up question and help students complete the lesson. At the end of the lesson, an interview will be conducted with each student to answer questions and clarify information.
The designer will observe each student as they work through the lesson. The designer will take note of areas that appear to be confusing to students and questions that students ask, while also helping to clear up question and help students complete the lesson. At the end of the lesson, an interview will be conducted with each student to answer questions and clarify information.
|
The instructor's feedback to this step:
No specific feedback given on this step. |
| Learners: small-group |
Your final response:
A small group of 5-6 students will be chosen to evaluate the "learnability" of the lesson. The students will be selected from a group that closely matches the target audience of the lesson meeting the prerequisites of the unit. The small group will work through the lesson with no help from the designer.
A small group of 5-6 students will be chosen to evaluate the "learnability" of the lesson. The students will be selected from a group that closely matches the target audience of the lesson meeting the prerequisites of the unit. The small group will work through the lesson with no help from the designer.
|
Your final response:
The small group evaluation will occur after the one-on-one evaluation. Before the small group evaluation, all modification deemed necessary by the one-on-one and expert evaluation will be completed.
The small group evaluation will occur after the one-on-one evaluation. Before the small group evaluation, all modification deemed necessary by the one-on-one and expert evaluation will be completed.
|
Your final response:
The designer will conduct an evaluation by observing during the lesson and noting areas of concern and student questions. After the lesson, the designer will interview students and make note of responses and questions to further improve instruction.
The designer will conduct an evaluation by observing during the lesson and noting areas of concern and student questions. After the lesson, the designer will interview students and make note of responses and questions to further improve instruction.
|
The instructor's feedback to this step:
No specific feedback given on this step. |
| Learners: field trial |
Your final response:
A class of 20 elementary students will be evaluating the "learnability" of the instruction. In this evaluation, student's mastery of the objective of the lesson based on the latest version of the instruction will be evaluated.
A class of 20 elementary students will be evaluating the "learnability" of the instruction. In this evaluation, student's mastery of the objective of the lesson based on the latest version of the instruction will be evaluated.
|
Your final response:
This evaluation will occur during the a classes scheduled time in the media center. The evaluation will occur after the small group evaluation and all modifications deemed necessary have been completed.
This evaluation will occur during the a classes scheduled time in the media center. The evaluation will occur after the small group evaluation and all modifications deemed necessary have been completed.
|
Your final response:
After the final evaluation, a variety of students will be pulled for interviews to evaluate the instruction. The SLMS that taught the lesson will be asked to write a reflection on the instruction and will also be interviewed. During the instruction the designer will observe the instruction. At the end of the instruction, students will be given keyword/subjects to use to search for material in the media center using Destiny. Students will find the material in the media center and have the teacher/SLMS check off each item. Completion of the keyword/subject search will demostrait mastery of the content.
After the final evaluation, a variety of students will be pulled for interviews to evaluate the instruction. The SLMS that taught the lesson will be asked to write a reflection on the instruction and will also be interviewed. During the instruction the designer will observe the instruction. At the end of the instruction, students will be given keyword/subjects to use to search for material in the media center using Destiny. Students will find the material in the media center and have the teacher/SLMS check off each item. Completion of the keyword/subject search will demostrait mastery of the content.
|
The instructor's feedback to this step:
No specific feedback given on this step. |
|