Overall Instructor Rating: Exemplary
Ratings explanation:
- Exemplary - A model answer in almost every way (this is given out very rarely).
- Satisfactory - Very well done; you've met the expectations of the assignment. There are some minor problems, so read my feedback well.
- Marginal Pass - You pass, but there are lots of issues to consider. Read my feedback very carefully and be sure you understand the points/issues I raise.
- Not satisfactory, redo and resubmit - The assignment was not completed appropriately. I am concerned that you do not understand the process well enough yet. To get credit for the assignment, you need to redo it, most probably on another topic. Read and consider my feedback very carefully before redoing.
Instructor's Overall Feedback:
You did an excellent job here. You seem to understand the process very well.
The objective of this activity is to plan for the formative evaluation of your instruction. As stated by Dick, Carey, and Carey (2001): "Formative evaluation is the process designers use to obtain data that can be used to revise their instruction to make it more efficient and effective. The emphasis in formative evlauation is on the collection and analysis of data and the revision of the instruction" (p. 284-285).
Using the lesson you have described in the IDA on lesson design, complete the Formative Evaluation Planning Worksheet. Using the table below, describe:
- Who will do the ongoing evaluation;
- What is being evaluated;
- When the evaluation should occur; and
- How the evaluation will be conducted (i.e. tools you will use)
Be sure to refer to Dick, Carey, and Carey Chapter 10 for specific information that can be gathered from experts (e.g. subject-matter, learning, and learner) and learners in different formative evaluation situations (e.g. one-to-one, small-group, and field trials).
Formative Evaluation Planning Worksheet
Write the instructional objectives of your lesson here (it can be more than one):
Your final response:
After exploring an EPA interactive website simulator, students will be able to genreate a poster display providing solutions for how the virtual city, "Dumptown" can efficiently and effectively reduce waste.
The instructor's feedback to this step:
This has all the elements of a well written objective. Nice Job.
Write your objective using the correct form. Click here for advice on writing objectives.
HTML formatting reminder: You can embed HTML tags directly in your responses. This will be help your buddies and the instructor view your information in a more readable fashion. For example, if you want a paragraph break somewhere, just enter <p>:
I will have the experts review the lesson on three levels:
<p>
1. content; 2. technical accuracy; 3. quality of instruction.
<p>
The content review will help ensure that no mistakes were made in the information provided to the learners.
Who |
What |
When |
How |
| Experts (subject-matter, learning, learner) |
Your final response:
Three experts will review the lesson design on three levels: 1. Content2. Technical accuracy3. Quality of instruction. The experts will consist of one regular education 4th grade teacher, one teacher with a science degree, and one School Technology Coordinator. The content review will help ensure that no mistakes were made in the information provided to the learners. More specifically, they will make sure the steps in the lesson are easy to follow and make sense so students understand how to play, “Dumptown”. The technical accuracy review will let the designer know if there are errors with the directions for playing, “Dumptown”. For example, when learners select to implement recycling programs for the town, the city budget change should be reflected. Finally, the quality of instruction review will let us know if the instruction is clear to learners and helpful to reaching the target objective. To aid in this evaluation process, each expert will be given a detailed lesson plan with easy to follow steps. Also, included will be a printed set of an introduction to the virtual city of , “Dumptown” and it’s environmental problems, directions for how to play “Dumptown”, and a sample poster display made by the lesson designer.
|
Your final response:
The 3 experts will have time slots planned for their reviews one week prior to conducting small group evaluations with learners and two weeks prior to the field trial.
|
Your final response:
The review will be conducted through a questionnaire, checklists, and interviews with the experts. The questionnaire will ask the experts questions on how easy the steps were to follow and what their opinions are of the lesson. The checklists will be provided for the experts to guide their review. The checklists will include all of the basic steps students will follow, plus additional space for comments. The interviews will take place after the instruction trial is completed. Feedback will be gathered from the interviews to assess possible problems encountered and how the lesson could be improved before one-on-one evaluations.
|
The instructor's feedback to this step:
This is a very thorough job. I just want to remind you that the experts can simply make notes on the lesson plan, not fill out a pre-formed questionnaire. |
| Learners: one-to-one |
Your final response:
Three sample learners will be selected for the evaluation of the “learnability” of the instruction. The learners will be selected based on their level of prior knowledge regarding the subject: novice, average, experienced. These learners will help to identify and remove obvious errors in the instructions. The first sample learner will be a student chosen from the same grade level, but a different instructor’s class. Thus, this student should be familiar with the science topic on environmental studies, but not know too much (novice). There also will be a student selected from the instructor’s class that has been performing near the mean of the class on previous lessons regarding environmental science concepts (average). The third sample learner will be a student who is performing in the top 10% of the class on science assessments thus far in the unit (experienced).
|
Your final response:
The one-on-one sessions with the three target students will be conducted 2-3 days following the three experts completing their interviews with the instruction evaluator.
|
Your final response:
The following chosen assessments will help obtain initial performance indicators from the first real target learner. First, the designer will sit with each learner as they go through the lesson instruction. Next, the designer will make observations and keep notes in the instruction areas where learner’s are confused and/or have problems. The designer will answer questions the learners pose as they complete the instruction. An interview will also be conducted after each learner has gone through the instruction to answer any questions (feasibility of the instruction and impact on the learner) and to make clarifications.
|
The instructor's feedback to this step:
Good, this is well done. |
| Learners: small-group |
Your final response:
The small group of learners who will be evaluating the learnability of the instruction will be comprised of 6 students. Two of the students selected will be in the novice level (more description of levels mentioned above). Two more will be on the average level. The last two will be on the experienced level.
|
Your final response:
The small group session will be conducted 1-2 days after the one-to-one evaluation and will occur at least one week before the field test group in order to make any improvements needed.
|
Your final response:
Assessments of the small group of learners will involve an attitude questionnaire and having the designer write observation notes during the trial. The notes will be used to gain insight into how long it took the learners to complete tasks and how easy/hard they found the instruction tasks. Both assessment tools will identify any remaining learning problems that learners may have will determine if learners can use the instruction without interacting with the instructor.
|
The instructor's feedback to this step:
Good, this is well done. |
| Learners: field trial |
Your final response:
The learners in the field test will be 30 upper elementary students studying environmental science concepts. These 30 students will provide valuable feedback because they are the real learners of the instructional objective.
|
Your final response:
The field test will be conducted after all of the other evaluations have been administered and their assessments have been thoroughly examined in order to make revisions in the instructional plan.
|
Your final response:
The evaluation will take place in the classroom and the computer lab. To evaluate the field trial observation notes will be taken by the evaluator. These notes will allow the evaluator to see if each learner performed adequately and achieved the intended instructional goal. Then the evaluator will interview each learner individually to gain information on the learners' attitudes.
|
The instructor's feedback to this step:
Good, this is well done. |
|