Overall Instructor Rating: Satisfactory
Ratings explanation:
- Exemplary - A model answer in almost every way (this is given out very rarely).
- Satisfactory - Very well done; you've met the expectations of the assignment. There are some minor problems, so read my feedback well.
- Marginal Pass - You pass, but there are lots of issues to consider. Read my feedback very carefully and be sure you understand the points/issues I raise.
- Not satisfactory, redo and resubmit - The assignment was not completed appropriately. I am concerned that you do not understand the process well enough yet. To get credit for the assignment, you need to redo it, most probably on another topic. Read and consider my feedback very carefully before redoing.
Instructor's Overall Feedback:
Very nice job on this IDA!
Your objective is well-formed and you have a lot of good content in the four phases. I especially like the fact that you included "amount of time this lesson takes" in your presentation of What will be evaluated at each phase - not many thought to include this.
Meantime, I have several other comments for you:
1) The When portions of your plan are intended to simply address the sequence of events for the overall process of formative evaluation. So the When of the Expert section could be re-worded, for example, to:
"The evaluation will occur as soon as the initial prototype of th lesson has been developed."
The other When portions can be adjusted along similar lines.
2) In the How portion of the One-to-One trial, I assume when you say "including an evaluation of the instruction" you mean an assessment of learning as opposed to evaluating usability. It's good you included this - some didn't - but you might want to reconsider the wording, since one should note that usability testing is also an evaluation of the instruction.
(And by the way, how will you accomplish "a strong rapport"?)
3) In the How portion of the Field Trial section, you forgot to include an assessment of learning - be sure you plan to assess learning as well as receiving other kinds of feedback.
Ok - that's my feedback for this IDA. I hope you find it helpful.
The objective of this activity is to plan for the formative evaluation of your instruction. As stated by Dick, Carey, and Carey (2001): "Formative evaluation is the process designers use to obtain data that can be used to revise their instruction to make it more efficient and effective. The emphasis in formative evlauation is on the collection and analysis of data and the revision of the instruction" (p. 284-285).
Using the lesson you have described in the IDA on lesson design, complete the Formative Evaluation Planning Worksheet. Using the table below, describe:
- Who will do the ongoing evaluation;
- What is being evaluated;
- When the evaluation should occur; and
- How the evaluation will be conducted (i.e. tools you will use)
Be sure to refer to Dick, Carey, and Carey Chapter 10 for specific information that can be gathered from experts (e.g. subject-matter, learning, and learner) and learners in different formative evaluation situations (e.g. one-to-one, small-group, and field trials).
Formative Evaluation Planning Worksheet
Write the instructional objectives of your lesson here (it can be more than one):
Your final response:
Teachers will be able to demonstrate how to download United Streaming videos they have identified through their searches and to access their videos after downloading.
The instructor's feedback to this step:
No specific feedback given on this step.
Write your objective using the correct form. Click here for advice on writing objectives.
HTML formatting reminder: You can embed HTML tags directly in your responses. This will be help your buddies and the instructor view your information in a more readable fashion. For example, if you want a paragraph break somewhere, just enter <p>:
I will have the experts review the lesson on three levels:
<p>
1. content; 2. technical accuracy; 3. quality of instruction.
<p>
The content review will help ensure that no mistakes were made in the information provided to the learners.
Who |
What |
When |
How |
| Experts (subject-matter, learning, learner) |
Your final response:
Who? Subject-matter expert
What? The instruction, the accuracy of the information provided, and the ease of which the student can apply the instruction are being evaluated.
Who? Learning specialist
What? The instruction related to what is known about hands-on computer learning.
|
Your final response:
The evaluation will occur after attempting to complete the lesson with the guidance of the trainer and the handout prior to the one-on-one evaluation.
After attempting to complete the lesson with the guidance of the trainer and the handout.
|
Your final response:
Informal conversation with the subject-matter expert and instructor notes (notes the instructor has taken throughout observing the subject-matter expert complete the lesson).
Informal conversation with learning specialist and instructor notes (notes the instructor has taken throughout observing the learning specialist complete the lesson).
|
The instructor's feedback to this step:
No specific feedback given on this step. |
| Learners: one-to-one |
Your final response:
The clarity of the information provided, the impact the lesson had, and the feasibility in which the learner can apply the information learned is being evaluated.
The instruction
|
Your final response:
The evaluation will occur after the lesson is completed with the few learners who are representative of the target population prior to the small-group evaluation, but after any suggestions or corrections have been made using the subject-matter expert’s feedback.
After the lesson is completed with the person.
|
Your final response:
Instructor notes throughout the lesson of how learners progress through the lesson and comments after the completion of the lesson from participants, including an evaluation of the instruction and the usability of the handout provided. A strong rapport will be the basis for these honest and constructive evaluations to ensure clarity, impact, and feasibility of the lesson.
Instructor notes throughout the lesson and comments after the completion of the lesson from participant.
|
The instructor's feedback to this step:
No specific feedback given on this step. |
| Learners: small-group |
Your final response:
Whether the 10-15 learners, selected as the small-group evaluators, can use the handout provided in the lesson without interacting with the instructor, the attitudes of the learners, the amount of time this lesson takes, and areas of improvement or confusion are being evaluated using this small-group of learners which represent the target population.
Whether the learners can use the handout provided in the lesson without interacting with the instructor.
|
Your final response:
Throughout the lesson, the instructor will take notes as to questions the small-group participants ask, the ease in which the participants go through the lesson, and the amount of time the lesson takes learners to complete. The instructor will also note the points of confusion and frustration participants’ experience. The instructor will intervene as little as possible, but will be available for questions and concerns throughout the lesson.
Throughout the lesson, the instructor will take notes as to questions the small-group participants ask and the ease in which the participants go through the lesson. The instructor will also note the points of confusion and frustration participants’ experience. A more formal evaluation will occur at the end of the lesson using a brief questionnaire.
|
Your final response:
Throughout the lesson, the instructor will make observations of the participants’ progression through the lesson. At the conclusion of the lesson, a brief questionnaire will be given to the small-group participants to assess participants’ attitudes, suggested improvements to the lesson or the delivery of the lesson, areas of confusion in the lesson, and the amount of time the lesson took to complete.
Observation and brief questionnaire
|
The instructor's feedback to this step:
No specific feedback given on this step. |
| Learners: field trial |
Your final response:
Learner achievement and attitudes, and the amount of time the lesson takes are all being evaluated in the field trail of approximately thirty teachers from various subject areas representing the target population.
Learner achievement and attitudes upon completion of the lesson.
|
Your final response:
Throughout and at the conclusion of the field trail, after all questions and concerns have been revised from the small-group evaluation piece.
Throughout and at the conclusion of the lesson.
|
Your final response:
Throughout the lesson, the instructor will make observations of the participants’ progression through the lesson. At the conclusion of the lesson, brief interviews will be conducted to assess participants’ attitudes of the lesson, how the lesson might be improved, the amount of time the lesson took, and the areas of transfer for the participant.
Throughout the lesson, the instructor will make observations of the participants’ progression through the lesson and at the conclusion; brief interviews will be conducted to assess participants’ view of the lesson, how the lesson might be improved, and the areas of transfer for the participant.
|
The instructor's feedback to this step:
No specific feedback given on this step. |
|