Overall Instructor Rating: Satisfactory
Ratings explanation:
- Exemplary - A model answer in almost every way (this is given out very rarely).
- Satisfactory - Very well done; you've met the expectations of the assignment. There are some minor problems, so read my feedback well.
- Marginal Pass - You pass, but there are lots of issues to consider. Read my feedback very carefully and be sure you understand the points/issues I raise.
- Not satisfactory, redo and resubmit - The assignment was not completed appropriately. I am concerned that you do not understand the process well enough yet. To get credit for the assignment, you need to redo it, most probably on another topic. Read and consider my feedback very carefully before redoing.
Instructor's Overall Feedback:
Hi, Jami
Overall, you did a good job on this IDA. I think you understand the purpose of formative evaluation and have a clear and specific plan to conduct one. Since your instruction will be web-based, I think you might want to include “usability of technology” from both experts’ and learners’ perspectives as part of your formative evaluation along with “learnability.”
Keep up with the good work.
Please let me know if you have any questions.
Thanks.
Best,
Eun Jung
The objective of this activity is to plan for the formative evaluation of your instruction. As stated by Dick, Carey, and Carey (2001): "Formative evaluation is the process designers use to obtain data that can be used to revise their instruction to make it more efficient and effective. The emphasis in formative evlauation is on the collection and analysis of data and the revision of the instruction" (p. 284-285).
Using the lesson you have described in the IDA on lesson design, complete the Formative Evaluation Planning Worksheet. Using the table below, describe:
- Who will do the ongoing evaluation;
- What is being evaluated;
- When the evaluation should occur; and
- How the evaluation will be conducted (i.e. tools you will use)
Be sure to refer to Dick, Carey, and Carey Chapter 10 for specific information that can be gathered from experts (e.g. subject-matter, learning, and learner) and learners in different formative evaluation situations (e.g. one-to-one, small-group, and field trials).
Formative Evaluation Planning Worksheet
Write the instructional objectives of your lesson here (it can be more than one):
Your final response:
Using an ImageRight software simulation, SWBAT demonstrate basic functionality of the ImageRight Desktop as identified on the ICM for Unit 2 (open files, navigating, annotations, adding to the file, sending out of the file, finding tasks and handling tasks) either from the menu options or the speedbar with 80% accuracy on the first attempt.
The instructor's feedback to this step:
No specific feedback given on this step.
Write your objective using the correct form. Click here for advice on writing objectives.
HTML formatting reminder: You can embed HTML tags directly in your responses. This will be help your buddies and the instructor view your information in a more readable fashion. For example, if you want a paragraph break somewhere, just enter <p>:
I will have the experts review the lesson on three levels:
<p>
1. content; 2. technical accuracy; 3. quality of instruction.
<p>
The content review will help ensure that no mistakes were made in the information provided to the learners.
Who |
What |
When |
How |
| Experts (subject-matter, learning, learner) |
Your final response:
SME’s will evaluate the content of the instruction to ensure that the appropriate material will be covered to the extent necessary.
Learning specialist will review the lesson to ensure that the flow is logical and the lesson can be completed with the resources allocated.
Learner specialist will review the lesson to ensure that the material presented is applicable to their work environment.
SME’s will evaluate the content of the instruction to ensure that the appropriate material will be covered. Learning specialist will review the lesson to ensure that the flow is logical and the lesson can be completed with the resources allocated. Learner specialist will review the lesson to ensure that the material presented is applicable to their work environment.
|
Your final response:
The experts will review the lesson once the icm has been completed with objectives for each lesson. They will know the instructional strategy and have some examples from the lesson.
The experts will review the lesson once the icm has been completed with objectives for each lesson. They will know the instructional strategy and have some examples from the lesson.
|
Your final response:
Interviews will be used to gather data so that I, as the designer, can understand the rationale behind their critique how best I can incorporate their ideas into my instruction.
Interviews will be used to gather data so that I, as the designer, can understand the rationale behind their critique how best I can incorporate their ideas into my instruction.
|
The instructor's feedback to this step:
No specific feedback given on this step. |
| Learners: one-to-one |
Your final response:
In the one-to-one evaluation, glaring errors in the instruction should be identified. Learners should be able to evaluate the instruction based on clarity, impact and feasibility. Learners selected will have varying levels of pc skills and knowledge of ImageRight.
In the one-to-one evaluation glaring errors in the instruction should be identified. Learners should be able to evaluate the instruction based on clarity, impact and feasibility. Learners selected will have varying levels of pc skills and knowledge of ImageRight.
|
Your final response:
This evaluation will occur after the expert review when there are some initial examples developed that they can launch to get a feel for the overall instruction.
This evaluation will occur after the expert review when there are some initial examples developed that they can launch to get a feel for the overall instruction.
|
Your final response:
I will sit with the users as they go through the instruction and take notes on where they have questions or problems. I will answer any questions they have and coach them through the process.
I will sit with the users as they go through the instruction and take notes on where they have questions or problems. I will answer any questions they have and coach them through the process.
|
The instructor's feedback to this step:
No specific feedback given on this step. |
| Learners: small-group |
Your final response:
In the small group evaluation I will be able to see if the instruction is able to stand on its own. In particular the technical distribution of the files, the programming of the lesson and the reactions from the students will be noted. A representative sample of the target audience will be chosen for the small group evaluation.
In the small group evaluation I will be able to see if the instruction is able to stand on its own. In particular the technical distribution of the files, the programming of the lesson and the reactions from the students will be noted. A representative sample of the target audience will be chosen for the small group evaluation.
|
Your final response:
This evaluation will occur after I have made changes based on the one-to-one feedback sessions. I will need to have a functional prototype of the entire lesson for this phase.
This evaluation will occur after I have made changes based on the one-to-one feedback sessions. I will need to have a functional prototype of the entire lesson for this phase.
|
Your final response:
Since this instruction is online, the small group evaluation will be delivered electronically however it will be in the ImageRight office so that I can observe the learners and make notes of their actions. Instruction will be measured through pre-test, post-test and a survey that is distributed after completion of the instruction. I will also interview a poor performer, an average performer and an exceptional performer.
Since this instruction is online, the small group evaluation will be delivered electronically however it will be in the ImageRight office so that I can observe the learners and make notes of their actions. Instruction will be measured through pre-test, post-test and a survey that is distributed after completion of the instruction. I will also interview a poor performer, an average performer and an exceptional performer.
|
The instructor's feedback to this step:
No specific feedback given on this step. |
| Learners: field trial |
Your final response:
Every aspect of the instruction will be evaluated during the field test. Instructors will evaluate the ease of use while learners will be evaluating elements of the instruction such as concepts, understanding, motivation etc. Through the field test I will be able to evaluate effectiveness of the instruction.
Every aspect of the instruction will be evaluated during the field test. Instructors will evaluate the ease of use while learners will be evaluating elements of the instruction such as concepts, understanding, motivation etc. Through the field test I will be able to evaluate effectiveness of the instruction.
|
Your final response:
The field trial will be conducted near the end of the design process after the small group evaluation. A fully functional lesson will be developed for the field test.
The field trial will be conducted near the end of the design process after the small group evaluation. A fully functional lesson will be developed for the field test.
|
Your final response:
The instruction will take place in the real life context for which it was designed. Pre-Test post test and surveys will be used. I will also speak to the instructor for further feedback regarding the lesson and deployment.
The instruction will take place in the real life context for which it was designed. Pre-Test post test and surveys will be used. I will also speak to the instructor for further feedback regarding the lesson and deployment.
|
The instructor's feedback to this step:
No specific feedback given on this step. |
|