Overall Instructor Rating: Satisfactory
Ratings explanation:
- Exemplary - A model answer in almost every way (this is given out very rarely).
- Satisfactory - Very well done; you've met the expectations of the assignment. There are some minor problems, so read my feedback well.
- Marginal Pass - You pass, but there are lots of issues to consider. Read my feedback very carefully and be sure you understand the points/issues I raise.
- Not satisfactory, redo and resubmit - The assignment was not completed appropriately. I am concerned that you do not understand the process well enough yet. To get credit for the assignment, you need to redo it, most probably on another topic. Read and consider my feedback very carefully before redoing.
Instructor's Overall Feedback:
Overall, you did a good job in this IDA. I did have a few concerns with some of your categories though:
How will you determine who is an average, novice, and experienced learner for your one-to-one evaluation?
Your sample of learners for the small group evaluation is too small. Dick, Carey and Carey say a minimum of 8 should be used or else your data will not be representative (page 292).
You may also want to evaluate the cost of instruction, feasability, attituedes of those implementing the instruction, time constraints, etc. during the small group analysis. Remember, the small group instruction is the first time your course is being conducted without several pauses to review clarity, applicability, and other factors with individual learners. If you decide to evaluate these aspects of instruction, how will you collect the information
In the field trial, you want to have as many participants as would take part in the actual instruction. Are you only planning to have 10-12 learners at a time? You also refer to "several other evaluation methods" that will be used after the trial. What are these methods?
The objective of this activity is to plan for the formative evaluation of your instruction. As stated by Dick, Carey, and Carey (2001): "Formative evaluation is the process designers use to obtain data that can be used to revise their instruction to make it more efficient and effective. The emphasis in formative evlauation is on the collection and analysis of data and the revision of the instruction" (p. 284-285).
Using the lesson you have described in the IDA on lesson design, complete the Formative Evaluation Planning Worksheet. Using the table below, describe:
- Who will do the ongoing evaluation;
- What is being evaluated;
- When the evaluation should occur; and
- How the evaluation will be conducted (i.e. tools you will use)
Be sure to refer to Dick, Carey, and Carey Chapter 10 for specific information that can be gathered from experts (e.g. subject-matter, learning, and learner) and learners in different formative evaluation situations (e.g. one-to-one, small-group, and field trials).
Formative Evaluation Planning Worksheet
Write the instructional objectives of your lesson here (it can be more than one):
Your final response:
LWBAT demonstrate basic features of Lotus Notes email program by reviewing, composing, sending, saving and deleting email.
The instructor's feedback to this step:
No specific feedback given on this step.
Write your objective using the correct form. Click here for advice on writing objectives.
HTML formatting reminder: You can embed HTML tags directly in your responses. This will be help your buddies and the instructor view your information in a more readable fashion. For example, if you want a paragraph break somewhere, just enter <p>:
I will have the experts review the lesson on three levels:
<p>
1. content; 2. technical accuracy; 3. quality of instruction.
<p>
The content review will help ensure that no mistakes were made in the information provided to the learners.
Who |
What |
When |
How |
| Experts (subject-matter, learning, learner) |
Your final response:
We will have the experts review the lesson for three characteristics:
1. content 2. technical accuracy 3. quality of instruction
1. The content review will be made in order to ensure there are no mistakes in our Lotus Notes presentation and additional handout material. This review will be conducted by several Local School Technology Coordinators. It will make certain our presentation and materials are not missing any steps from the emailing process teachers will follow in and out of class.
2. The technical accuracy review will be conducted by several local TST employees. It will enable us to make sure there are no errors in our materials concerning Power Point, Lotus Notes, Screen Cam videos, and local network access. This review will help our workshop run smoothly and without interruption due to any technical difficulties.
3. The quality of instruction will be reviewed by current in-service teachers in the county. The review will make sure our instruction is effective as possible throughout our workshop.
|
Your final response:
The review of content and technical accuracy will be reviewed several weeks before the workshop is taught to the first group of teachers. This will allow time for any needed modification to be completed. The quality of instruction review or evaluation will be made towards the end of the workshop. This will allow the experts to see a majority of the material presented.
|
Your final response:
The content and technical accuracy reviews will be conducted by short surveys and interviews with the experts. The quality of instruction expert reviews will consist of informal evaluation and interviews. These methods of review will allow for plenty of feedback from the experts.
|
The instructor's feedback to this step:
No specific feedback given on this step. |
| Learners: one-to-one |
Your final response:
Three sample participates will be selected for the evaluation of the "learnability" of the instruction. The learners will be selected based on their level of prior knowledge regarding computers: novice, average, experienced.
|
Your final response:
The one-on-one workshops will take place in the local school computer lab. Participate and instructor will work through the lessons together. This will happen after the experts have reviewed the material and potential problems have already been addressed. Depending on the teacher’s schedule, the workshop should only take a couple of weeks.
|
Your final response:
The instructor will go through the lesson with each participate. The instructor will take notes on any parts the participate finds unclear or confusing. Additional notes will also be taken on the participant’s prior computer knowledge. After completing the lesson, each participate will be interviewed to answer any further questions and gain feedback on the success of the lesson.
|
The instructor's feedback to this step:
No specific feedback given on this step. |
| Learners: small-group |
Your final response:
Five to six sample participants will be selected for the evaluation of the "learnability" of the instruction in small groups. We will select the learners based on their level of prior knowledge regarding computers: novice, average, experienced.
|
Your final response:
The small group session will take place after the necessary changes are made from the expert’s reviews and all the one-on-one sessions.
|
Your final response:
Several means of evaluation throughout the small group sessions: observations, checklists, written evaluations, and follow-up interviews. We will use these evaluations to measure the success of the session and to determine if the objective was mastered.
|
The instructor's feedback to this step:
No specific feedback given on this step. |
| Learners: field trial |
Your final response:
Ten to twelve participants will be selected for the evaluation of the “learnability” of instruction in the field test. These participates will be our “target audience” consisting of a variety Gwinnett County High School Teachers.
|
Your final response:
The field trial will be conducted after the expert’s review, one-on-one session, and small group session. Using the gathered information from these sessions, the instructional materials should be revised and ready for instruction.
|
Your final response:
The field trial evaluation will take place in the computer lab of a Gwinnett County Public High School with a small group of teachers. Hands-on lesson assessment will be evaluated at the end of the session for mastery of the content. Several other evaluation methods will also be used at the end of the session.
|
The instructor's feedback to this step:
No specific feedback given on this step. |
|