Overall Instructor Rating: Satisfactory
Ratings explanation:
- Exemplary - A model answer in almost every way (this is given out very rarely).
- Satisfactory - Very well done; you've met the expectations of the assignment. There are some minor problems, so read my feedback well.
- Marginal Pass - You pass, but there are lots of issues to consider. Read my feedback very carefully and be sure you understand the points/issues I raise.
- Not satisfactory, redo and resubmit - The assignment was not completed appropriately. I am concerned that you do not understand the process well enough yet. To get credit for the assignment, you need to redo it, most probably on another topic. Read and consider my feedback very carefully before redoing.
Instructor's Overall Feedback:
You've done an excellent job on this IDA. For the most part, you seem to really "get it" about how this process works.
I was especially impressed with your breakdown of specific experts you would use to review your instruction. This looks very logical and practical. You were also crystal clear about the purpose of the When sections and how that aspect of the planning fits together (with one exception in your wording - see below).
Here are a few notes for you to consider:
1) In the When aspect of the one-to-one phase, you used the phrase "after the initial instruction has been conceptualized." I was puzzled by your use of the word "conceptualized" here, because of course the instruction has already been through the expert review process at this point and would have been further developed based on that process. So while the instruction is not finished at this stage, it should be way beyond merely being conceptualized.
As I said above, all of your other "when" information seems very clear.
2) The What section of the last two stages has further Who information (which is good to include, and I note the varied exposure to the topic you have aimed to include among the learners) but no What information - what will be evaluated?
3) In your small group and field trial phases you have great plans for receiving feedback, but you have forgotten to include assessment of learning. Along with feedback about the *experience* of learning, also collect data on student mastery of the instructional goal. This point was probably assumed in your thinking all along, but it needs to be specified: will you use, for example, a rubric?
That's it - it was a pleasure reading your IDA, and other than the points above you are in really good shape. I hope you find this feedback helpful.
Greg
The objective of this activity is to plan for the formative evaluation of your instruction. As stated by Dick, Carey, and Carey (2001): "Formative evaluation is the process designers use to obtain data that can be used to revise their instruction to make it more efficient and effective. The emphasis in formative evlauation is on the collection and analysis of data and the revision of the instruction" (p. 284-285).
Using the lesson you have described in the IDA on lesson design, complete the Formative Evaluation Planning Worksheet. Using the table below, describe:
- Who will do the ongoing evaluation;
- What is being evaluated;
- When the evaluation should occur; and
- How the evaluation will be conducted (i.e. tools you will use)
Be sure to refer to Dick, Carey, and Carey Chapter 10 for specific information that can be gathered from experts (e.g. subject-matter, learning, and learner) and learners in different formative evaluation situations (e.g. one-to-one, small-group, and field trials).
Formative Evaluation Planning Worksheet
Write the instructional objectives of your lesson here (it can be more than one):
Your final response:
Given the need to find subject-matter media related the the curriculum, the SWBAT effectively search how to use the GPS search function within United Streaming to locate materials for classroom instruction.
The instructor's feedback to this step:
No specific feedback given on this step.
Write your objective using the correct form. Click here for advice on writing objectives.
HTML formatting reminder: You can embed HTML tags directly in your responses. This will be help your buddies and the instructor view your information in a more readable fashion. For example, if you want a paragraph break somewhere, just enter <p>:
I will have the experts review the lesson on three levels:
<p>
1. content; 2. technical accuracy; 3. quality of instruction.
<p>
The content review will help ensure that no mistakes were made in the information provided to the learners.
Who |
What |
When |
How |
| Experts (subject-matter, learning, learner) |
Your final response:
The experts will evaluate the lesson based on:
- Accuracy and currency of directions
- Content
- Learning outcome
Subject-matter: The MS will contact an instructor with ETTC. This person should be familiar with United Streaming.
Learning: The MS will ask another MS or Technology specialist to review the lesson. Typically, these experts have instructed adults using United Streaming.
Learner: The MS will contact an adult learning expert within the district (an Instructional Coach, Professional Development Coordinator, etc.) to review the appropriateness of the material as it relates to adult learners.
The review by experts will make sure that mistakes made in technical directions on the United Streaming website are corrected. It will also ensure that the learning outcome is enhanced by the instruction. The experts will be able to provide suggestions for improving the effectiveness and efficiency of the instruction for adult learners.
The experts will evaluate the lesson based on:
- Accuracy and currency of directions
- Content
- Learning outcome
The review by experts will make sure that mistakes made in technical directions on the United Streaming website. It will also ensure that the learning outcome is enhanced by the instruction. The SME will be able to provide suggestions for improving the effectiveness and efficiency of the instruction.
|
Your final response:
Ideally, this will be done as soon as the instruction has been developed initially. The review by the Subject Matter Specialist will occur first, followed by the Learning Specialist and then the Learner Specialist. Revisions will be done between each evaluation in order to prepare for the one-on-one evaluation.
Ideally, this will be done as soon as the instruction has been developed initially. We would like to be able to revise instruction prior to presenting it to learner groups.
|
Your final response:
The expert will review instruction using a checklist while going through a simulation of the instruction. Experts will also be encouraged to add comments and suggestions about how to better the instruction.
The expert will review instruction using a checklist while going through a simulation of the instruction. Experts will also be encouraged to add comments and suggestions about how to better the instruction.
|
The instructor's feedback to this step:
No specific feedback given on this step. |
| Learners: one-to-one |
Your final response:
Three learners will be selected to complete the instruction. Each will evaluate the learnability of the lesson based on how well the objective has been achieved. Each of the learners will have varying degrees of experience with United Streaming (novice, intermediate, advanced).
Three learners will be selected to complete the instruction. Each will evaluate the learnability of the lesson based on how well the objective has been achieved. Each of the learners will have varying degrees of experience with United Streaming (novice, intermediate, advanced).
|
Your final response:
The one-on-one instruction will occur after the initial instruction has been conceptualized.
The one-on-one instruction will occur after initial instruction has reached after the initial instruction has been conceptualized.
|
Your final response:
The instructional designer will sit with the learner while they attempt to complete the instructional objective. The designer will discuss the learner's difficulties and perceptions of the instruction. The designer will also ask for feedback for improving instruction.
The instructional designer will sit with the learner while they attempt to complete the instructional objective. The designer will discuss the learner's difficulties and perceptions of the instruction. The designer will also ask for feedback for improving instruction.
|
The instructor's feedback to this step:
No specific feedback given on this step. |
| Learners: small-group |
Your final response:
A small group of 5-8 learners will be selected to represent the target population (teachers) of learners to evaluate this lesson. Each of the learners will have varied experience with using United Streaming.
A small group of 5-8 learners will be selected to represent the target population (teachers) of learners to evaluate this lesson. Each of the learners will have varied experience with using United Streaming.
|
Your final response:
The small group evaluation will evaluate after a prototype has been created for the lesson.
The small group evaluation will evaluate after a prototype has been created for the lesson.
|
Your final response:
The instructor will administer the instruction in the same manner as its intended use. Each member of the small group of learners will assess the instruction on their own and then discuss as a group. The instructor can ask additional questions if necessary to gain insight on how to improve instruction.
The instructor will administer the instruction in the same manner as its intended use. Each member of the small group of learners will assess the instruction on their own and then discuss as a group. The instructor can ask additional questions if necessary to gain insight on how to improve instruction.
|
The instructor's feedback to this step:
No specific feedback given on this step. |
| Learners: field trial |
Your final response:
The Field trial learning group will consist of approximately 10-25 learners who represent the target population. Each learner will have varying levels of experience with using United Streaming.
The Field trial learning group will consist of approximately 10-25 learners who represent the target population. Each learner will have varying levels of experience with using United Streaming.
|
Your final response:
The field test will occur after the design and revision of the lesson is complete.
The field test will occur after the design and revision of the lesson is complete.
|
Your final response:
The field trial will simulate the real conditions of the learning environment. This instruction is intended to be used by the teacher on his/her own classroom computer. Each learner will go through the lesson using his or her own equipment. They will then fill out a questionnaire about how the objective was met by the instruction.
The field trial will simulate the real conditions of the learning environment. This instruction is intended to be used by the teacher on his/her own classroom computer. Each learner will go through the lesson using his or her own equipment. They will then fill out a questionnaire about the objective was met by the instruction.
|
The instructor's feedback to this step:
No specific feedback given on this step. |
|