Overall Instructor Rating: Satisfactory
Ratings explanation:
- Exemplary - A model answer in almost every way (this is given out very rarely).
- Satisfactory - Very well done; you've met the expectations of the assignment. There are some minor problems, so read my feedback well.
- Marginal Pass - You pass, but there are lots of issues to consider. Read my feedback very carefully and be sure you understand the points/issues I raise.
- Not satisfactory, redo and resubmit - The assignment was not completed appropriately. I am concerned that you do not understand the process well enough yet. To get credit for the assignment, you need to redo it, most probably on another topic. Read and consider my feedback very carefully before redoing.
Instructor's Overall Feedback:
Overall, I think this is good. There is some ambiguity with regard to the conditions of the objective and the criteria for selecting one-to-one learners.
Just as a general note to 6170 students that in your IDA’s, keep in mind that the Dick and Carey model asks us to make revisions at each step in the formative evaluation process, before continuing to the next step. (We realize that you may not do this for your team project because of the limitations of the assignment.)
The objective of this activity is to plan for the formative evaluation of your instruction. As stated by Dick, Carey, and Carey (2001): "Formative evaluation is the process designers use to obtain data that can be used to revise their instruction to make it more efficient and effective. The emphasis in formative evlauation is on the collection and analysis of data and the revision of the instruction" (p. 284-285).
Using the lesson you have described in the IDA on lesson design, complete the Formative Evaluation Planning Worksheet. Using the table below, describe:
- Who will do the ongoing evaluation;
- What is being evaluated;
- When the evaluation should occur; and
- How the evaluation will be conducted (i.e. tools you will use)
Be sure to refer to Dick, Carey, and Carey Chapter 10 for specific information that can be gathered from experts (e.g. subject-matter, learning, and learner) and learners in different formative evaluation situations (e.g. one-to-one, small-group, and field trials).
Formative Evaluation Planning Worksheet
Write the instructional objectives of your lesson here (it can be more than one):
Your final response:
Given the questions about the situations of connecting a elecrticity service on the web,
LWBAT demonstrate the process of connecting a electricity service by checking on the right answer without assistance
The instructor's feedback to this step:
I think this could be clearer with some minor wording adjustments. Does "the questions about the situations of..." refer to specific case studies or models that you will give learners? If so, you could just replace that portion of the objective with that wording.
Are these models web-based or does the student activity occur on the web?
Will learners demonstrate the process by checking the right answers or will they demonstrate the process and also check their answers without assistance?
Write your objective using the correct form. Click here for advice on writing objectives.
HTML formatting reminder: You can embed HTML tags directly in your responses. This will be help your buddies and the instructor view your information in a more readable fashion. For example, if you want a paragraph break somewhere, just enter <p>:
I will have the experts review the lesson on three levels:
<p>
1. content; 2. technical accuracy; 3. quality of instruction.
<p>
The content review will help ensure that no mistakes were made in the information provided to the learners.
Who |
What |
When |
How |
| Experts (subject-matter, learning, learner) |
Your final response:
The experts will have the experts review the lesson on three levels:
1.content
2.technical accuracy
3.quality of instruction.
The content review will help ensure that no mistakes were made in the information provided to the learners connecting a electricity service.
The technical accuracy review will enable us to know if we have errors in directions for getting to reference web-site, errors with graphics and flash files, etc.
Finally, the quality of instruction review will let us know if the instruction is as effective and efficient as possible.
|
Your final response:
Expert peer review will be condcuted at least 1-2 weeks prior to instructional implementation of lesson, in order to allow time for instructor modification and revision based on expert feedback. Therefore, expert feedback will occur during the early developmental stage of lesson design. (Expert feedback should also precede learner feedback.)
|
Your final response:
All reviews will be conducted through the use of checklists, questionnaires, and interviews.
At least one expert for each review will be needed for follow-up interview.
Checklists will be provided to give the experts' directions to guide the review.
|
The instructor's feedback to this step:
This is good. Could even be more specific about who your experts are. In the "what" column, you should see yourself as a designer, so the statement "The experts will have the experts review the lesson on three levels" should state "The designer will have the experts..." |
| Learners: one-to-one |
Your final response:
Three sample learners will be selected for the evaluation of the "learnability" of the instruction.
The learners will be selected based on their level of regarding reading Ability in English: novice with TOEFL score 500, average with TOEFL score 550, and experienced with TOEFL Score 600.
|
Your final response:
The one-on-one learner sessions will occur as soon as the subject matter experts have completed the Content, Technical, and Quality of Instruction Reviews.
|
Your final response:
All reviews will be conducted through the use of observation, semi-structured interviews.
The designer will sit with each learner as the learners go through the instruction, marking areas in the instruction where it appears to be confusing, answering questions the learners pose as they complete the instruction.
A semi-structured interview will be conducted after each learner has gone through the instruction to answer any questions and to clarify any information.
|
The instructor's feedback to this step:
The one-to-one learners should be selected based on their knowledge of the subject (connecting an electricity service) and should be representative of your final target audience. Reading ability will be important, but will your entire target audience have TOEFL scores or will they be expected to have a certain reading level(s) in addition to a certain level of knowledge about the topic? |
| Learners: small-group |
Your final response:
The small-group learners will be evaluating the "learnability" of the instruction.
A group of 5-6 learners from the target audience will be selected for this evaluation.
|
Your final response:
The small-group learners' session will occur after the subject matter expert reviews, and after the one-on-one reviews. The small group session will occur after the prototypes of the instruction are created.
|
Your final response:
All reviews will be conducted through the use of observation, interviews.
For the most part, Small group learners' session will follow the same format as one-to-one learners's session. However, posttests and post-instruction interviews will be of greater importance as we try to revise the instruction one last time before the field trial.
|
The instructor's feedback to this step:
Good. |
| Learners: field trial |
Your final response:
The learners in the field trial will be evaluating the "learnability" of the instruction.
The learners in the field test will be 30 learners who will be using the instruction once it is completed.
|
Your final response:
The learners in the field trial will occur a few days prior to actual instructional implementation of lesson, in order to allow time for last-minute instructor revision.
This is the final step of formative evaluation prior to implementation of instruction.
|
Your final response:
The field trial will take place in the actual setting with actual learners.
As with the small group, Posttests and post interviews interview will be conducted to make an assessment of the instruction.
Questionnaires will be provided as needed.
|
The instructor's feedback to this step:
Good. |
|