Overall Instructor Rating: Satisfactory
Ratings explanation:
- Exemplary - A model answer in almost every way (this is given out very rarely).
- Satisfactory - Very well done; you've met the expectations of the assignment. There are some minor problems, so read my feedback well.
- Marginal Pass - You pass, but there are lots of issues to consider. Read my feedback very carefully and be sure you understand the points/issues I raise.
- Not satisfactory, redo and resubmit - The assignment was not completed appropriately. I am concerned that you do not understand the process well enough yet. To get credit for the assignment, you need to redo it, most probably on another topic. Read and consider my feedback very carefully before redoing.
Instructor's Overall Feedback:
Good overall -- you seem to understand the fundamentals of formative evaluation. However, I have some suggestions about your formative evaluation plan, so please read that feedback below carefully.
The objective of this activity is to plan for the formative evaluation of your instruction. As stated by Dick, Carey, and Carey (2001): "Formative evaluation is the process designers use to obtain data that can be used to revise their instruction to make it more efficient and effective. The emphasis in formative evlauation is on the collection and analysis of data and the revision of the instruction" (p. 284-285).
Using the lesson you have described in the IDA on lesson design, complete the Formative Evaluation Planning Worksheet. Using the table below, describe:
- Who will do the ongoing evaluation;
- What is being evaluated;
- When the evaluation should occur; and
- How the evaluation will be conducted (i.e. tools you will use)
Be sure to refer to Dick, Carey, and Carey Chapter 10 for specific information that can be gathered from experts (e.g. subject-matter, learning, and learner) and learners in different formative evaluation situations (e.g. one-to-one, small-group, and field trials).
Formative Evaluation Planning Worksheet
Write the instructional objectives of your lesson here (it can be more than one):
Your final response:
SWBAT demonstrate basic video editing procedures.
The instructor's feedback to this step:
Good, but I think you know I prefer objectives to be more specific.
Write your objective using the correct form. Click here for advice on writing objectives.
HTML formatting reminder: You can embed HTML tags directly in your responses. This will be help your buddies and the instructor view your information in a more readable fashion. For example, if you want a paragraph break somewhere, just enter <p>:
I will have the experts review the lesson on three levels:
<p>
1. content; 2. technical accuracy; 3. quality of instruction.
<p>
The content review will help ensure that no mistakes were made in the information provided to the learners.
Who |
What |
When |
How |
| Experts (subject-matter, learning, learner) |
Your final response:
Subject matter experts will review the lesson on three levels:
1. content and accuracy
2. planning and organization
3. quality of instruction.
|
Your final response:
Subject matter experts will review the instruction in a practice/test session and provide feedback.
|
Your final response:
SME’s will take notes of observations during instructional practice session and provide both reflective narrative assessment and answer a checklist of questions regarding the content, approach, and delivery of the instruction.
|
The instructor's feedback to this step:
Good. |
| Learners: one-to-one |
Your final response:
3 sample learners (novice, average, experienced) will be observed in order to assess objective performance of both the instruction and the learner. They will also review their subjective experience of the instruction.
Observation will assess problem and success areas for attainment of the objectives of the lesson.
Questionnaires will ask the learners to evaluate the quality and pace of the instruction, provide feedback about problems and successes, and to assess their own attainment of the objectives of the lesson.
|
Your final response:
Sample learners will be observed by both the designer and SME’s in the test sessions and immediately afterwards will be interviewed.
|
Your final response:
The designer and SME’s will observe each sample learner, documenting learner’s problems, questions and successes, as well as the overall flow and pace of the instruction and attainment of objectives.
Learner assignments will be evaluated for attainment of the objectives of the lesson according to pre-defined criteria.
Learners will complete a questionnaire after the lesson is complete. Feedback will be incorporated into the prototype.
|
The instructor's feedback to this step:
Good. It's ambiguous how you will assess for "attainment of the objectives", however. What evaluation method will you use for this? |
| Learners: small-group |
Your final response:
Five to six sample learners representing the target audience for the instruction will be observed in a similar setting to the planned instruction. The emphasis will be on reviewing the pacing of the instruction in a larger group setting to be sure that all material is covered given the additional needs of multiple users in a hands-on computer lab setting.
|
Your final response:
The instructional pace will be observed by the designer / instructor.
|
Your final response:
The designer / instructor will note pacing issues, particularly for providing hands-on support to individual students, document, and revise the instructional plan as necessary,
|
The instructor's feedback to this step:
You don't mention anything about assessing the students' learning (according to the objectives) here. This is important. |
| Learners: field trial |
Your final response:
Test sessions will be held for full-size classes of target learners in the actual setting where instruction will typically be delivered. Pacing and refinement of instruction will continue to be an emphasis for the purposes of determination about additional support for larger group in computer-lab setting and fine-tuning of processes to ensure completion of all planned tasks.
|
Your final response:
The field test will incorporate SME observers, designer/instructor reflection, and learner post-instructional questionnaire.
|
Your final response:
SME’s will take notes of observations during instructional practice sessions and provide both reflective narrative assessment and answer the same checklist of questions regarding the content, approach, and delivery of the instruction as in the initial observation for the purposes of comparative assessment.
Learners will complete the same post-instructional questionnaire as in the one-on-one evaluation for comparative assessment.
Designer/instructor will note issues for correction and develop a final plan for addressing and incorporating changes into the lesson plan.
|
The instructor's feedback to this step:
Same feedback here too -- you need to be precise in how you will assess the learning objectives. |
|