Overall Instructor Rating: Satisfactory
Ratings explanation:
- Exemplary - A model answer in almost every way (this is given out very rarely).
- Satisfactory - Very well done; you've met the expectations of the assignment. There are some minor problems, so read my feedback well.
- Marginal Pass - You pass, but there are lots of issues to consider. Read my feedback very carefully and be sure you understand the points/issues I raise.
- Not satisfactory, redo and resubmit - The assignment was not completed appropriately. I am concerned that you do not understand the process well enough yet. To get credit for the assignment, you need to redo it, most probably on another topic. Read and consider my feedback very carefully before redoing.
Instructor's Overall Feedback:
(Feedback given by Younghee Woo; concurred by Lloyd Rieber.)
You have done an excellent job with your formative evaluation plan. I have some suggestions for improving your plan, so please read that feedback below carefully.
The objective of this activity is to plan for the formative evaluation of your instruction. As stated by Dick, Carey, and Carey (2001): "Formative evaluation is the process designers use to obtain data that can be used to revise their instruction to make it more efficient and effective. The emphasis in formative evlauation is on the collection and analysis of data and the revision of the instruction" (p. 284-285).
Using the lesson you have described in the IDA on lesson design, complete the Formative Evaluation Planning Worksheet. Using the table below, describe:
- Who will do the ongoing evaluation;
- What is being evaluated;
- When the evaluation should occur; and
- How the evaluation will be conducted (i.e. tools you will use)
Be sure to refer to Dick, Carey, and Carey Chapter 10 for specific information that can be gathered from experts (e.g. subject-matter, learning, and learner) and learners in different formative evaluation situations (e.g. one-to-one, small-group, and field trials).
Formative Evaluation Planning Worksheet
Write the instructional objectives of your lesson here (it can be more than one):
Your final response:
Given a simple topic such as a flashing bulb, SWBAT create a small frame by frame animated picture by using flash within 30 minutes.
The instructor's feedback to this step:
Looks good!
Write your objective using the correct form. Click here for advice on writing objectives.
HTML formatting reminder: You can embed HTML tags directly in your responses. This will be help your buddies and the instructor view your information in a more readable fashion. For example, if you want a paragraph break somewhere, just enter <p>:
I will have the experts review the lesson on three levels:
<p>
1. content; 2. technical accuracy; 3. quality of instruction.
<p>
The content review will help ensure that no mistakes were made in the information provided to the learners.
Who |
What |
When |
How |
| Experts (subject-matter, learning, learner) |
Your final response:
The experts will evaluate the lesson on three levels:
1. Technical accuracy
2. Quality of the lesson
3. Difficulty of the lesson
The technical accuracy review will enable us to determine if any mistakes were made in creating a frame by frame animated picture based on a step-by-step manner. The quality of the lesson review will examine the effectiveness and feasiblity of the instruction. Reviewing the difficulty of the lesson, will provide information that will help determine if the level of instruction matches the level of the learners.
|
Your final response:
The three levels will be completed according to the experts' time frame.
|
Your final response:
A checklist will be provided to give the experts' directions to guide the review.
An interview with each expert will occur after the review is completed.
|
The instructor's feedback to this step:
This looks very good, but I recommend that you make clear who are experts for reviewing the content, technical accuracy, and quality of instruction. You might need different experts for each part. |
| Learners: one-to-one |
Your final response:
Not more than 3 learners will be selected from the target population.
To represent the range of ability, participants will be selected from three levels: above average, average, below average.
This trial is conducted to evaluate the clarity, impact, and feasibility of the instruction.
|
Your final response:
The one-to-one evaluation will take place after the designer finishes his/her first lesson draft for instruction.
|
Your final response:
The designer and the learner will go through the lesson together and find out the relatively gross problems as well as small errors. Then, the designer will discuss with each selected learner about strengths and weaknesses in the implementation of the instructional materials.
|
The instructor's feedback to this step:
You seem to understand the one-to-one evaluation process quite well. I want to add just one thing -- you should be more specific in how you will select participants and how you will establish rapport with participants and so on. A more specific plan will make your actual formative evaluation easier to implement and more valuable.
|
| Learners: small-group |
Your final response:
Eight to twenty learners that are as representative as possible to the target population will be selected.
In this process, the effectiveness of changes made following the one-to-one evaluation and to identify any remaiing learning problems will be examined.
|
Your final response:
The small group session will occur in the formative stage of development that is after the prototypes of the instruction are created.
|
Your final response:
Both quantitative and descriptive information will be gathered in this trial.
Quantitative data such as test scores, time requirements will be collected.
Descriptive data consists of comments collected from attitude questionnaires, interviews, or evaluator's notes written during this trial.
An interview with the participants will be given after the instruction.
|
The instructor's feedback to this step:
You did a good job here. You seem to understand the small-group evaluation process well. |
| Learners: field trial |
Your final response:
About 30 learners will be selected to ensure that it is representative of the target population for evaluating the effectiveness of the completed instructional materials.
|
Your final response:
The field test will occur after the design of the instruction is complete.
|
Your final response:
The evaluation will take place in the actual setting where the instruction will be used on a regular basis.
Same with the small group, an interview with the participants will be given after the instruction.
|
The instructor's feedback to this step:
Good job! I have one question. Would you use just an interview method for the field trial? You can use several methods for collecting more valuable and correct data. How about observation? |
|