Overall Instructor Rating: Marginal
Ratings explanation:
- Exemplary - A model answer in almost every way (this is given out very rarely).
- Satisfactory - Very well done; you've met the expectations of the assignment. There are some minor problems, so read my feedback well.
- Marginal Pass - You pass, but there are lots of issues to consider. Read my feedback very carefully and be sure you understand the points/issues I raise.
- Not satisfactory, redo and resubmit - The assignment was not completed appropriately. I am concerned that you do not understand the process well enough yet. To get credit for the assignment, you need to redo it, most probably on another topic. Read and consider my feedback very carefully before redoing.
Instructor's Overall Feedback:
Hi Holly:
Overall, your formative evaluation plan is thorough and is designed to get at much of what you are looking for to evaluate and improve the instruction. There are a few areas that are potential problems:
One-to-One Evaluation:
The Senior staff member serving as the "expert" will provide some valuable insights into the learnability of the instruction. The expert may not be able to pick up on some of the weaknesses of the instruction that only a novice learner may be able to identify. You would benefit from having at least a novice and an expert evaluate the instruction during the one-to-one phase.
Small Group Evaluation:
The purpose of the small group evaluation is to try out the instruction on a small group (4-8) of the target learners to both gain insights as to how to improve the instruction and to minimize the impact of a large implementation if there are critical errors or problems that surface during the small group evaluation. Consider changing this to a subset of the current employee population.
Field Trial:
What you describe here is really a "summative" evaluation since the program is already implemented. Again, you want to test it with a larger group than your small group test, but it should be before the course is officially implemented. Consider revising this to reflect that it is before the implementation with a larger group than the small group test. Also, the instructional designer does not impact the way the instruction is delivered. She only observes.
The objective of this activity is to plan for the formative evaluation of your instruction. As stated by Dick, Carey, and Carey (2001): "Formative evaluation is the process designers use to obtain data that can be used to revise their instruction to make it more efficient and effective. The emphasis in formative evlauation is on the collection and analysis of data and the revision of the instruction" (p. 284-285).
Using the lesson you have described in the IDA on lesson design, complete the Formative Evaluation Planning Worksheet. Using the table below, describe:
- Who will do the ongoing evaluation;
- What is being evaluated;
- When the evaluation should occur; and
- How the evaluation will be conducted (i.e. tools you will use)
Be sure to refer to Dick, Carey, and Carey Chapter 10 for specific information that can be gathered from experts (e.g. subject-matter, learning, and learner) and learners in different formative evaluation situations (e.g. one-to-one, small-group, and field trials).
Formative Evaluation Planning Worksheet
Write the instructional objectives of your lesson here (it can be more than one):
Your final response:
This is for Lesson 4 (Titled "How We Clean") of the New Plantation Employee Training program.
Lesson Terminal Objective: After completing unit 4 of the New Plantation Employee Training program, EWBAT demonstrate the proper cleaning procedures.
Lesson Objectives:
1. Given a map of the plantation, EWBAT identify the four areas where cleaning tools and supplies are located by drawing a star on these areas on the map.
2. Given a list of cleaning activities (such as washing windows, sweeping floors, etc.) EWBAT choose the proper cleaning tools/supplies (such as paper towels/windex/broom) to complete each activity.
3. Given a fill-in-the-blank worksheet on the rules of preservation, EWBAT correctly fill in the worksheet with the correct words.
4. Given a piece of paper numbered 1 through 5, EWBAT list the basic cleaning procedures in order.
The instructor's feedback to this step:
No specific feedback given on this step.
Write your objective using the correct form. Click here for advice on writing objectives.
HTML formatting reminder: You can embed HTML tags directly in your responses. This will be help your buddies and the instructor view your information in a more readable fashion. For example, if you want a paragraph break somewhere, just enter <p>:
I will have the experts review the lesson on three levels:
<p>
1. content; 2. technical accuracy; 3. quality of instruction.
<p>
The content review will help ensure that no mistakes were made in the information provided to the learners.
Who |
What |
When |
How |
| Experts (subject-matter, learning, learner) |
Your final response:
The subject matter experts (the supervisor or the plantation, a preservation specialist, and a professional housekeeper) will evaluate the accuracy and currency of cleaning procedures, location and use of cleaning tools and the rules of preservation. The learning specialist will evaluate the types of instructional methods and activities used to make sure every type of learner is engaged in the learning process. The learner specialist will make sure the material learned is appropriate to the job.
The subject matter experts (the supervisor or the plantation, a preservation specialist, and a professional housekeeper) will evaluate the accuracy and currency of cleaning procedures, location and use of cleaning tools and the rules of preservation. The learning specialist will evaluate the types of instructional methods and activities used to make sure every type of learner is engaged in the learning process. The learner specialist will make sure the material learned is appropriate to the job.
|
Your final response:
The evaluation will occur 2 weeks before the implementation of the training program as well as during the development stage of the lesson design.
The evaluation will occur 2 weeks before the implementation of the training program as well as during the development stage of the lesson design.
|
Your final response:
Informal discussion to discover the reactions/opinions of the SMEs and the learning/learner specialist.
Informal discussion to discover the reactions/opinions of the SMEs and the learning/learner specialist.
|
The instructor's feedback to this step:
No specific feedback given on this step. |
| Learners: one-to-one |
Your final response:
The most senior staff member (the employee of the plantation that has been working at the plantation for the longest time) will evaluate the clarity of the instruction, the impact of the material on the learner, and the feasibility of the training program related to performance of new employees. The senior staff member will be able to give insight to the instruction since he/she is already familiar with the cleaning procedures and the rules of preservation.
The most senior staff member (the employee of the plantation that has been working at the plantation for the longest time) will evaluate the clarity of the instruction, the impact of the material on the learner, and the feasibility of the training program related to performance of new employees. The senior staff member will be able to give insight to the instruction since he/she is already familiar with the cleaning procedures and the rules of preservation.
|
Your final response:
A week before the training program is implemented so there is time to adjust the training program if needed.
A week before the training program is implemented so there is time to adjust the training program if needed.
|
Your final response:
A condensed version of the training program will be presented to the senior staff member. Afterwards, the trainer, the program designer and the senior staff member will engaged in informal discussion on the effectiveness of the program.
A condensed version of the training program will be presented to the senior staff member. Afterwards, the trainer, the program designer and the senior staff member will engaged in informal discussion on the effectiveness of the program.
|
The instructor's feedback to this step:
No specific feedback given on this step. |
| Learners: small-group |
Your final response:
The effectiveness of the program after all changes so far have been made.
The effectiveness of the program after all changes so far have been made.
|
Your final response:
3 days before the training program is implemented so there is time to adjust the training program if needed.
3 days before the training program is implemented so there is time to adjust the training program if needed.
|
Your final response:
The complete training program will be delivered to all current employees of the plantation. The employees will understand from the beginning that they are completing the program during its development stage and that feedback is necessary. Data gathered includes test scores and time requirements as well as attitude questionnaires and interviews.
The complete training program will be delivered to all current employees of the plantation. The employees will understand from the beginning that they are completing the program during its development stage and that feedback is necessary. Data gathered includes test scores and time requirements as well as attitude questionnaires and interviews.
|
The instructor's feedback to this step:
No specific feedback given on this step. |
| Learners: field trial |
Your final response:
The learner performance, achievement and attitudes as well as the instructional delivery, procedures and attitudes and a reassessment of time, cost, space and equipment.
The learner performance, achievement and attitudes as well as the instructional delivery, procedures and attitudes and a reassessment of time, cost, space and equipment.
|
Your final response:
Each time a new employee completes the training program. Continuous evaluation of the training program will keep it current and relevant.
Each time a new employee completes the training program. Continuous evaluation of the training program will keep it current and relevant.
|
Your final response:
Pre-tests and post-tests; interviews and questionnaires after the program has been completed; observations during the training program.
Pre-tests and post-tests; interviews and questionnaires after the program has been completed; observations during the training program.
|
The instructor's feedback to this step:
No specific feedback given on this step. |
|