Overall Instructor Rating: Satisfactory
Ratings explanation:
- Exemplary - A model answer in almost every way (this is given out very rarely).
- Satisfactory - Very well done; you've met the expectations of the assignment. There are some minor problems, so read my feedback well.
- Marginal Pass - You pass, but there are lots of issues to consider. Read my feedback very carefully and be sure you understand the points/issues I raise.
- Not satisfactory, redo and resubmit - The assignment was not completed appropriately. I am concerned that you do not understand the process well enough yet. To get credit for the assignment, you need to redo it, most probably on another topic. Read and consider my feedback very carefully before redoing.
Instructor's Overall Feedback:
Hi, Consuelo
Overall, you did a good job on this IDA. I think you understand the purpose of formative evaluation. You have good and specific evaluation plans with good rationales. Other than finding a couple of typos, I do not have any suggestions for further improvement. In particular, the “what” of your expert review part is written twice.
Keep up with the good work.
Please let me know if you have any questions.
Thanks.
Best,
Eun Jung
The objective of this activity is to plan for the formative evaluation of your instruction. As stated by Dick, Carey, and Carey (2001): "Formative evaluation is the process designers use to obtain data that can be used to revise their instruction to make it more efficient and effective. The emphasis in formative evlauation is on the collection and analysis of data and the revision of the instruction" (p. 284-285).
Using the lesson you have described in the IDA on lesson design, complete the Formative Evaluation Planning Worksheet. Using the table below, describe:
- Who will do the ongoing evaluation;
- What is being evaluated;
- When the evaluation should occur; and
- How the evaluation will be conducted (i.e. tools you will use)
Be sure to refer to Dick, Carey, and Carey Chapter 10 for specific information that can be gathered from experts (e.g. subject-matter, learning, and learner) and learners in different formative evaluation situations (e.g. one-to-one, small-group, and field trials).
Formative Evaluation Planning Worksheet
Write the instructional objectives of your lesson here (it can be more than one):
Your final response:
Learners will be able to execute the proper procedures required to use a lift arm support while servicing a skid steer loader.
The instructor's feedback to this step:
No specific feedback given on this step.
Write your objective using the correct form. Click here for advice on writing objectives.
HTML formatting reminder: You can embed HTML tags directly in your responses. This will be help your buddies and the instructor view your information in a more readable fashion. For example, if you want a paragraph break somewhere, just enter <p>:
I will have the experts review the lesson on three levels:
<p>
1. content; 2. technical accuracy; 3. quality of instruction.
<p>
The content review will help ensure that no mistakes were made in the information provided to the learners.
Who |
What |
When |
How |
| Experts (subject-matter, learning, learner) |
Your final response:
I will have three to four experts review the lesson for the following:
1.Accuracy and clarity of instruction 2. Content 3. Quality of materials used. The experts will be service department managers from Skid Steer manufacturing companies.
The accuracy and clarity of instruction review will help determine if there are any errors in the selected What is being evaluated?
I will have three to four experts review the lesson for the following: 1.Accuracy and clarity of instruction 2. Content 3. Quality of materials used. The experts will be service department managers from Skid Steer manufacturing companies. The accuracy and clarity of instruction review will help determine if there are any errors in the selected procedures used for the hands on training. The content review will help ensure that no mistakes were made in the information provided to the learners. Finally, the quality of materials review will let us know if the materials are appropriate and suitable for the subject matter. procedures used for the hands on training. The content review will help ensure that no mistakes were made in the information provided to the learners. Finally, the quality of materials review will let us know if the materials are appropriate and suitable for the subject matter.
I will have three to four experts review the lesson for the following:
1.Accuracy and clarity of instruction 2. Content 3. Quality of materials used. The experts will be service department managers from Skid Steer manufacturing companies.
The accuracy and clarity of instruction review will help determine if there are any errors in the selected What is being evaluated?
I will have three to four experts review the lesson for the following: 1.Accuracy and clarity of instruction 2. Content 3. Quality of materials used. The experts will be service department managers from Skid Steer manufacturing companies. The accuracy and clarity of instruction review will help determine if there are any errors in the selected procedures used for the hands on training. The content review will help ensure that no mistakes were made in the information provided to the learners. Finally, the quality of materials review will let us know if the materials are appropriate and suitable for the subject matter. procedures used for the hands on training. The content review will help ensure that no mistakes were made in the information provided to the learners. Finally, the quality of materials review will let us know if the materials are appropriate and suitable for the subject matter.
|
Your final response:
The experts will be contacted to review the lesson as soon as the materials are developed and completed. The time frame will be such that they will be able to complete the review and return feedback with sufficient time so that the results of their review will be as accurate as possible.
The experts will be contacted to review the lesson as soon as the materials are developed and completed. The time frame will be such that they will be able to complete the review and return feedback with sufficient time so that the results of their review will be as accurate as possible.
|
Your final response:
The experts will review a video that will demonstrate the hands on procedure for clarity. Upon completion of the video the experts will walk through the instructional material developed by the designer using a check lists that will enable the experts to provide feedback immediately to the instructional designer.
They will determine if the instructional material has directions that are clear, simple and easy to follow and that the quality of the content is effective and consistent.
In addition the experts will assess the pretest and post test for item clarity by taking the tests.
Interviews with the experts will take place after the review is completed to clarify any information.
The experts will walk through the instruction using a check list that will enable the experts to provide feedback immediately to the instructional designer.
|
The instructor's feedback to this step:
No specific feedback given on this step. |
| Learners: one-to-one |
Your final response:
Three learners will be selected for the evaluation of the effectiveness and clarity of the instruction. These learners will be representative of the targeted population and will be selected from three groups based on their level of prior knowledge regarding skid steer loader service procedures. The three groups are those having no prior knowledge of servicing a skid steer loader, those having some knowledge of servicing a skid steer loader using a lift arm support and those having experience with servicing a skid steer loader using a lift arm support.
Three learners will be selected for the evaluation of the effectiveness and clarity of the instruction. These learners will be representative of the targeted population and will be selected from three groups based on their level of prior knowledge regarding skid steer loader service procedures. The three groups are those having no prior knowledge of servicing a skid steer loader, those having some knowledge of servicing a skid steer loader using a lift arm support and those having experience with servicing a skid steer loader using a lift arm support.
|
Your final response:
The one-on-one sessions will commence after the experts have provided feedback to the designer and the instructional materials have been developed.
The one-on-one sessions will commence after the experts have provided feedback to the designer and the instructional materials have been developed.
|
Your final response:
The evaluation will take place in the environment in which the instruction will eventually be given. A pretest and post test will be administered to determine effectiveness of instruction. A trained instructor will go through the lesson as it was designed conducting a skid steer service using the lift arm support. The designer will work with each learner as they go through the instruction, marking areas in the instruction check list where it appears to be confusing, answering questions the learners pose as they complete the instruction. The designer will note any difficulties that appear to arise in the course of instruction. Assessment will be done through a performance evaluation which will be conducted while the learner goes through the instruction on his own. A final interview will be conducted to answer any questions and to clarify any information.
The evaluation will take place in the environment in which the instruction will eventually be given. A pretest and post test will be administered to determine effectiveness of instruction. A trained instructor will go through the lesson as it was designed conducting a skid steer service using the lift arm support. The designer will work with each learner as they go through the instruction, marking areas in the instruction where it appears to be confusing, answering questions the learners pose as they complete the instruction. The designer will note any
difficulties that appear to arise in the course of instruction. Assessment will be done through a performance evaluation which will be conducted while the learner goes through the instruction on his own. A final interview will be conducted to answer any questions and to clarify any information.
|
The instructor's feedback to this step:
No specific feedback given on this step. |
| Learners: small-group |
Your final response:
The small group of learners will be evaluating the effectiveness and clarity of the instruction. This group will be comprised of five to six learners. This group should closely match the targeted population of skid steer service technicians with varying degree of experience using a lift arm support while performing a service.
The small group of learners will be evaluating the effectiveness and clarity of the instruction. This group will be comprised of five to six learners. This group should closely match the targeted population of skid steer service technicians with varying degree of experience using a lift arm support while performing a service.
|
Your final response:
The small group evaluation will take place after the one-on-one evaluations have been completed and any modifications or corrections have been made.
The small group evaluation will take place after the one-on-one evaluations have been completed and any modifications or corrections have been made.
|
Your final response:
Depending on equipment and facility availability, the evaluation will take place in the environment where the instruction will consistently be delivered. A pretest and post test will be administered to determine effectiveness of instruction. As with the one-on-one sessions a trained instructor will go through the lesson as it was designed conducting a skid steer service using the lift arm support. A performance evaluation will be administered to each learner as he individually completes the instruction. In addition, surveys and post-instruction interviews will be conducted after the lesson is completed to gather information on the experience. The designer will be focused more upon observing the group and will allow the instruction to run its course without seeking any feedback during the instruction unless some equipment failure or other snag in the instruction takes place. The designer will take notes on how well updated version of the instruction is able to support the through the instructional process and did it remain effective and clear.
Depending on equipment and facility availability, the evaluation will take place in the environment where the instruction will consistently be delivered. A pretest and post test will be administered to determine effectiveness of instruction. As with the one-on-one sessions a trained instructor will go through the lesson as it was designed conducting a skid steer service using the lift arm support. A performance evaluation will be administered to each learner as he individually completes the instruction. In addition, surveys and post-instruction interviews will be conducted after the lesson is completed to gather information on the experience. The designer will be focused more upon observing the group and will allow the instruction to run its course without seeking any feedback during the instruction unless some equipment failure or other snag in the instruction takes place. The designer will take notes on how well updated version of the instruction is able to support the through the instructional process and did it remain effective and clear.
|
The instructor's feedback to this step:
No specific feedback given on this step. |
| Learners: field trial |
Your final response:
This will be the final evaluation of the effectiveness an clarity of instruction. This group of learners will be in the first class offered and be the group for which the instruction has been developed. They will be completing an evaluation on the process at the completion of the instruction.
This will be the final evaluation of the effectiveness an clarity of instruction. This group of learners will be in the first class offered and be the group for which the instruction has been developed. They will be completing an evaluation on the process at the completion of the instruction.
|
Your final response:
The field test will occur after all other evaluations have been completed and any modification or corrections have been made.
The field test will occur after all other evaluations have been completed and any modification or corrections have been made.
|
Your final response:
The evaluation will conducted in the setting where the instruction will be
consistently delivered. A pretest and post test along with a performance evaluation will be administered to determine the effectiveness of instruction.
A post-instructional interview will support the assessment that will be administered.
The evaluation will conducted in the setting where the instruction will be
consistently delivered. A pretest and post test along with a performance evaluation will be administered to determine the effectiveness of instruction.
A post-instructional interview will support the assessment that will be administered.
|
The instructor's feedback to this step:
No specific feedback given on this step. |
|