Return to the list of Formative Evaluation IDAs | Return to the IDA Library Home Page


Instructional Design Activity: Formative Evaluation


 

Overall Instructor Rating: Satisfactory

Ratings explanation:

  • Exemplary - A model answer in almost every way (this is given out very rarely).
  • Satisfactory - Very well done; you've met the expectations of the assignment. There are some minor problems, so read my feedback well.
  • Marginal Pass - You pass, but there are lots of issues to consider. Read my feedback very carefully and be sure you understand the points/issues I raise.
  • Not satisfactory, redo and resubmit - The assignment was not completed appropriately. I am concerned that you do not understand the process well enough yet. To get credit for the assignment, you need to redo it, most probably on another topic. Read and consider my feedback very carefully before redoing.

Instructor's Overall Feedback:

Hi Lindsay: Your formative evaluation is well designed and should provide you with the necessary data at each point to make instructional design decisions on how to improve the materials (if necessary). Dr. Law

 


The objective of this activity is to plan for the formative evaluation of your instruction. As stated by Dick, Carey, and Carey (2001): "Formative evaluation is the process designers use to obtain data that can be used to revise their instruction to make it more efficient and effective. The emphasis in formative evlauation is on the collection and analysis of data and the revision of the instruction" (p. 284-285).

Using the lesson you have described in the IDA on lesson design, complete the Formative Evaluation Planning Worksheet. Using the table below, describe:

  • Who will do the ongoing evaluation;
  • What is being evaluated;
  • When the evaluation should occur; and
  • How the evaluation will be conducted (i.e. tools you will use)

Be sure to refer to Dick, Carey, and Carey Chapter 10 for specific information that can be gathered from experts (e.g. subject-matter, learning, and learner) and learners in different formative evaluation situations (e.g. one-to-one, small-group, and field trials).

 


Formative Evaluation Planning Worksheet

Write the instructional objectives of your lesson here (it can be more than one):

Your final response:

Drivers will demonstrate proper procedure for making left turns.

The instructor's feedback to this step:

No specific feedback given on this step.


Write your objective using the correct form. Click here for advice on writing objectives.


HTML formatting reminder: You can embed HTML tags directly in your responses. This will be help your buddies and the instructor view your information in a more readable fashion. For example, if you want a paragraph break somewhere, just enter <p>:

I will have the experts review the lesson on three levels:
<p>
1. content; 2. technical accuracy; 3. quality of instruction.
<p>
The content review will help ensure that no mistakes were made in the information provided to the learners.

Who
What
When
How
Experts (subject-matter, learning, learner)

Your final response:

I will have SMEs who are familiar with road laws review the content of my lesson for accuracy. I will have a learning expert such as a master educator review my lesson for sound learning techniques and the quality of educational materials within it. Lastly, I will have adults who are students (in fields other than driver's education) review the content and presentation of my lesson with a focus on evaluating clarity, relevance and usability to learners.

I will have SMEs who are familiar with road laws review the content of my lesson for accuracy. I will have a learning expert such as a master educator review my lesson for sound learning techniques and the quality of educational materials within it. Lastly, I will have adults who are students (in fields other than driver's education) review the content and presentation of my lesson with a focus on evaluating clarity, relevance and usability to learners.

 

Your final response:

I will have the SMEs evaluate my lesson in the early stages of preparation after I have compiled pertinent legal information and driving procedures about 4 weeks prior to lesson implementation). I will do this with the hope that they will spot inaccuracies in the actual content of the lesson. The learning experts will review my lesson after it is first completed (about 3 weeks prior to implementation). The learner will be the last of the experts to evaluate the completed lesson which will have corrected content (verified by the SME) and will use appropriate learning techniques (verified by learning expert).

I will have the SMEs evaluate my lesson in the early stages of preparation after I have compiled pertinent legal information and driving procedures about 4 weeks prior to lesson implementation). I will do this with the hope that they will spot inaccuracies in the actual content of the lesson. The learning experts will review my lesson after it is first completed (about 3 weeks prior to implementation). The learner will be the last of the experts to evaluate the completed lesson which will have corrected content (verified by the SME) and will use appropriate learning techniques (verified by learning expert).

Your final response:

The SMEs will evaluate my lesson by analyzing all of the laws and procedures I will use in the lesson and by also being an observing passenger in a mock road test. The learning and learner experts will analyze the completed classroom lesson (including PowerPoint presentation and printouts). They will then analyze a mock road test. All three groups will use group discussion, checklists and a scoring sheet. The checklists and scoring sheets provided will be tailored to meet the areas of concern for each position.

The SMEs will evaluate my lesson by analyzing all of the laws and procedures I will use in the lesson and by also being an observing passenger in a mock road test. The learning and learner experts will analyze the completed classroom lesson (including PowerPoint presentation and printouts). They will then analyze a mock road test. All three groups will use group discussion, checklists and a scoring sheet. The checklists and scoring sheets provided will be tailored to meet the areas of concern for each position.

The instructor's feedback to this step:

No specific feedback given on this step.

Learners: one-to-one

Your final response:

I will select a small group of driver's education learners to evaluate the instruction, usability of materials and the clarity of the lesson and relevance of the components of the lesson to the learning objective.

I will select a small group of driver's education learners to evaluate the instruction, usability of materials and the clarity of the lesson and relevance of the components of the lesson to the learning objective.

Your final response:

This will occur before the course is considered complete and at least 2 weeks before the intended date to begin actual instruction. One - to - One evaluators will meet at a time and place when actual learners are not present so they feel free to share their opinions without reservation or interference.

This will occur before the course is considered complete and at least 2 weeks before the intended date to begin actual instruction. One - to - One evaluators will meet at a time and place when actual learners are not present so they feel free to share their opinions without reservation or interference.

Your final response:

The evaluators will be presented with a condensed version of the course conisiting of one randomly selected lessons from each unit. The evaluators will be engaged in group discussion on the: relevance, clarity and usability of the subject matter as well as the organization of the course.

I will use surveys, questionnaires and a rating sheet in which evaluators will use a scale to rate various aspects of the lessons on: relevance, clarity and usability.

The instructor's feedback to this step:

No specific feedback given on this step.

Learners: small-group

Your final response:

The effectiveness of the changes that I made to my lesson due to the results of the One - to - One as well as the Expert evaluations will be evaluated by a small group of adult learners.

The effectiveness of the changes that I made to my lesson due to the results of the One - to - One evaluation will be evaluated by a small group of adult learners.

Your final response:

This evaluation will occur after the One - to - One evaluation (about a week prior to implementation), once again when other learners are not present.

This evaluation will occur after the One - to - One evaluation (about a week prior to implementation), once again when other learners are not present.

Your final response:

The Small Group evaluators will evaluate the complete driver's education course and materials actual PowerPoint presentations, handouts and vehicle in a mock road test. They will survey them, respond to a questionnaire and score various components on the scoring sheet. They will also be engaged in an attitudinal discussion in which they will be asked to express how relevant the material is, if the appropriate language was used and if all elements of the course useful and time-efficient.

The Small Group evaluators will use the actual PowerPoint presentations, handouts and vehicle in a mock road test. They will survey them, respond to a questionnaire and score various components on the scoring sheet.

The instructor's feedback to this step:

No specific feedback given on this step.

Learners: field trial

Your final response:

Whether the changes / revisions that I have made in my instruction after the Small group evaluation were effective. This will be done to see if the instruction can be used in the driving education context for which I intended its use.

Whether the changes / revisions that I have made in my instruction after the Small group evaluation were effective. This will be done to see if the instruction can be used in the driving education context for which I intended its use.

Your final response:

This evaluation will occur after the Small Group evaluation has taken places and the suggestions and data from it were applied to the instruction. This will be scheduled to take place days before lesson implementation.

This evaluation will occur after the Small Group evaluation has taken places and the suggestions and data from it were applied to the instruction. This will be scheduled to take place days before lesson implementation.

Your final response:

The evaluation wil be conducted by a most or all of the subject group. They will participate in the entire course including all of its components. They will use group discussions, rating sheets and a questionnaire to provide the data which will allow me to determine if changes I have made due to prior evaluations have been effective. I will also give a pre-test and a post-test to measure the knowledge attained after the cousre.

The evaluation wil be conducted by a most or all of the subject group. They will participate in the entire lesson including all of its components. They will use group discussions, rating sheets and a questionnaire to provide the data which will allow me to determine if changes I have made due to prior evaluations have been effective.

The instructor's feedback to this step:

No specific feedback given on this step.