Return to the list of Formative Evaluation IDAs | Return to the IDA Library Home Page


Instructional Design Activity: Formative Evaluation


 

Overall Instructor Rating: Exemplary

Ratings explanation:

  • Exemplary - A model answer in almost every way (this is given out very rarely).
  • Satisfactory - Very well done; you've met the expectations of the assignment. There are some minor problems, so read my feedback well.
  • Marginal Pass - You pass, but there are lots of issues to consider. Read my feedback very carefully and be sure you understand the points/issues I raise.
  • Not satisfactory, redo and resubmit - The assignment was not completed appropriately. I am concerned that you do not understand the process well enough yet. To get credit for the assignment, you need to redo it, most probably on another topic. Read and consider my feedback very carefully before redoing.

Instructor's Overall Feedback:

An excellent Formative Analysis IDA! although I'm going to point out just a couple of things I think you should modify, they will not prevent me from giving you an "exemplary" rating. You have done a thorough job, giving thoughtful detail to each step, and shown that you "get it" as to what formative evaluation is all about. The only criticism I have for you is that in the How section of your field trial, I'd like you to make sure you are explicit about measuring student learning. In other words, you say "evaluate the instruction based on a set of questions," but do these questions look at whether the learners achieved the objective? Or are they about learner attitude or usability - or will it include all of these? I know that measuring student learning is probably very much assumed in your thinking, but please make it explicit. Other than this, you have done quite an exemplary IDA. Way to go! Greg

 


The objective of this activity is to plan for the formative evaluation of your instruction. As stated by Dick, Carey, and Carey (2001): "Formative evaluation is the process designers use to obtain data that can be used to revise their instruction to make it more efficient and effective. The emphasis in formative evlauation is on the collection and analysis of data and the revision of the instruction" (p. 284-285).

Using the lesson you have described in the IDA on lesson design, complete the Formative Evaluation Planning Worksheet. Using the table below, describe:

  • Who will do the ongoing evaluation;
  • What is being evaluated;
  • When the evaluation should occur; and
  • How the evaluation will be conducted (i.e. tools you will use)

Be sure to refer to Dick, Carey, and Carey Chapter 10 for specific information that can be gathered from experts (e.g. subject-matter, learning, and learner) and learners in different formative evaluation situations (e.g. one-to-one, small-group, and field trials).

 


Formative Evaluation Planning Worksheet

Write the instructional objectives of your lesson here (it can be more than one):

Your final response:

Using the Title Search Option SWBAT identify the author, call number and availbility of specific book titles.

The instructor's feedback to this step:

No specific feedback given on this step.


Write your objective using the correct form. Click here for advice on writing objectives.


HTML formatting reminder: You can embed HTML tags directly in your responses. This will be help your buddies and the instructor view your information in a more readable fashion. For example, if you want a paragraph break somewhere, just enter <p>:

I will have the experts review the lesson on three levels:
<p>
1. content; 2. technical accuracy; 3. quality of instruction.
<p>
The content review will help ensure that no mistakes were made in the information provided to the learners.

Who
What
When
How
Experts (subject-matter, learning, learner)

Your final response:

An expert in the area of OPAC searches will be chosen by the SLMS, and will review the instruction evaluating the following: Content technical accuracy quality of instruction The content review will show us inaccuracies in the instruction given to the students. Checking for technical accuracy will show us if we have correctly designed instructions for using any tools. The quality of instruction will tell us if the instruction is effective to the learners.

An expert in the area of OPAC searched will be chosen by the SLMS, and will review the instruction evaluating the following: Content technical accuracy quality of instruction The content review will show us inaccuracies in the instruction given to the students. Checking for technical accuracy will show us if we have correctly designed instructions for using any tools. he quality of instruction will tell us if the instruction is effective to the learners.

 

Your final response:

This evaluation will occur right after the design phase, but before we trial with any one-on-one users.

This evaluation will occur right after the design phase, but before we trial with any one-on-one users.

Your final response:

The review will be conducted by allowing the experts to work through the instruction, evaluating as they go using checklists and providing feedback. Also, we will conduct a closing interview with the expert to go over all of the feedback on three areas of evaluation.

The review will be conducted by allowing the experts to work through the instruction, evaluating as they go using checklists and providing feedback. Also, we will conduct a closing interview with the expert to go over all of the feedback on three areas of evaluation.

The instructor's feedback to this step:

No specific feedback given on this step.

Learners: one-to-one

Your final response:

A sample learner will be selected based on knowledge and ability with using the OPAC. This person will evaluate the content of the instruction to make sure it is easy to follow, technically accurate, and effective.

A sample learner will be selected based on knowledge and ability with using the OPAC. This person will evaluate the content of the instruction to make sure it is easy to follow, technically accurate, and effective.

Your final response:

This evaluation will occur after changes are made as a result of the expert evaluation.

This evaluation will occur after changes are made as a result of the expert evaluation.

Your final response:

The instructors will work one-on-one with this person going through the instruction with them at the OPAC. Notes will be taken by the learner on improvements that must be made.

The instructors will work one-on-one with this person going through the instruction with them at the OPAC. Notes will be taken by the learner on improvements that must be made.

The instructor's feedback to this step:

No specific feedback given on this step.

Learners: small-group

Your final response:

A small group of 4-6 students will be solicited on a volunteer basis to proceed through the instruction. They will evaluate the effectiveness of the instruction.

A small group of 4-6 students will be solicited on a volunteer basis to proceed through the instruction. They will evaluate the effectiveness of the instruction.

Your final response:

This evaluation will occur after changes are made to the instruction based on both the expert feedback and the one-on-one feedback.

This evaluation will occur after changes are made to the instruction based on both the expert feedback and the one-on-one feedback.

Your final response:

The group will be given a sheet of paper with certain elements to evaluate and space for their own impressions and feedback. The instructor will also evaluate whether or not they were able to find the information on the title search.

The group will be given a sheet of paper with certain elements to evaluate and space for their own impressions and feedback. The instructor will also evaluate whether or not they were able to find the information on the title search.

The instructor's feedback to this step:

No specific feedback given on this step.

Learners: field trial

Your final response:

An entire class of 5th graders will be given the lesson to complete and judge it's effectiveness.

An entire class of 5th graders will be given the lesson to complete and judge it's effectiveness.

Your final response:

This evaluation will occur after all changes are made from all previous evaluations. The results from the field trial should be incorporated into the next phase which will be the final instruction.

This evaluation will occur after all changes are made from all previous evaluations. The results from the field trial should be incorporated into the next phase which will be the final instruction.

Your final response:

Each student will be given access to the lesson tools and asked to complete the lesson. They will first be given the task of correctly locating information based on a title search, and then will be given the opportunity to evaluate the instruction based on a set of questions.

Each student will be given access to the lesson tools and asked to complete the lesson. They will first be given the task of correctly locating information based on a title search, and then will be given the opportunity to evaluate the instruction based on a set of questions.

The instructor's feedback to this step:

No specific feedback given on this step.