Imaster Evaluation Shop

Mission: The mission of the Imaster Evaluation Shop is to document impact and outcomes of Imaster programming in Missouri.

What can it do for you, an Imaster series coordinator?

• Provides preprinted evaluation forms to be used at the beginning of Class 1, at the conclusion of Class 10 and at the conclusion of volunteer hours. Copies of the Learning Type Measure are also available for purchase.

• Provides camera ready copy of the "Feedback from Today" form.

• The evaluation shop will enter data from your Imaster classes:

Q1 -13 Class 1 "Beginning at the Beginning"
Q1 -13 Class 10 "As Classes Conclude"
Q1 -13 "As You Conclude 30 Hours of Volunteer Community Education"
all data from "Some Information About You, Please"
Data from pages 1, 3 and 4 of the Learner Type Measure

• Do statistical analysis of your class' data.

• Write reports (with reasonable timetables)!

PRLL
Outcomes for annual reports
Regional and statewide aggregate outcomes and impact
Descriptive statistics of Imasters

• Consult with Imaster coordinators on the evaluation process.

Evaluation Shop Coordinator:

Cynthia Crawford
153 South Odell Avenue
Marshall MO 65340
(660) 886-6908
fax [660] 886=2603
CrawfordC@missouri.edu

Evaluation Design

Goals:

There are two goals of the Imaster evaluation design:

1. Improve programming
2. Document and articulate outcomes and impact

While the Imaster Evaluation Shop has provided instruments and suggested a workable process of collecting data to improve Imaster programming, it's primary purpose is to document and articulate outcomes and impact. Outcomes and impact will be reported at the knowledge change, behavior change, and consequences to society levels.

Two types of data:

1. Formative evaluation - Ask the learners to fill out the one page "Feedback Form" periodically at the end of class. We found it to be useful at the end of sessions 2, 4, 6, and 8. Page 4 of each of the three repeated measures also collects formative data.

These responses are of primary interest to the presenters and series coordinators. Do not submit any "Feedback Forms" to the evaluation clinic. Retain these at the local level. Don Day and Maryann Redelfs would be great to consult with on formative issues.

2. Summative evaluation - Data will be collected for analysis from through several means.

1. Repeated measures - three instruments

"Beginning at the Beginning" - have learners fill out at the beginning of the first session (2 pages front and back).

"As Classes Conclude" - have learners fill out at the conclusion of the 10th (final) class (2 pages front and back plus a third page printed on one side only).

"As You Conclude Volunteer Community Education" - have learners fill out at the end of their formal participation (usually about 1 year after classes).

The repeated measures focus on:
    1. knowledge and use of the Internet - 9 questions
    2. facilitating community education - 4 questions

2. Descriptive data

1. Learner Type Measure - an integral part of Session 4.

2. Page 4 of the repeated measure instrument filled out at the conclusion of class 10.

3. Matrix on page 4 of the final repeated measure - describing volunteer time and educational efforts.

• Send the data from your classes to the Imaster Evaluation Shop as soon as they have been completed by learners:

"Beginning at the Beginning" after class 1

Learner Type Measure - Photocopy pages 1, 3, and 4 of the booklet and be certain to transfer the name of the learner front cover to the photocopied pages that you've stapled in sets of three (p. 1, 3, and 4). The original booklet is handed back to each of the learners to support the learning process - after class 4.

"As Classes Conclude" - after class 10

It is possible to do reporting at this point-
a. Knowledge and behavior change of Imasters
b. Descriptive statistics of Imasters

"At the Conclusion of Community Volunteer Education"

After this final instrument is received, more extensive reporting is possible. Outcomes can be articulated at the consequences to society level.

• Evaluation instruments will be kept on file in the Imaster Evaluation Shop. Photocopy any data or instruments that you want for your files and for formative purposes before you send the instruments to the Evaluation Shop.

• Evaluation Shop Address:

Saline County Extension Center
Attn: Cynthia Crawford
153 South Odell Avenue
Marshall MO 65340

• As you send packages of instruments to the Evaluation Shop if you will notify us to expect them via E-mail, we will be pleased to acknowledge their receipt by return E-mail.

• Data must be sent to the Imaster Evaluation Shop within 30 days after it is collected. The quicker it is received, the quicker we can provide valuable descriptive statistics, documentation and needed reports back to you and to University Extension.

Odds and Ends

• Can you present the Imaster programming and opt out of participating in the prescribed evaluation process and design? No. This is part of the total programming package. The Imaster Program gives University Extension the opportunity to report collective statewide impact and outcomes.

• Be certain that learners put their name on each evaluation instrument.

• At the present time the Evaluation Shop is scheduled to be in place through December 1999. This is an experiment to explore one way of providing evaluation support for field staff by field staff.

• You may not change any of the data collection instruments that accompany this programming package. In consultation with Cynthia Crawford, it may be possible to collect additional information that you feel is of interest to your programming.

• The Learner Type Measure must be purchased for class use/evaluation data collection. Remove the tissue page prior to class (it would be used with a more extensive workshop) and X out the identity data section on page 4 of the instrument.

University Outreach and Extension does not discriminate on the basis of race, color, national origin, sex, religion, age, disability or status as a Vietnam-era veteran in employment or programs.