ARISE Evaluation

The ARISE evaluation is designed to obtain formative information that will inform the ongoing refinement of project activities, and summative information to help us determine to what extent the overall goals of this project are being met. The evaluation research is being conducted by project staff and external evaluators from the EDC Center for Children and Technology, using this logic model.

Strategies for collecting information include:

• • Participant perception surveys
    We are conducting post-event evaluations of convenings (e.g., Working Groups, Regional Meetings, and Summits) of representatives from the Noyce community. Evaluation questions focus on the most valuable parts of the events, topics that require further discussion, actions that will be taken as a result of the event, and other comments. Findings will guide the design of future events and the development of products resulting from the ARISE project.

• • Stakeholder outreach interests, needs, & satisfaction
    Surveys, interviews, focus groups, and interaction metrics will serve to assess how ARISE is currently and can better serve to fill in gaps in the field and share content most relevant and practical to user needs to increase ARISE project impact.

• • Interviews capturing change
    Using interviews with Noyce grantees conducted at periodic intervals throughout the project, the external evaluation team will examine who is doing research about STEM teacher education and innovations in teacher education programs, areas of focus, and changes in teacher preparation practices. A subset of Noyce grantees will be tracked. The interviews are expected to provide a deeper understanding of the change process within departments and institutions. Selection of the subset attended to geographic regions, different STEM disciplines, type of institution (public/private), type of community (rural, urban, suburban), and alternative programs. Programs that focus on recruitment of STEM professionals or traditionally underrepresented groups, those that engage high school students in their recruitment strategies, and programs where partners are community colleges or that recruit from community colleges are of particular interest.
    • Read EDC’s Baseline report.
    • Read EDC’s Follow-Up Project Evaluation report.