From CISEREUPI

Assessment Working Group 2010

1. Adoption of the Common Application:

• Interested PIs email Audrey Rorrer (arorrer at uncc dot edu)
• New PIs will also receive an email reminder of the option
• Ask Joan and Harriet to include a blurb in their site approval email to New PIs
• The Common Application reminder will go out in November & December (for 2011)
• Explore platform alternatives to Google and potential unified site for 2011 (SurveyMonkey, Qualtrics, StudentVoice, etc.)

2. Adoption of the A la Carte Survey:

• Follow up email reminder of the benefits of use, including demo link to the full survey
• Host a follow conference call to address PI questions
• Explore platform options for a centralized la carte survey (inclusive of the validation project, but PIs can ‘opt out’ of scales)

3. Refinements of toolkit:

• Explore offering other tools, such as faculty/mentor survey
• Continue to incorporate additional scales to the A la Carte Survey, e.g. ethics
• Include the survey validation process for transparency (the steps, what we are measuring)

Assessment Working Group in 2010

• Leaders: Audrey Rorrer, Teresa Dahlberg, Stephen Gilbert
• Members: Karen Bean, Ping Chen, Andrew Fagg, Shou-Hsuan Huang, Wei-Shinn Ku, Michael Loui, Sanjay Madria, Ahmed Mahdy, Loretta Moore, Thomas Naps, Niki Pissinou, Jessica Ward

Common Application

Link to the Common Application FAQs- The Common Application is a customizable online student application with student front end and administrative spreadsheet- it's online, customizable, ready to go and easy to use!

A La Carte Survey

Link to the A la Carte Survey Information-

• Participate in the complete survey validation effort (fast, easy and free)
• Or opt to use the modular components in your survey

NSF Highlights SAMPLE

Richard Hughey, School of Engineering at the University of California-Santa Cruz, has graciously shared a recent Highlights report to the NSF. To view this report, visit the CISE REU Evaluation Toolkit, linked below, and go to the Reports & Templates menu.

CISE REU Evaluation Tookit

Link to the CISE REU Evaluation Tookit for an easy one-stop shop for all your REU evaluation questions: an overview of site assessment and evaluation tools & tips for your annual report or Renewal proposal.

Assessment Project Overview 2009

Our overall goals are to plan for web content to support the REU Sites PI community containing: Shared survey instruments Shared evaluation reports A la carte survey tool Evaluation toolkit Common student application Discussion group

We now have a CISE REU Evaluation Toolkit available for use [1]. The toolkit is an ongoing work in progress, being built by the CISE PI Community. Toolkit features include: Evaluation concepts and glossary Recommended indicators of REU success How to begin evaluating your site Data collection A la carte survey items and sample surveys Interpretation of evaluation Dissemination Reports and other templates References.

Information updates will take place as PIs make contributions via the online survey form to provide us with input on how helpful this toolkit is. PIs are also encouraged to share their own evaluation and dissemination documents and tools.

Our top three issues are:

• Determining IRB and FERPA implications for common application
• Gauge feasibility of complete online common application (central site) versus common form
• Identify common measures, information needs and content areas for a la carte surveys, website, toolkit and common application

The action items emerging from the initial meeting conducted during the March 2009 PI Meeting are as follows:

• Investigate IRB/FERPA concerns
• Continue to collect instruments and student applications

Subcommittees:

• A La Carte Survey= Guy- Alain, Kevin, Neils, Eric, Manfred, Andrew, Sanjay
• Toolkit= Audrey, Sanjay, Andrew, Wendy
• Website= Teresa, Stephen

We will provide initial survey samples with more evaluation material to follow in late summer.

Monthly teleconferences held on 4th Thursdays at noon central time.