Evaluation Process

Depending on whether you are running an REU Site or you have an REU Supplement, we will use an evaluation method most appropriate for your project and student population.

REU Sites

1. During the spring prior to the start of your REU, we will reach out to collect some information about the planned structure of your REU. We will also go over the evaluation plan for the summer, reminding you of any important details.
2. At the beginning of your REU, we will give you a URL to our pre-program survey that you will give to students. We will monitor that data collection.
3. At the end of your REU, we will give you a URL to our post-program survey that you will give to students. Again, we will monitor that data collection.
4. Within a few months after data collection is complete, we will give you a report that shows your students’ responses alongside a comparison group of other REU sites.

REU Supplements

1. At least 2 months prior to the start of your REU supplement project, we will reach out to collect some information about the planned structure of your REU.
2. At the beginning of your REU, we will give you a URL to our pre-program survey that you will give to students. We will monitor that data collection.
3. At the end of your REU, we will give you a URL to our post-program survey that you will give to students. Again, we will monitor that data collection.
4. Depending on the number of student participants, we will use one of the following methods for reporting:
   1. You receive a full report summarizing your students responses alongside a comparison group of other REU supplements
   2. You receive a report that aggregates the students in your department (multiple awards) together for reporting. Comparison group will include an aggregated sample of students at similar institutions.
   3. You receive a report that aggregates your student(s) with students from similar institutions. An appropriate comparison group will be determined at reporting.

If you are interested in having CERP evaluate your NSF CISE REU program, please complete our interest form. 

After you complete the interest form, you will receive an email from the CERP team (cerpreu@cra.org) within a few days confirming receipt of your form response. If you are preparing an NSF proposal for your REU, we will also provide you with a paragraph to include in your proposal.

Frequently Asked Questions about CERP REU Evaluation

What is the cost of working with CERP evaluation?

With funding through a contract with NSF, CERP’s evaluation services are free for NSF REU Sites and REU Supplements. PIs do not need to include a budget for CERP’s evaluation in their proposals. 

If I work with CERP, do I need to hire another evaluator?

CERP’s evaluation fulfills NSF’s evaluation requirement, so another evaluator is not necessary.

Will CERP collaborate with other evaluators?

While CERP is happy to provide other evaluators with the methodology and copies of the survey, CERP is not directly collaborating with other REU Site and Supplement evaluators for this project. 

Will CERP share data with other evaluators?

Due to privacy considerations, CERP does not share raw data collected through this project. PIs are encouraged to share the summary reports that CERP will provide each year (assuming  that there are enough participant responses) with other evaluators as needed.

When I signed up to work with CERP for evaluation, I received a proposal paragraph. How do I include it in my REU Site/Supplement proposal?

The proposal paragraph that we provide should be inserted directly into the required section of your proposal on evaluation. . As it is a general paragraph, please feel free to add minor modifications to the language so that the paragraph includes any project-specific language or institutional information.

As an REU PI working with CERP for evaluation, do I need to have my own IRB approval?

CERP will have IRB approval to conduct evaluation through Solutions IRB. As an REU PI, you are encouraged to contact your IRB office to determine whether additional oversight is required by your institution. Once we have our IRB-approved materials this upcoming spring of 2022, we will supply a copy of the approval letter and templates on our website that you can use to initiate that conversation.

Can I add site-specific questions to the CERP survey?

By spring 2022, PIs will be able to submit a proposal for additional site-specific survey questions after reviewing the evaluation measures. Site-specific questions will be determined on a case-by-case basis based on feasibility and type of request. 

Will surveys also be sent to mentors/staff?

Although official surveys for evaluation will not be sent to REU mentors and staff, CERP will collect information about the REU from PIs and other project leadership to better understand the structure of each REU. This data collection effort will be in service of providing appropriate comparison groups.

Who is responsible for administering the evaluation surveys to student participants?

Each REU project will be responsible for administering the evaluation surveys to participants. Prior to data collection, CERP will provide PIs (or the determined contact person) with all materials necessary for distribution, such as recruitment templates and the survey link. All communications from CERP will come from cerpreu@cra.org.