NAVIGATE: Intervention Effectiveness

Intervention Effectiveness is a great tool within Navigate for assessing the effectiveness of your programs and interventions. It is located under the Analytics tab in the "Population Health Analytics" section. Not all users have access to this component. To request access, please contact [email protected]. 

Training Guides

Intervention Effectiveness Toolkit

Frequently Asked Questions

Can Intervention Effectiveness be used in lieu of obtaining analyses from the office of Institutional Research at my institution?

The reports within Intervention Effectiveness are not designed to replace the analyses developed by the IR office at your institution. In general, the analyses within Intervention Effectiveness may use data definitions, configurations, or sources that differ from those used by your Institutional Research office. For example, Intervention Effectiveness centers around reports of student success for populations of students that the end user can define themselves; this may differ from Institutional Research analyses designed to officially report on specifically defined student cohorts (such as first time full time students entering in a particular year or term). Additionally, Intervention Effectiveness is not intended to replace the wide variety of data sources and analytical scopes that may be available through your Institutional Research office.

What types of students are included in each report?

Students who already have a graduated indicator (for any degree) in their academic record as of the selected Start Term will not be included in the population of students in the results. Additionally, if your institution does not send EAB data on students going back more than a few years, then you will be unable to analyze data for terms that occurred before the date for which your institution began sending data.

Can I see exactly which students are included in a segment or cohort?

Yes, you can see individual student data by viewing or exporting the drill-in for any report. Click any blue text in Intervention Effectiveness to obtain a drill-in report about that metric with individual student data. Export aggregated data into a CSV file from the drill-in by clicking the three buttons above the drill-in and selecting “Download as CSV”.

How can my colleagues get access to these reports?

Please contact a representative from your institution’s student success leadership team to request access.

Can I request additional reports or analyses?

We always want to be able to incorporate member feedback as we continue building out additional analyses over time. If there is a specific type of report that you'd like to see in a future iteration of Intervention Effectiveness, please contact your Strategic Leader or the Member Support Team.

How often is data loaded into Intervention Effectiveness?

Data is loaded into Intervention Effectiveness each night. Data from your Student Information System (SIS) will load into Intervention Effectiveness on a two-day lag, because the data loads for Intervention Effectiveness cannot run until after that data has loaded into the Navigate platform.

For example:  If a student changes their major on Monday, that data will update in Navigate on Tuesday, and will update in Intervention Effectiveness on Wednesday.

For data that does not come from your SIS, but rather is generated in the Navigate platform (e.g., appointments, creating/updating Watch Lists), you will see the update in Intervention Effectiveness the next day.

For example:  If you edit the name of a campaign, or add a new Watch List on Monday, you will see that information in Intervention Effectiveness on Tuesday.

I added a Watch List or Tag today, why don’t I see it in Intervention Effectiveness?

For data that does not come from your SIS, but rather is generated in the Navigate platform (such as appointments, watch lists, or tags), you will see the update in Intervention Effectiveness the next day.

Why can’t I use the 'email dashboard' feature I see in the tool?

Intervention Effectiveness is developed in a separate application from the rest of the Navigate platform. As explained above, users at your institution log into the tool through a single user login that is a generic login for your institution. The “email dashboard” link in the tool is a standard option that we cannot turn off in the application where we’ve developed Intervention Effectiveness, but we will not be able to provide that feature to members until we are able to provision access to individual users at your institution through separate accounts.

Why do I have to see all the campaigns and Watch Lists instead of just my own?

Because everyone at your institution logs into Intervention Effectiveness through a single login (see above), we are currently unable to filter down the Watch Lists and campaigns to only reflect those that you have run or saved in Navigate.

How do you handle double majors?

Students are included when you filter for a specific major if they had declared that major at the end of the selected start term, regardless of whether the major was their primary, secondary, etc. major.

Can I change (or request that EAB change) the ranges—for instance credit or GPA—that are showing up in the charts?

At this time, the ranges for each attribute are standard for every member and cannot be changed. They are based on the ranges in the Historical Trend Analytics. If you have suggestions for improvements to the ranges, please contact your Strategic Leader, or the Member Support Team.

Why would we see average cumulative GPA for students in a current term, and how could that number be different from the previous term if this term has not yet ended?

We see cumulative GPA in a current term because students always have a current cumulative GPA associated with them in their academic record. Some institutions send data for cumulative GPA nightly, while others only send it once or a few times a term. We would expect to usually see a different average GPA for the current term than the prior term even if no individual students have had changes to their GPA because the group of students enrolled in the end term (which is currently in session) is likely not the same group of students enrolled in the prior term. This will change the average cumulative GPA of the group, because the different students will not all have the same cumulative GPA as each other.

Why do I see a concentration or major in the drop-down that makes no sense with my college selection?

The filtering works differently in the Analytics dashboards and reports than in Advanced Search. In advanced search, if you select the College of Health Sciences and then go to the Major drop-down, you'll only see majors within that college. In analytics, you will see majors that students within the College of Health Sciences are enrolled in. For example, Student X could be enrolled in pre-Nursing, and also be enrolled in a Spanish major, and you'd see those both appear in the drop-down when you select the College of Health Sciences because both of those are in her academic record.

I selected a student population using the Category filter and there are fewer students returning in the results than I expect, what is the reason for this?

Categories are removed from students who are marked as Inactive in the Navigate platform. As a result, this means that categories cannot effectively be used as a filter for retroactive analyses in some situations, as students who were in that category previously and still meet the criteria for it despite being inactive will have been removed from that category. This could be the case if your institution uses categories to record a student’s entering class – they were still a part of that entering class even if they are inactive or no longer attend the institution. If you are concerned that some students in the population you are selecting by Category may be inactive, consider using a Watch List instead.

When a student becomes inactive, does their data remain in the platform? Or can Intervention Effectiveness analysis only be done on students who are marked as active?

Inactive students' data will remain in the platform unless a school actively removes them. They cannot be searched for using categories, as categories are removed from inactive students. If you want to examine a population that contains inactive students, use other filters (e.g. a Watch List) to identify them. 

Is there a way to filter unassigned students?

No, there is no direct way to filter unassigned students. A workaround is to create two watch lists - one of students with an assigned advisor and one without, and use the watch lists to compare.

What does the "All" option in the "Appointment Campaign" filter mean?

It works more like an N/A, e.g. not relying on any one campaign, rather than All Appointment Campaigns in the filter.