Sentiment Analysis AI for Course Evaluations

📙 Knowledge Base Tip: Before using this functionality, users should be familiar with the Survey Results page and question types, including their configurations.

HelioCampus offers Sentiment Analysis AI for Course Evaluations to help institutions quickly make sense of open-ended course evaluation feedback. After HelioCampus enables the feature and users are provisioned with the appropriate role-based access, AI analysis becomes available directly on the Survey Results page.

• AI Insights: AI insights are a high-level combination of quantitative metrics (from multiple-choice questions) and qualitative insights (from open-ended responses) to spot trends and potential problem areas.

• AI Summary Themes: A theme is a qualitative grouping and summary of open-ended student comments for a specific question. Sentiment Analysis AI generates themes for eligible text-response question types with 30 or more responses.

Enabling Sentiment Analysis AI

1. Submit a support ticket to request that Sentiment Analysis AI for Course Evaluations be enabled for the Institution. Learn about contacting support.
   Enabling this functionality requires HelioCampus to process an Institution's survey data in preparation for Sentiment Analysis AI. Depending on the amount of survey data to be processed, this may take multiple days, and Support will notify Institutions when processing is complete.

2. Once Sentiment Analysis AI has been enabled, Institutions must provision role-based access to users to allow access to the functionality. Users should be assigned the Survey AI User from the General category when provisioning access.

   1. User roles can be added individually per user, or in bulk via the platform interface; the Survey AI User cannot be assigned in bulk via the template export/import process. Learn how to add roles to individual users or in bulk via the platform interface.

3. After the Survey AI User role is assigned to a user, the Sentiment Analysis AI functionality will be available to the user up to 12 hours later, due to platform processing time.

Generating AI Summary Themes

Each theme includes an overall sentiment range, and the underlying responses are grouped to generate that theme. Themes can be generated for the following question types that have 30 or more responses:

• Text/Memo questions

• Instructor Text/Memo questions

• Single Line Text questions

• Questions configured with text boxes for additional comments for non-text/memo questions

1. From the Survey Homepage, select the Survey Results page from the left-hand menu.

   

2. Locate the level to view results at and click Results.

   

3. Locate the question and click AI Summary to generate themes.

   

4. Responses that are not applicable will be consolidated into a theme with no summary, indicating that they are null or not applicable to the analysis (1). Displayed directly below the theme number is the total count of survey responses that contributed to the theme analysis (2); these responses can be viewed by clicking View Responses (3). For each theme, the overall impression is shown in a ‘very negative' to ‘very positive’ range (4); hovering over the impression displays the range assignment.

   

5. Once generated, if themes are unsatisfactory, clicking Regenerate Themes (1) will prompt the Sentiment Analysis AI to create new themes. Providing feedback via the thumbs-up/thumbs-down (2) options helps identify unsatisfactory AI responses and contributes to overall AI generation.

   

Viewing AI Analysis Insights

AI insights combine quantitative metrics (from multiple-choice questions) and qualitative insights (from open-ended questions) to surface Institution-level findings and trends.

1. From the Survey Homepage, select the Survey Results page from the left-hand menu.

   

2. Locate the level to view results at and click Results.

   

3. AI results can be viewed by clicking View AI Insights to open the AI Quantitative Analysis drawer.

   

4. The AI Quantitative Analysis drawer displays quantitative and qualitative analysis results. The AI analysis can be refreshed (1) as well as copied or printed (2).

   

5. Institutions that need a fast, high-level read on educational quality can view quick-glance information via metrics charts as part of the AI Analysis.

   

Frequently Asked Questions

How often is the Sentiment Analysis AI for Course Evaluations refreshed with new evaluation results?

While new evaluation responses are continuously gathered, they will not be included until they are processed and added to the analysis each Saturday.

Is there a limit to how many themes will be generated?

No. The number of themes generated varies based on the quantity and variety of responses. The analysis dynamically determines how many themes to create for the applicable question types containing 30 or more responses.

Troubleshooting

Sentiment Analysis AI for Course Evaluations has been enabled, and I have the Survey AI User role assigned, but there is no AI Summary button on the Survey Results page.

Due to platform processing, there may be a delay in reflecting the assigned Survey AI User role for access to the AI Summary button. If more than 24 hours have passed, and there is still no AI Summary button, please contact support.

My survey is in progress, and I have received enough text responses; however, when I click on AI Summary, no themes are generated.

Although it’s ideal to generate themes once the survey closes, in in-progress surveys, clicking Regenerate Themes generates themes based only on the responses received so far. If additional responses are received after generating themes, click Regenerate Themes again. Because course evaluation results for Sentiment Analysis AI are automatically refreshed every Saturday, it is recommended to regenerate themes after the Saturday following the submission of the additional responses.