Breadcrumbs

Program/Course Assessment Analysis

📙 Knowledge Base Tip: Reviewing the Report Library article before utilizing any reports is recommended.

This report assesses student performance on learning outcomes (PLOs, CLOs, Department/College/Institution, or Accreditor) collected as a part of Course or Program Assessment(s). This report provides a high-level overview of student achievement in meeting outcome assessment goals set at the learning outcome level, aggregated by outcome for selected term(s) at the desired Organizational Hierarchy level (Institutional, down to course section).

  • College Admin

  • Course Coordinator

  • Course Section Director

  • Department Admin

  • Institution Admin

  • Instructor

  • Preceptor

  • Program Coordinator

  • Teaching Assistant

:light_bulb_on:

Product Tip

Users with Organizational Hierarchy roles (e.g., Institutions Admin, College Admin, etc.) will only see the business objects (colleges, departments, courses, etc.) they are associated with. For example, College Admins can configure report parameters and view report results only for the course sections associated with the colleges for which they are assigned the admin role.

Use Cases

Assessing Achievement & Identifying Gaps

Institutions can evaluate how well students in various course sections meet the Course Learning Outcomes (CLOs) and compare performance across sections to identify discrepancies in achievement levels, which might indicate inconsistencies in instruction or assessment methods.

Informed Decision-Making

Institutions can utilize report data to make informed decisions about curriculum redesign, faculty development, and resource allocation. For instance, if students in one section consistently outperform others, the institution might investigate and adopt the effective teaching strategies used in that section.

Accreditation Preparation

Institutions can use this report to demonstrate to accrediting bodies that it systematically monitors and improves student learning outcomes and can provide evidence that an Institution is committed to maintaining high academic standards and continuously improving its programs.

Considerations

The Aggregate Process is required for assessment data to populate in this report’s output. The report output will include data from in-progress assessments, and results are refreshed twice a day with the Aggregate Process at 7:00 AM/PM. Learn more about the Aggregate Process.

Parameters

Parameter

Details

Assessment Type

Optional.

  • Both: Select to capture Assessment Data collected from both Program Assessments and Course Assessments.

  • Program Assessment: Select to capture data on only Program Assessments.

  • CLO Assessment: Select to capture data on only Course Assessments.

Term


Required.

When selecting terms, select the term(s) where data was collected.

Outcome Set

https://heliocampus.atlassian.net/wiki/s/-2024114597/6452/d11bb6fdc5c8ba4c973785837de5a62b5833bfe3/_/images/icons/emoticons/information.png This parameter will only be available when the Assessment Type parameter is configured as Program Assessment.

Assessment data will only display for outcomes that collected data.

Level

https://heliocampus.atlassian.net/wiki/s/-2024114597/6452/d11bb6fdc5c8ba4c973785837de5a62b5833bfe3/_/images/icons/emoticons/information.png This parameter will only be available when the Assessment Type parameter is configured as Program Assessment.

Optional.

Aggregate Terms

Optional.

  • Institution

  • College/Administrative Division

  • Department/Administrative Unit

Optional. 

These parameters are useful for narrowing results and more easily configuring the Course Section parameter.

  • Program

  • Educational Experiences Category

https://heliocampus.atlassian.net/wiki/s/-2024114597/6452/d11bb6fdc5c8ba4c973785837de5a62b5833bfe3/_/images/icons/emoticons/information.png This parameter will only be available when the Assessment Type parameter is configured as Program Assessment.

Optional.

These parameters are useful for narrowing results and more easily configuring the Course and Course Section parameters.

  • Course

  • Course Section

Required.

One or more courses are required to be selected to configure the Course Sections parameter. Multiple course sections across multiple terms can be selected.

Developmental Level

https://heliocampus.atlassian.net/wiki/s/-2024114597/6452/d11bb6fdc5c8ba4c973785837de5a62b5833bfe3/_/images/icons/emoticons/information.png This parameter will only be available when the Assessment Type parameter is configured as Program Assessment.

Optional.

Tag

https://heliocampus.atlassian.net/wiki/s/-2024114597/6452/d11bb6fdc5c8ba4c973785837de5a62b5833bfe3/_/images/icons/emoticons/information.png This parameter will only be available when the Assessment Type parameter is configured as Both or CLO Assessment.

Optional.

Selection options depend on the configuration of the Courses parameter; only tags associated with the selected courses will be available for selection. Additionally, if the Outcomes parameter is utilized with the Tag parameter, only outcomes associated with the selected tags will be available for selection.

Outcomes

Optional.

Selection options depend on the configuration of the Courses parameter; only outcomes associated with the selected courses will be available for selection. Additionally, the configuration of this parameter is related to the Assessment Type parameter.

  • If the assessment type is Program Assessment, only Program Learning Outcomes (PLOs) will be available for selection.

  • If the assessment type is CLO Assessment or Both, only Course Learning Outcomes (CLOs) will be available for selection.

Hide PLOs and aggregate results by CLOs

https://heliocampus.atlassian.net/wiki/s/-2024114597/6452/d11bb6fdc5c8ba4c973785837de5a62b5833bfe3/_/images/icons/emoticons/information.png This parameter will only be available when the Assessment Type parameter is configured as Both.

Optional.

When enabled, duplicate data where every PLO has been mapped to a CLO will be removed.

Result Type

Optional.

Not Assessed Data

Optional.

When Show is selected, the report output will display all rows, even those without collected data.

Hide Parameters in Report Results

When enabled, the parameters configured for the report results will not be included in the report output. When disabled, parameters and their selections will be included in the report output.

https://heliocampus.atlassian.net/wiki/s/-2024114597/6452/d11bb6fdc5c8ba4c973785837de5a62b5833bfe3/_/images/icons/emoticons/lightbulb_on.png Product Tip

Additional report parameters are available to configure student-specific data; to set up the utilization of these parameters, please contact support.

  • Age

  • Ethnicity

  • Gender

  • Home State

  • Highschool GPA

  • Cumulative GPA

  • Athletic Status

  • Number of Terms

  • Student Degree

  • Student Minor

  • Student Concentration

  • Class Level

  • ACT English Score

  • ACT Math Score

  • ACT Total Score

  • SAT Math Score

  • SAT Verbal Score

  • SAT Total Score

Report Output

image-20240823-163110.png

Once report parameters have been configured and Run Report has been clicked, the report output will display below the collapsed read-only view of the report parameters. Clicking Edit Report Parameters will reopen edit capabilities; once parameters have been edited, Run Report can be clicked again to re-generate the report output. Clicking Save Report Parameters will open the Create a New Saved Report pop-up, where the name and description of the new saved report can entered. Once a report has been saved, it will be available via the My Saved Reports tab of the Report Library.

image-20240819-184506.png

1

The assessed outcome and linked Course Learning Outcome (CLO) if applicable.

2

The total count of students enrolled in the course section and the total count of assessed students.

3

A visual representation of how student performance is spread across different proficiency levels for a specific Program Learning Outcome (PLO) or Course Learning Outcome (CLO). This distribution shows the number or percentage of students who fall into each defined proficiency level.

4

The percentage of assessed students considered successful in the course section, and the percentage of assessed students who met the performance goal.

5

The report output can be exported to PDF, CSV, Word, or Excel formats or printed.

Troubleshooting

Previously Removed Data Still Included in the Report Output

When generating this report, the platform will only recalculate results for course sections with assignment links. If all existing assignment links for a course section have been removed, the platform will never recalculate results, and the report output will continue to indicate that there are results for a section despite them being unlinked. This is a known issue and will be resolved in a future release.

Existing Assessment Data Not Included in Report Output

Scenario A

Solution

If the course sections selected in the Course Section parameter are at different levels of the Organizational Hierarchy (College vs. Department) than the program…

Then, all associated levels of the organizational hierarchy must be selected using the Department/Administrative Unit parameter.

🔎

If a course section in the College of Engineering college is being assessed in a program that belongs to the College of Arts And Sciences college, then both the College of Engineering and the College of Arts and Sciences should be selected via the Colleges parameter to see results for the course section.

Scenario B

Solution

If Program Outcomes were mapped directly to a course, and the Assessment Type parameter is configured as ‘Both’…

Then no outcomes should be selected via the Outcomes parameter. If outcomes are selected, the report output will generate no results.

Results will not be generated because when mappings are only made to the course, and none are made to the Course Learning Outcomes (CLOs), selecting any outcomes will not generate any results.

Scenario C

Solution

If a program has been configured to assess specific degrees only…

Then, the platform will only collect data for students associated with those degrees. Therefore, only data pertaining to those students will be included in the report output.