Point-In-time Reports provide a picture of student learning, like a snapshot taken at a single moment in time.
The online reporting feature can be used to generate basic Point-in-Time Reports. Point-in-Time Reports are snapshots of how students are doing at a given point in time using Outcomes as your benchmarks.
Point-In-Time Reports can be used to add visual information in support of your report narrative and to judge how students are doing as they enter the program. This will give you baseline data for use in progress reporting; to show that students are learning as they progress through the instructional program. Point-in-Time Reports may also be used to judge how students are doing as they finish the instructional program and to show that your instruction is effective. Lastly, they may be used in data-driven improvement efforts.
Step 1: Select Report Scope Options
1. Using the List By drop-down menu, select Outcome Set.
2. Using the Statistics drop-down menu, select Overall Average, Performance Level Counts, or Percent.
Step 2: Select Time Intervals
3. Use the From and To date fields to select the dates for your report.
If you wish to select a specific time interval for your report use the Time Intervals section. Clicking on the current dates will provide you with a calendar to select a new date.
If you do not select a specific time interval for your report, the time interval will default to the last cache build range.
Step 3: Select Filter Options
4. Click on the Choose Outcome button to select the Outcome.
1. Use the Sources column to select the department in which the Outcome or Outcome Set exists.
2. Use the Outcome Sets column to select the appropriate Outcome or Outcome Set. Use the Add Selected button or Drag-and-Drop the Outcome to the Chosen Outcomes column.
3. Click Done.
Step 4: Select Calculation & Output Options
4. Select the Calculation Options that you would like to use:
- In Case of Multiple Submissions: If more than one submission was made and scored, this option allows you to select to include all submissions, average student submission scores, use the latest student submission score, or use the earliest student submission score.
- Filter by Date: This option allows you to select to filter by the date the submissions were made or the date the submissions were assessed.
- Statistics Mode: This option allows you to select to display population or sample statistics.
- Calculate Instrument Means Using: This option allows you to select how the means will be calculated.
- Reliability Assessment Scores: If you have performed reliability tests using Assessment Instrument linked to this outcome set you can select to include or exclude the reliability assessment scores.
- Held Scores: This option allows you to select whether you would like to include, exclude, or who only held scores.
5. Select the Output Options that you would like to use:
Select the output options you wish to include in your report by clicking on the associated checkboxes.
6. If you would like to use a Pegging Scheme, use the drop-down menu to select it.
The output options selected in this example are for the purposes of this sample report. Please select the desired output options based on what you would like to display in your report.
What does "Zero Performance Levels" mean?
Zero performance levels may be set up as part of your performance levels when you are creating rubrics. A score of zero generally means that the work was not submitted, or that the submitted work did not satisfy the requirements. Including the zero score in the calculation of the mean will negatively impact the mean score. Check the option only if you want to include any zero scores in the calculation of the mean.
Zero scores should not be confused with Not Applicable criterion scores. N/A scores are not included in the calculation of the mean score
What does "Mean Bar Chart" mean?
The Mean Bar chart gives an indication of the range of scores. For example, if you have a seven (7) performance level scoring range, a mean of 3.5 would have a 50% mean bar chart.
Step 5: Generate Report
7. Click on the Generate Report button.
Step 6: Review the Report
Your report will now be displayed in table format. You have the following options on this screen:
8. Report Settings: To make changes to the report parameters, select this option.
9. Settings Summary: To view a summary of the report settings, click the Settings Summary button.
10. Export: If you would like to save the report on your computer, you can export it as Excel TSV, Raw XML or Excel XML.
11. Save Report As...: This option will allow you to save this report so that you can run it in the future, without having to select the parameters again. Saving the report will also allow you to insert the report into a portfolio.
12. Copy or Print: To save a copy of the report table to your clipboard or print your report, use the Copy or Print options.
Step 7: Browse Report Results
Viewing a mean score for an entire Outcome Set is of limited value, since this view will tell you nothing about discrete skills. To gain further insight into student abilities, examine individual Outcomes (Outcome Sections or Subsections).
13. Click the Browse link on the right side of the table.
Step 8: Drill Down into Outcomes
You can now drill further into Outcome results of interest.
14. Click on a point on the line graph or bar graph and select a drill-down option. In this case, we have selected Drill down into outcomes.
Identify low scores that have high percent values (Outcomes that have the lowest scores).
Step 9: View Outcome Scores by Student
15. Drill into these low scores by clicking on the bar or graph point again and select a drill option. Select Related Information and choose the Outcome Scores by Student (Matrix) option to view Outcome Section scores by student.