Shortlister/Shortlist.Me Release Notes (16/10/24)

New Features

Boomerang - Participant video/audio test step for activities

We have added a test step into activities that allow participants to test their video and audio output prior to starting the activity questions. After the standard hardware check a test recording is recommended but not mandatory.

If the test is taken, the user is requested to repeat a phrase into their microphone while recording. This video is then played back to them to confirm the output is correct before continuing. This step can be retaken as many times as needed or skipped entirely to progress to the first stage of the activity.

Rubric review functional changes

Rubric criterion is no longer mandatory in order to complete the review and access the final overview screen. Providing no rating to a criterion does not equal a zero rating. Users must explicitly choose the zero value option on the scale to mark it as a zero. Any unscored criterion will be taken into account for the reviewers total score. Users will be reminded that some criterion remains unrated on the overview screen if missed in error.

If no criteria is scored when reaching the overview, and no one else has reviewed the application, then it will remain in the ‘responded’ column of the review pipeline. Only when a total score of zero or higher is submitted will the application be moved to the ‘reviewed’ column of the pipeline. Both the users personal score and the average score fields will be populated on screen and within the csv export.

Rubric question custom criteria validation

To avoid accidentally overwriting custom rubric data per question during the activity setup process, we now perform a check and ask users to confirm their next steps in order to either keep or overwrite any custom content that may exist.

Personality Aptitude test includes print/download option

It is now possible for users to print or download their personality test results when taking the personality aptitude test. The print button is displayed on the results screen. The download option is present within the modal that appears when clicking the print button.


AI Summary & Highlights text changes during creation

When AI Summary is enabled users will see this option during the creation steps for activities. In this area we have made some changes to the text and the running order of this screen. The overall changes are listed below:

  • AI Summary is now referred to as “AI Assistance” in the left menu and shows correctly when setting up an activity in coaching hub for all activity types (experience/ feedback/ assessment)
  • The AI Assistance screen will display first within the ‘Review’ section during setup
  • The subtext for both enabling and disabling AI Assistance has been updated to:
      • When enabled -  “AI Assistance transforms participant responses into concise, insightful summaries and highlights to accelerate the review process.”
  • When disabled - “AI will not assist in summarising or highlighting participant responses.”
  • The chosen option will correctly display on the summary screen prior to publishing and on the activity overview screen after the activity is published

As part of this change we now also show all the Review sub-screens in the left menu breadcrumb trail when setting up an Assessment type activity within the Coaching Hub.

Fixes

Attempts count per question is reset to default when duplicating activity

We have resolved an issue with duplicating activities not retaining the custom values of the multiple attempts field per question. Rather than defaulting to ‘1’ we retain the values set on the original activity.

Review button missing from UI for reviewers on Matrix style activities

Resolved an issue where reviewers were unable to access activities with a matrix rating scale.

Ensure overall review count on activity list increases correctly

Corrected an issue where activities using a rubric review would not update the overall ‘to review’ count at the top of the screen when it was submitted and entered the ‘responded’ list. Note: the specific activity count would increase correctly.

AI Summary screen incorrectly displaying during activity setup when feature is disabled

When creating a new activity in the coaching hub, users were being shown a screen incorrectly that warned them they had not yet activated AI Assistance. This has been corrected and no longer shows.

Review overview and question modal would display the last users review score

We have corrected an issue when reviewing a rubric activity that would sometimes display the last Account Holder/Reviewers scores within the question modal or final overview screen against each question. Note: This was a visual issue only and did not impact the current users ratings or their final score on either the overview screen or csv export once submitted.