Shortlister/Shortlist.Me Release Notes (25/09/24)

AI Summary & Highlights: Review

The AI Summary feature displays an AI-powered summary and highlights for each participant's video response to questions within their activity submission; giving the reviewer a brief understanding of their answer prior to watching the full video and rating the response.

The benefit of this feature for reviewers is to improve efficiency during the review process particularly when the reviewers have an extremely large number of submissions to review.

The summary content is displayed within the ‘question header’ area of the review screen while the highlights are displayed in a list under the video player. Full feature documentation is available on the knowledge base.

Note: Matrix review type activities do not currently support AI summary functionality.

For more information on this feature speak to your Account Manager.

Application Review Screen UI update

Alongside the AI feature, the existing review screen UI has been updated to be more consistent with the rest of the platform. As part of this update, several new options have been implemented to improve the user experience.

  • Left navigation bar is now available on the review screen
  • The transcript option is now permanently displayed under the video player rather than an option in the top navigation bar
  • New question navigation icons within the ‘question header’ section that allow user to quickly move between questions without having to scroll down to the bottom of the screen or use the top bar navigation modal option
  • Email option now fits within the existing modal window rather than a separate modal for consistency

Screen Recording

New feature allowing users to present their screens as well as their camera within activity questions. The feature has been designed to allow users to swap between screens while sharing and even stop sharing entirely, continuing with just their camera recording.

Full feature documentation will be available on the knowledge base to understand its function as well as how to set up your activities correctly.

For more information on this feature speak to your Account Manager.

Aptitude Tests

The Aptitude Tests functionality was originally released on 25th June 2024. Below is a list of enhancements and issues resolved for this area of functionality.

For more information on this feature speak to your Account Manager.

Text change for Aptitude test

The information message bar has been updated to be more specific to ensure users know exactly how to save their results after completing a test. The message bar now reads:

“Please print or download your results via the 'print these results' button before closing the test. They won't be accessible later.”

Fix: Company level report not showing responded count

Resolved an issue with the reports UI and csv export not displaying the ‘responded’ count correctly for Aptitude Tests.

Inductive reasoning 2 - print option now available

Print option is now available for the Inductive Reasoning 2 activity. The print button allows users to download the results to PDF as well as print.

General Enhancements & Fixes

Available thinking time options increased for activity questions

We have included two more options for the thinking time value set against questions on activities. Users can now set 90 seconds or 120 seconds thinking time for questions.

Timer for ‘Answer time’ added to browser tab for activity questions

The timer for answering a question is now visible within the browser tab of the activity window as well as the animated bar that moves around the users camera output.

Text changes to candidate information during activities

The text displayed to users before questions has been improved for clarity and readability.

“Please note: navigating away or closing the browser will count as a response”.

Display ‘last logged in’ date on User Management screen

The User Management screen now displays the date each user last logged into the system. The format is DD-MM-YYYY. If a user has not yet logged in then an alternate message is displayed. See screenshot below.

 

Add Activity type filter to search options on the Marketplace

Users can now filter by activity type on the Marketplace.When clicking into the new search box a dropdown will display that lists all in-use activity types for this marketplace. Selecting an activity type from this list will populate the search box. Multiple activity types can be selected in a single search. Free text search is also available and can be used alongside the activity filter to make the results more specific.

Text change on marketplace search box

The placeholder text within the search box on the marketplace has been altered from ‘Find an interview’ to ‘Find an activity’.

Supporting line breaks in review screen

Line breaks that are included in an activities question text will display correctly on the review screens instead of being stripped out and displaying as a single line or paragraph.

Disable ability to copy content from activities

To ensure more authentic responses from users answering questions within activities, we have stopped the ability for content to be copied from the screen which can then be pasted elsewhere, such as AI tools to assist in answering questions. This change stops users from being able to copy and paste any text content from the lobby screen through to the end of their activity.

CSV Reports to include External ID field

The reports for activity and company level now include the External ID field.

CSV Reports to display data from all activity types

SJT, Strength Assessment, Webinars and Aptitude Test outcomes have now been added to the CSV export.

Answer reset also resets question attempts count

Previously, when an answer was reset by a reviewer/account holder that only had a single attempt initially, it would error when attempting to resubmit the new answer as the original attempt had been used on the first submission. We now ensure that question resets also reset the attempts back to the value set against the question during the create process.

Display ‘unlimited attempts’ text on activity overview

We now display appropriate text for questions using unlimited attempts on both the summary (draft) and the overview (published) screens on an activity.

[Fix] Multiple attempts value defaulting to ‘unlimited’

We have resolved an issue during activity create where the multiple attempts function would default the value of the field to ‘unlimited’ instead of ‘1’.

[Fix] Activity listview not truncating text when activity name is too long

Resolved a UI issue where the activity table would squeeze some columns together because an activity name being too long would not truncate onto a new line.

[Fix] Question navigation from overview screen of review

Resolved an issue that would incorrectly label the question number in the opposite order when navigating back to them from the overview screen. Eg- if there are four total questions, returning to question one from the overview screen would label it as ‘Q4’.

[Fix] ‘Reply to’ email field not updating during activity creation

Resolved an issue with the ‘reply to’ field on email templates not updating to new custom value during the activity creation process. This field now correctly updates for the specific activity while keeping the system default in place for future activity creation.

[Fix] Reasonable adjustments email sends in error

Resolved an error where a reasonable adjustment email could be sent to users added to the invite list but not yet invited to the activity if applying a reasonable adjustment to the user via the checkbox option.

[Fix] Create 'new activity' pre-filled with previous questions added from the most recent activity created

Resolved an issue where questions built using the question generator function for an activity would be visible when creating a new activity immediately afterwards. Now when a new activity is being created the question section starts empty until you populate it.

[Fix] Self review criteria missing from duplicated activities

Resolved an issue where self review criteria was not being included when duplicating an activity.

Evaluation Rubric

Evaluation Rubric is a new rating style available within the Assessment hub and Employer hub. This rating style allows for a more complex and customisable set of scoring options per question for the review process on activities.

Default criteria for the activity will be applied to all questions on your activity. Further customisation options allow for specific, tailored criteria to be applied on a per question basis on top of the existing default settings.

Further information on the functionality of Rubric can be found on our knowledge base.