Quality Analysis on New Experience

This feature is available from version 3.35.0 and to use it, you need to enable on your license Quality Analysis

With the New Client Experience, on Voice Recordings, it is possible to apply a Quality Analysis using the AI features.

If you don't have a New Client Experience you can still see most of the features described below. However, you might find some limitations

Voice Recordings on New Client Experience

We are working to improve the User Experience of Voice Recordings section. In future releases, the relative GUI will be updated..stay tuned!

On the New Client Experience, the Voice Recordings section shows more advanced search filters and custom columns.

image-20240517-080230.png

It is possible to configure columns and fields of the table and the table width can be flexible, namely fittable to the surrounding space, or fixed, according to a specific dimension measured in pixels.

You can also add as many columns as you need.

Moreover you can customize the number of elements, from the text field Number of Items per page, for example, a maximum of 10.

image-20240723-075754.png

 

You can apply a series of filters to find several voice recordings:

  • Duration that can organize the data in ascending or descending order (so this filter does not allow the insertion of text or numbers)

  • Date: you can select a time range from the calendar or you can choose default option as today, yesterday, this week, last week, this month, last month, this year, last year

  • Agent who managed the conversation

  • Caller / Called or Connected (agent’s internal number)

  • Type: internal, inbound, outbound or dialer

  • Unique ID

  • Queue on which the call arrived

  • Disposition (1°,2°,3° level)

To filter Voice Recordings click on Apply Filters

A voice recording can have one or more Transcriptions, Post-Call Analytics, or Sentiment Analyses. To launch Transcribe, Sentiment Analysis and Post Call Analytics you can select the voice recording and use the icons on the top right. There is also a specific button to export files in .csv format.

It is also possible to see all the actions' results relative to a Voice Recording, by clicking on a specific recording. From this interface, you can see the details of the Voice Recording, which cannot be modified, and the amount of actions taken (e.g. 11 Transcriptions)

Here, you can see the details of each transcription, with indication of Date (default descending sorting), Status, Service (Amazon AWS or OpenAI), Language code and Display column (represented by the eye icon).

Status can be:

  • New: the job has just been created and is waiting for processing

  • UploadingData: the file is being uploaded to the provider's server

  • InProgress: the provider is processing the uploaded file

  • Unknown: unknown status (due to some error)

  • Completed: processing completed successfully

  • Failed: processing failed (in this case, if the provider gives an error message, a warning icon is placed next to the status (with a tooltip showing that message)

Requirements

Transcribe

You can launch a new transcription, by inserting the Provider:

If you choose AWS, you can indicate Region and language from the dropdown menu

 

If you choose OpenAI, you don’t need to indicate the language, because it has automatic recognition

 

 

By clicking on the eye button image-20240521-125138.png it is possible to see audio details:

  • Two audio bars, indicating the User and Customer audio channels (enabling split voice recordings in settings section).
    The right channel, represented by the agent, has downward values, while the left channel, containing the client's audio, shows upward bands. By scrolling the vertical bar to a position on the plot, you can see the detail of the corresponding part of the transcript.

  • Word confidence colors are label to indicate the speech recognition's reliability level. Specifically, white text is above 90% sure, orange 50% and red is less than 50% (the system had difficulty identifying the correct words).
    It is possible to Hide confidence to remove the above-mentioned colors from the text body

  • On the left there is the conversation transcription, divided by the two speakers (User and Customer). The duration time of each exchange is reported in seconds

  • To see a more detailed view of the transcription, click on Show table visualisation

From this visualisation, you can click on Show chat visualisation to turn back to the previous interface

Sentiment Analysis

Sentiment analysis can be run on the latest transcription produced by AWS transcribe, OpenAI whisper or post call analytics. This feature inspects the call transcript text and returns an inference of the prevailing sentiment (POSITIVE, NEUTRAL, MIXED, or NEGATIVE, expressed in percentage) and their corresponding confidence levels.

 

The list of sentiment analysis shows the following columns:

  • Date (default descending sorting)

  • Status: (described above)

  • Service (only Amazon AWS)

The detail on the right shows the sentiment of the entire conversation, with percentages for each individual category.

Post-Call Analytics

Post-Call Analytics estimates how the customer and agent have been feeling throughout the call.

 

As columns, you can see Date, Status, Service (only Amazon AWS), Language code and Visualisation column (eye icon).

By clicking on a row you can see details about analysis. This feature can be useful when the sentiment output is negative, so the user can choose to run the post-call analytics, to find out in which parts of the conversation the issue occurred.

You can view general details about the analysis:

  • general sentiment, by assigning scores to the agent and the client

  • Word confidence color to indicate the speech recognition's reliability level of transcribe

  • matched categories: by default all created categories are searched inside the conversation, but clicking on this icon you can also decide to filter for specific categories

 

  • audio file divided per speaker

  • conversation with relative duration of each part

For each piece of conversation, you can view the speaker’s tones of the voice, expressed using emojis:

= appropriate, non-aggressive tone

= conversation improveable, but appropriate to the context (neutral emoji)

= threatening or aggressive tone, inappropriate vocabulary

Moreover when categories are matched in the conversation by AWS (when the audio is sent to analysis), you will see a green star near the phrase and a orange bar to the left

So it is possible to track also pause, for example by filtering by non_talk category to match moments in which pauses last at least the seconds entered in the category configuration (it’s possible to find pause moments also inside comics of conversation)

 

 

 

By selecting a piece of conversation you can view the relative sentiment, matched categories and duration

Data Redaction

This function allows users to choose if to enable the data redaction process before starting the post-call analysis. By enabling this mode, when you launch a Post-Call Analytics, sensitive information (credit cards, phone numbers, addresses, etc.) will be hidden in the return transcript from AWS (sensitive data are hidden by asterisks).

 

By launching a post call analytics, if you choose as language code “English US” or “Spanish US”, you will be able to activate manually, if you want, the redaction (option disabled by default), by selecting the option “Allow data redaction”.

When post call analytics will be finished, by clicking on eye icon to view the content, the conversation will be obscured in the sensitive data with asterisks.

 

Troubleshooting

To check if the Redis container is started correctly, you can follow this procedure:

  • connect to the machine in SSH and launch this command as root user

docker ps

 

  • in the list of active containers, a container using the Redis image (in IMAGE column) and named “bullmq-v1” (NAMES column) should appear.
    Moreover you can see that in PORTS column, the host port 21000 is mapped (in this case to internal port 6379 on the container).

curl -u 'public:bs4#)W]h8+VK),RV' --silent --location https://repository.xcally.com/repository/provisioning/Scripts/motionV3_new_feature_update | bash
  • Then you need to check the environment variables in the .env file (variables published in requirements paragraph).

  • Finally as motion user

su - motion

 

go to folder cd /var/opt/motion2 and launch this command

 

to apply the changes to the environment variables, but consider that it restarts the API and it can create disservice (so it is recommended to launch it while you are not using the server).