The Quality of Experience (QOE) section is available within the Webcast Intelligence Report. It's currently available as a beta version for clients who are targeting internal corporate webinars. To have the QOE section of the Webcast Intelligence Report enabled, please submit a Technical Support ticket.
My Dashboard - Quality
When to use this feature?
The QOE Report will be used by enterprises doing internal webinars, and as a general diagnostic for clients experiencing problematic stream delivery performance. It is useful for evaluating user experience was affected by buffering instances.
What are the benefits of this feature?
This section allows users to analyze and understand the media player's report of buffering behavior. Two widgets will allow users to review data from this report.
This widget is found at the top of the QOE report and plots the protocol used by each attendee.
Each attendee uses the HLS protocol for desktop users and delivery to mobile devices.
Video Buffering Widget
This widget is plotted for every attendee from the beginning to the end of the live webinar. The number of buffering instances encountered by each attendee every 5 minutes places these attendees into 3 categories listed below:
Green -Attendees who faced good experience during Webcast (depending on a few instances of buffering)
Yellow - Attendees who faced fair experience during Webcast.
Pink - Attendees who faced poor experience.
Numeric definitions of Good, Fair, and Poor are at the bottom of this page.
Underneath, you will find the video buffering grid and table. This grid allows drilling down to examine who had a poor experience and lists all the attendees and their details.
Note: Some buffering is expected based on transient conditions in the network. Also, because the system uses adaptive bitrate, it normally starts at the low data rate, then shifts up to the higher data rate after about 20 seconds if headroom is available, all beneath the audience's notice. This will frequently generate enough buffering during the first 5 minutes of the event to be visible as many attendees see "fair" buffering performance since the stats count buffering instances. In some cases, excessive buffering will often reflect a larger problem in the network affecting the overall quality of the experience.
Download the Detailed Buffering Data
Scroll down to the Video Buffering Report/Widget
By default, connections of all quality are displayed. Select the drop-down to view only those with Good, Fair, or Poor connections.
Click the download icon to export the report to Excel.
The .xlsx file will contain multiple tabs: All Attendees, Good Connections, Fair Connections, Poor Connections, and all columns displayed on the page. You can use this data to view the connection quality for specific individuals.
Measured based on a 5-minute window:
Good = 0-5 buffering events in a 5-minute window
Fair = 6-14
Poor = 15 or more
We put people into the category for the worst 5-minute window they had (not the average) for the downloadable data. If a person had any 5-minute window with 15 or more buffering events, they would go into Poor. If a person didn't have any windows w/ 15 or more but did have at least one with 6-14 buffering events, they would be included in the Fair. Everyone else would go in Good. That means that a person could have 60 buffering events in a 60-minute event, but if they were evenly spread out 5 per 5-minute window, that would be considered a ˜good" experience. But if 15 had come in the first 5 minutes, it would be considered a "poor" experience.