Skip to main content

Manage Biggy Analytics

The Analytics module of the Biggy Web App gives you insights into how your organization is interacting with Biggy. These powerful reports can help you visualize the amount of time that Biggy is saving your users, and see which operators are utilizing Biggy the most. Feedback and action plan metrics can also help you determine ways to improve Biggy's responses by adjusting action plan settings or by providing Biggy with additional context.

The Analytics module contains two sections:

  • Usage Metrics - Information on who is using Biggy and how they're interacting with it.

  • User Feedback - Details about the feedback your users gave to Biggy's query responses.

  • Workflow Executions - Usage details about workflows that trigger from new messages in your chat channels.Workflow Executions

Key Features

  • See how many queries were sent to Biggy, and which users are interacting with Biggy the most.

  • Determine which action plans your users trigger most often during queries.

  • View detailed Biggy interactions including the full text of queries and responses.

  • See the specific feedback your users gave Biggy.

  • View usage details about your workflows. 

Usage Metrics

The Usage Metrics section provides detailed information on how often your users interact with Biggy, which users utilize Biggy the most, and which action plans Biggy uses to answer user queries.

biggy_webapp_usagemetrics.png

Usage Metrics 

The following report widgets are available in the Usage Metrics section:

Report

Description

User Queries

A line graph displaying how many times users interacted with Biggy on each day, over the past 90 days.

Action Plan Usage

A pie chart displaying the number of times each action plan was used, and the top 5 most used action plans.

Unique Users

The number of unique Biggy users over the past month, and the percent increase or decrease from the previous month.

Total User Queries

The total number of user queries over the past 90 days.

Returning User Rate

The percentage and number of users out of the total users who have placed more than 3 queries.

Monthly Active Users

The number of monthly active users over time, over the past 6 months.

You can hover over a dot on the line chart to see the exact number of active users for that month.

Top Users

The top 10 Biggy users for your organization based on the number of queries placed.

Usage by Platform

The total number of user queries for each supported platform (Slack, Teams, and Web chat), and the percentage of the total for each platform. 

Web Chat Usage

A char displaying web chat usage over the past 90 days. Hover over a specific date to view the number of sessions and messages for that day.

Action Plan Execution Heatmap

A heat map displaying each of your action plans, and the number of times the action plan was used for each week over a 6 month period.

Action Plan Execution Bar Chart

A bar chart displaying how many times each action plan was used for each week over a 6 month period.

All Usage

A table displaying details about how your users are interacting with Biggy. Each line on the table displays:

  • User - the user who placed the query

  • User query - the full query that the user asked Biggy

  • Action plan - the action plan that Biggy used to answer the query

  • Date - the date the query was placed

  • Response - Biggy's response to the user query.

You can filter usage by User or Action Plan using the drop-down menus at the top of the table.

To view the report in CSV format, click Export to CSV.

User Feedback

The User Feedback reports show you details about the feedback your users gave on Biggy's responses. You can use these reports to see how much time Biggy is saving for your operators, and find areas where Biggy may need more context to improve responses.

biggy_webapp_userfeedback.png

User Feedback

For more information about giving Biggy feedback, see the Provide Biggy Feedback documentation.

The following report widgets are available:

Report

Description

Positive Feedback

The percentage and number of Biggy responses that users rated with a thumbs-up.

Negative Feedback

The percentage and number of Biggy responses that users rated with a thumbs-down.

Average Time Saved

The average amount of time in minutes saved for each query that Biggy helped with, and the median amount of time in minutes.

Positive Feedback Over Time

A line graph displaying the percentage of positive feedback the Biggy requests received for each day over time. Hover over a specific spot on the line graph to view the positive feedback percentage for that day. 

Top Feedback Users

The top ten users who have left the most feedback for Biggy. Displays the number of times each user has provided feedback, broken down by positive and negative ratings. 

Feedback per Action Plan

A table displaying feedback grouped by action plan. The following information is displayed: 

  • Action plan - name of the plan

  • Total feedback - the total number of times feedback was given for the action plan

  • Positive - the number of times positive feedback was given

  • Negative - the number of times negative feedback was given

  • Positive Rate - the percent of feedback that was positive 

  • Avg Time Saved - the average amount of time users reported was saved

User Feedback

A table displaying detailed feedback that users gave Biggy about responses to their queries. The following information is displayed:

  • Sentiment - whether the query received a thumbs-up or thumbs-down rating from the user

  • Feedback text - the feedback that the user gave Biggy on the response

  • User query - the original query that the user asked Biggy

  • Date - the date and time of the user query

  • Context issues - displays any context issues. Missing context means that no context was shared, wrong means the context was incorrect and should be updated. 

  • Minutes saved - the number of minutes that Biggy saved the user in troubleshooting or solving the issue

  • Response - the response that Biggy gave to the user query

To view the report in CSV format, click Export to CSV.

Configuration Suggestions

Biggy can suggest configuration changes based on user feedback. These recommendations are available in the Configuration Suggestions section.

biggy_config_configsuggestions.png

Configuration Suggestions 

Each configuration suggestion displays the following information:

  • Summary of the suggested changes

  • The affected configuration element

  • The full suggested change

  • The feedback that the suggested change is based on

  • The date and time the suggested change was generated, and the user who generated the suggestion.

To add the configuration change to the Accepted list, select Accept. To reject a suggestion, select Discard.

All current suggestions appear within the Suggested tab. To view suggestions you have accepted but not applied, select the Accepted tab.

Applying suggested changes

Biggy does not automatically apply suggested changes. You must copy a suggested change and apply it to the configuration element suggested by Biggy.

To view accepted suggestions that have been applied, select the Completed tab.

To view discarded suggestions, select the Discarded tab.

If no suggestions appear or if you would like to see new suggestions, select the Suggest Config Updates button.

Workflow Executions

The Workflow Executions section allows you to track how your Workflows are performing.

biggy_webapp_workflowexecutions.png

Workflow Executions 

The following report widgets are available in the Workflow Executions section:

Report

Description

Total Executions

Total number of times that all of your workflows have run. 

Average Duration

Average duration of a workflow run, in seconds.

Executions Over Time

Daily count of your workflow runs, over time.

Top Workflows

Top 10 most frequently executed workflows. Each workflow displays the number of times it was run, and the average run time. 

Daily Executions by Workflow

Breakdown of daily workflow runs by workflow name, over time.

All Workflow Execution Metrics

Detailed statistics for all executions, by workflow.

The following information is displayed for each workflow:

  • Workflow name - the name of the workflow, as defined in the workflow execution configuration

  • Workflow type - the type of workflow (scheduled workflow or channel hawk)

  • Total executions - the number of executions that took place 

  • Average duration - the average amount of time that the workflow took to execute

  • % of total - the percent of executions that used this workflow, out of the total

Recent Workflow Execution Results

The latest 500 workflow executions.

At the top of the section, you can filter by Workflow Name, Workflow Type, or App Type.

Click Export to CSV to download a CSV file containing the table. 

The following information is displayed for each workflow execution:

  • Workflow name - the name of the workflow, as defined in the workflow execution configuration

  • Workflow type - the type of workflow (scheduled workflow or channel hawk)

  • App - the chat tool where the workflow was executed (Slack or Teams)

  • Duration - the amount of time that the workflow took

  • Date - the date and time when the workflow execution occurred

  • Trigger message - the message that caused the workflow execution to occur

  • Response - Biggy's response resulting from the workflow execution

Next Steps

Find an overview of the Biggy Web App.

Find best practices and tips for Managing Incidents with Biggy.