AI Incident Prevention Dashboards
The AI Incident Prevention module helps you assess and analyze the risk associated with proposed changes in your IT environment. It calculates a risk score based on specific change fields and compares the current planned change details with data from your change integrations to identify potential risks.
Use the Change Analytics and Change Risk Prediction dashboards to find risk prediction information for change requests.
Change Analytics
The Change Risk Analytics page provides a high-level analysis of changes in your IT environment for a specific time period.
The drop-down menu at the top right of the screen allows you to adjust the selected time period.
The following widgets are available in the Change Risk Analytics dashboard:
Widget | Description |
|---|---|
Risk Posture | How well your organization is doing from a change risk perspective. This score is based on the percentage of changes that were considered low risk. |
Risk Trend | Whether your organization's change risk scores are getting better or worse, and the percent change over the selected time period. |
Top Performer | The team that deployed changes with the lowest average risk score, and their success percentage. |
Riskiest CI Category | The configuration item (CI) category with the highest average risk score. |
Total Changes | The total number of changes, and the percent change for the selected time period. |
Average Risk Score | The average risk score across all changes, and the risk score percent change for the selected time period. |
Risky Changes Identified | The percent of changes that were identified as high risk, and the risk score percent change for the selected time period. |
Success Rate | The average success rate of changes, and the risk score percent change for the selected time period. |
Risk Trend | A graph displaying the risk score change over the selected time period. Hover over a specific day on the graph to see the average risk score for that day. |
Risk Distribution | A pie chart displaying the distribution of change risk levels. |
Team Change Health | A comparison of each team's percentage of successful changes, and the number of risky changes. The calculation for success rate is (total changes - incidents caused) / total changes. |
Risk by CI Category | Risk information for changes grouped by the category of their affected CIs. For each CI, the number of changes, incidents, success percentage, average risk score, and number of incidents that were either critical or high severity. |
Riskiest Times to Deploy | The riskiest times to deploy, broken down by Riskiest Day and Riskiest Time. Riskiest Day shows the average risk score by day of the week for changes scheduled in the selected time period. The riskiest day and safest day are highlighted below the full week. Riskiest Time is an hourly risk analysis shown in your local time zone. The riskiest time and safest time are highlighted below the full day. |
Risk Score Averages and Weights | Shows the average risk score for each risk component across all analyzed changes, and the component's relative importance (weight). |
Incidents Caused by Changes
The Incidents Caused by Changes section of the Change Risk Analytics dashboard displays data about incidents that were caused by changes.
The following widgets are available in this section:
Widget | Description |
|---|---|
Prediction Accuracy | The percentage of risk predictions that accurately identified the outcome of the change. Prediction accuracy is measured using the following calculations:
The formula is (True positives + True negatives) / Total Changes x 100 Medium risk changes are excluded from the calculation. |
Incident Rate | Displays the percent of changes that caused an incident, the number of changes that resulted in an incident out of the total number of changes, and the total number of incidents caused by changes. |
False Negatives | The percent of low-risk changes that resulted in an incident. |
False Positives | The percent of high-risk changes that didn't cause an incident. |
Risk Rating vs. Actual Incidents | A bar chart showing how well risk ratings predict incidents, broken down by the risk level. Hover over a section of the chart to see the number of changes with or without incidents for that risk level. |
Incident Severity | A pie chart showing the distribution of incident priorities for all incidents caused by changes. |
Incident Timeline | A line graph showing a daily view of changes vs. incidents caused by the change over the selected time period. Hover over a specific day to see the number of changes that were implemented and the number of incidents that occurred on that day. |
Teams Causing the Most Incidents | Assignment groups causing the most incidents from their changes. |
Changes that Caused the Most Incidents | Changes that directly caused incidents, showing change details and related incident information. |
Change Risk Dashboard
AI Incident Prevention required
Your organization must have the AI Incident Prevention module to access the Change Risk Dashboard. If you're interested in purchasing this, contact your BigPanda account team.
Within the Change Risk Dashboard, view all change requests and their associated risk, predicted by AI Incident Prevention.
By default, all changes for the next 30 days appear on the page. You can filter the list using the Date Range or Assignment Group filters.
To find a specific change, use the Search bar. You can search for a change number or keyword.
Below the filters and search bar is the Change Volume by Risk Level graph. This displays the total number of changes broken down by risk level.
The following information about each change appears on the Change Risk Dashboard screen:
Change number
Short description
Full description
Assignment group
Scheduled start
Risk rating
Risk score
Click any change in the dashboard to open the Change Risk Assessment screen.
Change Risk Assessment
The Change Risk Assessment screen shows you details about the potential risk associated with the selected change.
The assessment screen is divided into the following tabs:
Change Details
The Change Details tab displays high-level information about the selected change.
The screen is divided into the following sections:
Section | Description |
|---|---|
Change Information | High-level information about the change. The following details are displayed in this section:
If the change requires attention, a red box with an exclamation point will appear describing the requirements. |
AI Risk Assessment | The risk assessment score and risk rating. Click View Details to open the Risk Prediction tab. |
Change Plan | Steps to take to implement the change. |
Justification | Reasoning behind the change plan. |
Test Plan | Steps to take to test after the change to ensure it was successful. |
Backout Plan | Steps that can be taken if the change needs to be reversed. |
User-Declared Risk | The risk level of the change defined by the user who opened it. |
User-Declared Risk Analysis | The risk analysis of the change defined by the user who opened it. |
Approval Information | People who need to review the change before it can be implemented. The following information about each approver is displayed:
|
Affected Services | Services potentially affected by the change. |
Affected CIs | Systems and services that will potentially be affected by this change. The following information about each CI is displayed:
|
Related Change Tasks | Tasks that need to be completed as part of the change. The following information about each task is displayed:
|
Historical Analysis
The Historical Analysis tab displays similar changes and related incidents that were used as part of the change risk profile. These changes and incidents may provide additional context.
The Historical Analysis screen is divided into the following sections:
Section | Description |
|---|---|
CI Risk Analysis | The risk assessment for configuration items affected by this change, based on historical incident data. This information can be displayed in Card View or Table View. The following information appears for each CI:
|
Similar Changes | Changes that are similar in nature or affect the same CIs. A box displaying the change number, description, and date appears for each similar change. Click a box to view additional information including the full description, similarity reasoning, resolution of the incident (if applicable), and linked incidents. |
Additional Relevant Incidents | Incidents that were not linked to a change, but are considered relevant given the nature or affected CIs of the current change. A box displaying the incident number, description, date, and shared CIs appears for each relevant incident. Click a box to view additional information including the full description, similarity reasoning, and resolution of the incident (if applicable). |
Relevant Ancillary Context | Information across all available contexts that was deemed potentially relevant to the current change. |
Team History
The Team History tab shows the historical performance records of the team and the individual responsible for the change.
You can view history by Team Metrics or Individual Metrics.
The Team History screen shows the following information:
Field | Description |
|---|---|
Team | The team name, reliability score, and deployment frequency score. |
Individual | The individual's name, reliability score, and deployment frequency score. |
Total Changes | The total number of changes deployed by the team. |
Incident Rate | The incident rate compared to the number of changes the team was responsible for. |
Success Rate | The percent of successful changes that the team was responsible for. |
Change Timeline | A timeline of changes over the past 12 months. The blue bars represent changes, the orange bars represent incidents, and the green line represents the change success rate. |
Recent Team/Individual Incidents | The most recent incidents caused by changes the team or individual was responsible for. The following information about each incident is displayed:
|
Organization-Specific Risk Evaluation
The Organization-Specific Risk Evaluation tab displays a custom risk evaluation based on factors and context specific to your organization.
Configuration
To view org-specific risk information, you must configure org-specific settings in the Change Risk Prediction action plan.
The following information is displayed:
Section | Description |
|---|---|
Risk Evaluation Summary | Short summary of the org-specific risk evaluation. |
Org-Specific Risk Assessment | The risk score. |
Evaluation Confidence Level | How confident AI Incident Prevention is in the evaluation. |
Specific Risk Factors | List of specific factors contributing to the risk score. |
Ambiguities | Ambiguous factors related to the change that contribute to the risk score. |
Risk Prediction
The Risk Prediction tab displays widgets containing information about the predicted risk level of the change.
The following widgets are displayed:
Widget | Description |
|---|---|
Risk Prediction | AI-powered risk assessment based on previous changes. The following scores are displayed:
|
Overall Risk Rating | The risk assessment of the change with all factors combined. The date and time of the last assessment appears under the risk rating. |
Risk Reasoning | Explanation of the reasoning behind the risk assessment. |
Risk History | How the change's risk assessment has evolved over time. |
Suggested Mitigations | Suggested steps that can be taken to mitigate risks associated with the change. |
Graph View
The Graph View tab visualizes the relationships between the change, similar changes, and related incidents.
The graph view is coded by color:
Current change - purple
Similar change - purplish blue
Incident - red
Configuration item - blue
Hover over any of the items in the graph to view additional information such as the number, description, and risk level.
To see a larger view, click the Full screen button.
To view a text version of the visualization, click the List View tab.
