Data Redaction with UDC
Opt-in service
Data redaction is currently an opt-in service. If you are interested in enabling this functionality, contact your BigPanda account team.
Unified Data Connector required
Your organization must be ingesting data using the Unified Data Connector(UDC) to use the data redaction service.
Only data ingested through UDC connectors is affected by data redaction. Monitoring, change, and CMDB data passed through the event pipeline is not affected by data redaction.
Ensure your private data stays secure using the data redaction service. With data redaction, you can redact sensitive information ingested via the Unified Data Connector, including PII, PHI, and PCI, giving you confidence that your confidential data remains exclusively within your approved channels.
Enabling this service will strengthen your data protection by automatically identifying and removing sensitive information before it reaches the BigPanda platform. This ensures your established access controls remain effective while maintaining compliance with applicable regulatory data handling requirements.
How it works
Data redaction uses RegEx and natural language processing (NLP) to find sensitive data and remove it from the system. The service seamlessly integrates with the BigPanda Unified Data Connector, meeting all data security requirements of the platform.
Seamless integration - There is no change to how you integrate with the platform. BigPanda APIs will not change as the data flow occurs.
Customer segregation - Each BigPanda customer has their own data privacy vault. No data is shared between customers.
Data processing and storage - Data processing and redaction take place using the Unified Data Connector. Once the redaction process is complete, the cleansed data is then transmitted to BigPanda. Data containing sensitive information is not recoverable within BigPanda.
Data types
Data being transmitted to the BigPanda platform is identified as either Observability Data or Non-Observability Data:
The data redaction service is configured to detect a default set of non-observability data types for redaction. Data that matches these types will be completely redacted and unrecoverable.
Those data types include information such as:
Observability data is machine-generated, making it more structured, controlled, and predictable. This type of data generally does not contain sensitive information governed by privacy frameworks.
Non-observability data includes human-generated content that is less structured and predictable than machine-generated data. This creates a potential risk that the data could include sensitive information, including personal details, financial information, or other regulated data.
Advanced redaction available
If your organization has complex redaction or regulatory requirements, there are advanced options for data redaction. Contact your BigPanda account team for more information.
Standard Redaction Entities
The following entities are supported as part of standard data redaction:
Entity Type | Description | Detection Method |
|---|---|---|
CREDIT_CARD | A credit card number between 12 to 19 digits | Pattern match and checksum |
DATE_TIME | Dates, or periods or times smaller than a day | Pattern match and context |
EMAIL_ADDRESS | An email address | Pattern match, context, andRFC-822 |
IBAN_CODE | International Bank Account Number (IBAN) | Pattern match, context, and checksum |
IP_ADDRESS | Internet Protocol (IP) address (either IPv4 or IPv6) | Pattern match, context, and checksum |
NRP | A person’s nationality, religious or political group | Custom logic and context |
LOCATION | Name of a politically or geographically defined location | Custom logic and context |
PERSON | Include first names, middle names or initials, and last names | Custom logic and context |
PHONE_NUMBER | Telephone number | Custom logic, pattern match, and context |
MEDICAL_LICENSE | Common medical license numbers | Pattern match, context, and checksum |
US_BANK_NUMBER | US bank account number between 8 to 17 digits | Pattern match and context |
US_DRIVER_LICENSE | US driver’s license | Pattern match and context |
US_ITIN | US Individual Taxpayer Identification Number (ITIN) | Pattern match and context |
US_PASSPORT | US passport number with 9 digits | Pattern match and context |
US_SSN | US Social Security Number (SSN) with 9 digits | Pattern match and context |
UK_NHS | UK National Health Service number with 10 digits | Pattern match, context, and checksum |
UK_NINO | UK National Insurance Number | Pattern match and context |