Data Redaction
Opt-in service
Data redaction is currently an opt-in service. If you are interested in enabling this functionality, contact your BigPanda account team.
Unified Data Connector required
Your organization must be ingesting data using the Unified Data Connector to use the data redaction service.
Ensure your private data stays secure using the data redaction service. With data redaction, you can redact sensitive information ingested via the Unified Data Connector, including PII, PHI, and PCI, giving you confidence that your confidential data remains exclusively within your approved channels.
Enabling this service will strengthen your data protection by automatically identifying and removing sensitive information before it reaches the BigPanda platform. This ensures your established access controls remain effective while maintaining compliance with applicable regulatory data handling requirements.
How it works
Data redaction uses RegEx and natural language processing (NLP) to find sensitive data and remove it from the system. The service seamlessly integrates with the BigPanda Unified Data Connector, meeting all data security requirements of the platform.
Seamless integration - there is no change to how you integrate with the platform. BigPanda APIs will not change as the data flow occurs.
Customer segregation - each BigPanda customer has their own data privacy vault. No data is shared between customers.
Data processing and storage - data processing and redaction take place using the Unified Data Connector. Once the redaction process is complete, the cleansed data is then transmitted to BigPanda. Data containing sensitive information is not recoverable within BigPanda.
Data types
Data being transmitted to the BigPanda platform is identified as either Observability Data or Non-Observability Data:
Observability data is machine-generated, making it more structured, controlled, and predictable. This type of data generally does not contain sensitive information governed by privacy frameworks.
Non-observability data includes human-generated content that is less structured and predictable than machine-generated data. This creates a potential risk that the data could include sensitive information, including personal details, financial information, or other regulated data.
The data redaction service is configured to detect a default set of non-observability data types for redaction. Data that matches these types will be completely redacted and unrecoverable.
Those data types include information such as:
PCI - Bank account or credit card number, etc.
PHI - Healthcare number
PII - Passport number, Social Security number, driver license, address, etc.
Account Information - Username, password, secrets, encryption/API keys, AWS AKIA keys, etc.
If your organization has complex redaction or regulatory requirements, there are advanced options for data redaction. Contact your BigPanda account team for more information.