Open Integration Manager Preprocessing Functions
Find information about preprocessing functions performed on complex OIM integrations.
Before being ingested into BigPanda, the Open Integration Manager performs preprocessing functions on some complex integrations. Preprocessing functions are essential components of OIM that transform, delete, create, or update incoming data before it reaches OIM. This allows the data to be mapped appropriately to tags in BigPanda. You can view these functions in the Integration Manager tab within OIM.
View Preprocessing Functions
Preprocessing functions are visible within the Integration Manager tab in OIM integrations. To view preprocessing functions used on the integration, click the Settings cog icon.
If there are no preprocessing functions performed on the integration, the Settings cog icon will be greyed out and display the number zero next to it.
The Preprocessing Functions window shows all global and custom functions applied for the integration. Click the arrow on the preprocessing function box to expand details about the function. The following information is available:
- Function name
- Description
- Source tags
Available Preprocessing Functions
The following preprocessing functions are used in the Open Integration Manager:
Function name | Description | Integrations |
---|---|---|
dateToString | Converts a date string or epoch string into a formatted date string. | Splunk |
valueMap | Translates values based on a setstatic map. | Entuity AppDynamics |
duplicate | Duplicates the selected tags in the payload, adding with a prefix. | Datadog AppDynamics |
split | Splits a string into an array of items. | Datadog |
addTag | Adds a new tag to the payload. | Splunk |
keyValuePairParser | Parses an array of strings into separate tags containing each value to create a key value entry in the object. | Datadog |
sanitizeMarkdown | Converts markdown to regular text. | Datadog |
replace | Replaces the tag or value for a given tag. | Splunk Datadog LogScale |
mathOps | Runs a math operation made up of an expression and arguments. | Splunk |
timeStringToSeconds | Turns a time string such as 1h or 2m into seconds. | Splunk |
decodeURI | Decodes URI encoded strings. | Entuity |
regexExtraction | Uses a regular expression to extract a value from a tag into a new tag name. Note: This function returns the matched text, it does not support capture groups. | Cloudwatch |
coalesceToTag | Checks for the presence of each tag in the payload, finds the first match containing a value, and assigns it to the value in coalescedTagName as well as the value in the payload. | Cloudwatch |
deleteTag | Deletes a tag in the payload. | Cloudwatch Splunk |
findAndMoveItemUp | Finds an object in an array and moves it up one level as a single object. Item object is passed into the expression. | Cloudwatch |
cloudwatch_processDimensions | Loops through the dimensions array in a CloudWatch alert and sets specific properties for the object and dimensions key. | Cloudwatch |
cloudwatch_processMetrics | Loops through the metrics array in a CloudWatch alert and expression, operator and check property. | Cloudwatch |
cloudwatch_processSubscriptionConfirmation | Processes the CloudWatch subscription confirmation type. The message does not result in an alert and does not go to OIM. | Cloudwatch |
stringToObject | Parses a string and converts it to a JSON object. | Cloudwatch LogScale |
Updated 11 months ago