Skip to main content

Open Integration Manager Preprocessing Functions

Before being ingested into BigPanda, the Open Integration Manager performs preprocessing functions on some complex integrations. Preprocessing functions are essential components of OIM that transform, delete, create, or update incoming data before it reaches OIM. This allows the data to be mapped appropriately to tags in BigPanda. You can view these functions in the Integration Manager tab within OIM.

View Preprocessing Functions

Preprocessing functions are visible within the Integration Manager tab in OIM integrations. To view preprocessing functions used on the integration, click the Settings cog icon.

https://files.readme.io/c5847ca-Integrations_OIM_Preprocessing.png​​

No preprocessing functions

If there are no preprocessing functions performed on the integration, the Settings cog icon will be greyed out and display the number zero next to it.

The Preprocessing Functions window shows all global and custom functions applied for the integration. Click the arrow on the preprocessing function box to expand details about the function. The following information is available:

  • Function name

  • Description

  • Source tags

Integrations_OIM_PreprocessingScreen.png

On the right side of the screen, a sample payload preview is available.

Available Preprocessing Functions

The following preprocessing functions are used in the Open Integration Manager:

Function name

Description

Integrations

dateToString

Converts a date string or epoch string into a formatted date string.

Splunk

valueMap

Translates values based on a setstatic map.

Entuity

AppDynamics

duplicate

Duplicates the selected tags in the payload, adding with a prefix.

Datadog

AppDynamics

split

Splits a string into an array of items.

Datadog

addTag

Adds a new tag to the payload.

Splunk

keyValuePairParser

Parses an array of strings into separate tags containing each value to create a key value entry in the object.

Datadog

sanitizeMarkdown

Converts markdown to regular text.

Datadog

replace

Replaces the tag or value for a given tag.

Splunk

Datadog

LogScale

mathOps

Runs a math operation made up of an expression and arguments.

Splunk

timeStringToSeconds

Turns a time string such as 1h or 2m into seconds.

Splunk

decodeURI

Decodes URI encoded strings.

Entuity

regexExtraction

Uses a regular expression to extract a value from a tag into a new tag name.

Cloudwatch

coalesceToTag

Checks for the presence of each tag in the payload, finds the first match containing a value, and assigns it to the value in coalescedTagName as well as the value in the payload.

Cloudwatch

deleteTag

Deletes a tag in the payload.

Cloudwatch

Splunk

findAndMoveItemUp

Finds an object in an array and moves it up one level as a single object. Item object is passed into the expression.

Cloudwatch

cloudwatch_processDimensions

Loops through the dimensions array in a CloudWatch alert and sets specific properties for the object and dimensions key.

Cloudwatch

cloudwatch_processMetrics

Loops through the metrics array in a CloudWatch alert and expression, operator and check property.

Cloudwatch

cloudwatch_processSubscriptionConfirmation

Processes the CloudWatch subscription confirmation type. The message does not result in an alert and does not go to OIM.

Cloudwatch

stringToObject

Parses a string and converts it to a JSON object.

Cloudwatch