17. Diagnostic and Security

Logging

Using Workflow Logs

By default all steps executed within a Workflow are logged. Here are the different ways you can view these logs:

  • See a live view of Workflow logs while a Workflow is running in the Design pane.
  • See recent runs of a Workflow from its Workflow Landing pane.
  • Search logs for a specific Workflow from the Workflow Landing pane by clicking Workflow Logs.
  • See recent logs for a specific Node from the Workflow Design pane by clicking on the Node Header v → Load Recent Logs.
  • Search across logs for all Workflows from the Workflow Logs pane accessed from the left-hand menu.

In some log views, there are two coloured circles on the left side of each log row. The first represents the Workflow so where you see the same color across multiple rows, this indicates the same Workflow. The second indicates the Workflow instance or in other words the run of a particular Workflow. Where you see the same color over multiple rows, this indicates that the logs belong to the same instance of the Workflow.

These guides are helpful when you're searching across multiple Workflows or multiple instances of the same Workflow as they enable you to tell the logs apart without viewing their detail properties.

As you hover a log row, you'll see a button on the left-hand side. Clicking this button opens a context menu showing options available for the selected log.

  • Go to Workflow Design opens the Design pane for the Workflow the log belongs to in a new browser tab.
  • Go to sub-Workflow drills in to an entry for the Workflow Node where a sub-Workflow is being invoked.
  • Show from Start Log loads a log that displays the first entry for the instance of the Workflow (i.e. the Start Node entry).
  • Show with Parent/Child Workflows loads a log showing the parent Workflow and all child Workflows in a single view (by default, child Workflows are not shown).

In some log views, you can filter by a date and time. These will be defaulted to the current time. Log searches work backwards so searching from a specific date and time returns the first 100 log rows up to that time. If you want to see a page of earlier log rows, click the Search Earlier than... label.

For more information, see Workflow Log Pane.

Low Logging

Although having detailed logs is helpful for diagnosing issues, in some cases this amount of logging can slow down Workflow execution. This is particularly likely when Workflows contain a large number of steps that execute very quickly.

You can reduce the amount of logging on a Workflow from the Workflow Design pane by opening Workflow Settings and setting Log Level to Low Logging instead of Full Logging.

In this mode, only Workflow Start entries and Nodes that end with an error will be logged.

For more information, see Workflow Log Logging.

Property Redaction

If a Workflow processes sensitive information, you may wish to redact sensitive Properties.

From the Workflow Design Pane, click the label of a Property of a Node you wish to redact and switch the Logged dropdown to Redacted.

Redacted Properties are indicated in yellow and their values are never logged even if the Node errors. When using this feature, take care to trace all downstream Properties that may include sensitive data and mark them as redacted too. For example, if you redact an input Custom Property, you should also redact the output Property on the Node if the value of the Custom Property will appear somewhere within it.

For mre information see For more information, see Property Redaction.

Metrics

Metrics are access from the left-hand menu and provide a summary of Workflow activity in the context of a subscription.

You can change the period of time the metrics are shown for by using the filter provided.

  • Total Active Workflows shows the peak Active Workflows over a period.
  • Active Workflows by Mode breaks down peak Active Workflows by API-invoked, Always On and all other categories.
  • Workflow Activations shows the number of top-level Workflows that have activated over a period along with the number of activations that terminated with an error.
  • Sub-Workflow Activations shows the number of sub-Workflow invokes over a period along with the number of sub-Workflow invokes that ended with an error.
  • Node Activations shows the number of Nodes invoked over a period along with the number that ended with an error.

Relationships

Certain Flowgear plans allow you to explore relationships between different objects such as Workflows, Connections, API Keys and DropPoints.

Click the chain link icon on the relevant screen to see a tree view of all related objects.

This technique is useful when you want to understand the impact of a change. For example, you can see whether a Workflow is used by another Workflow or whether a Connection is in use in any Workflows.

The Relationships pane allows you to select the Environment you'd like to view relationships in context for. This is because when Release Management is enabled, relationships between objects could be different across different Environments.

Audit Trail

Key events in the platform such as saving a Connection or promoting a Workflow are stored in an audit trail. You can access an audit trail of events for an object by clicking the padlock icon from that object pane.

Export

You can export the content of most panes by clicking the download button on the right-hand side. For panes like Workflow or Connection lists, this option will give you a CSV document of the list of objects.

For the Workflow Design pane, you can use the export button to get a JSON view of the Workflow or download an SVG representation of it.