What is evidence?

Rainbird can provide evidence for every decision made. This transparency provides explainability and traceability, which ensures important decisions can be automated, trusted and audited.

We have a range of methods available to view evidence data visually, or for programmatic access via API.

Evidence can also be provided from different perspectives. When combined this provides a 360 degree view of decisions made.

This includes:

Interaction data

This is a log of interactions with the engine, including any questions and answers going back and forth between the end-user and Rainbird. This provides an external view of what data was provided to the model, and the decision(s) made. For Subject Matter Experts (SMEs) this can often be enough to determine whether the decisions provided aligns to their own judgement, based on the input data. If further introspection is required, then the evidence for each decision can also be accessed. Interaction History can be accessed from the Studio under Stats & Reporting. The data can also be accessed via API from the /interactions end-point.

Evidence data

For each individual decision made, a chain of reasoning (what we call the Evidence Tree) can be accessed. This shows what inferences were made, how they were made, the impact of the data to the certainty and the source of this data. The Evidence Tree can be viewed as a visual representation in our evidence application. This can be accessed from Studio anytime a result is shown with the (i) symbol next to it. It is also available via API from the /evidence end-point.

Session data

This provides both metadata about the session (such as the name, ID and version of the knowledge map) but it also provides the ability to access all facts from the session. This includes all facts from all sources (hard-coded in the map, retrieved from a datasource, injected into the session, inferred from a rule or answered by a user) regardless of whether they contributed to a decision or not.

Even when data hasn't directly contributed to a decision, it can be useful to include in reports following a decision, as it can provide helpful context. This is available as an API only and provides the easiest way to extract all data from a session in order to compile reports.

For a reminder on sessions, head to What is a session?.

To ensure we store or delete this data in accordance with your industry or organisational requirements a data retention policy can be set. To find out more, check out Managing your data.