Risk

The Risk page provides functionality to systematically analyze and visualize risks that occur during LLM Traces and Decision processes. This allows you to quickly identify high-risk situations, understand recurring problem patterns, and improve the overall stability of your LLM applications.

Risks are automatically generated based on various elements that make up a Trace. By configuring Traces through the SDK, users can leverage risk analysis immediately without any additional setup.

Tip
When using the SDK, setting span_type appropriately (e.g., rag, select) helps the system better interpret the decision-making flow, resulting in more accurate and insightful risk analysis.

Trace Tab

The Trace tab provides risk analysis at the Trace level. Each Trace can have one or more Risk Tags. You can filter Traces by Risk Tag to focus on specific types of risks. Trace-level risk scores help you quickly identify Traces with a high likelihood of issues.

Decision Tab

The Decision tab allows you to view Decision Signals generated during the Decision process.

Decision Signals are color-coded based on their risk level:

• Red: 0.7 or higher

• Yellow: 0.5 or higher

• Green: below 0.5

Each Signal represents a potential risk that occurred during the agent’s decision-making process.

The page also provides quadrant analysis based on Review Priority and Frequency, allowing you to intuitively identify:

• Decisions that require immediate review due to high risk and high frequency

• Decisions with lower priority but significant cumulative impact

• Rare but potentially critical Decisions

Clicking on a Decision Signal navigates you directly to the corresponding Decision detail page.