Skip to main content
Every signal starts as a candidate. Nothing is auto-confirmed — the first job on the queue is your verdict. ‘Confirm failure’ makes it a fix target. ‘Not a failure’ removes it from the cluster counts. That exact line sits in the drawer as guidance.

The signal detail drawer

Click a signal in the list and a drawer opens on the right. The drawer stays live while the row is on screen — its cluster field auto-updates the moment the background job assigns one (a short 군집 배정 중 badge shows while it runs). At the top: the summary title, a View trace → link, and the ID, Source type, Flow, and Severity. Tabs below move between sections.

Confirm failure

Press [Confirm failure] and the signal becomes a fix target. Effects:
  • The button stays in its confirmed state — reopen the drawer and the verdict is still there.
  • The cluster + case are created in the background. A case appears in the parent cluster with your comment as the answer key (see Cases).
  • The parent cluster is created only at this moment if no matching cluster exists yet. Empty clusters never accumulate — candidates alone don’t spawn one.
These cases later become the test cases for experiments in Simulation.

Not a failure

If it’s a false alarm or acceptable as-is, press [Not a failure]. The signal drops out of the cluster counts and moves to the excluded verdict.

Guardrail (F) signals — 정상 차단 vs 오발

Guardrail signals need a two-way call:
  • 정상 차단 (correct block) — the AI did say something it shouldn’t have. Confirmed → cluster → case. The blocked answer text is included in the case as the wrong output.
  • 오발 (misfire) — the answer was fine and the block was over-eager. Excluded with reason guardrail_misfire; the drawer links to the rule so you can tune or disable it.
The blocked answer is preserved on the signal payload only — it never lands in the run output, session memory, or downstream events.

Leaving good feedback

As the Feedback tab itself says: the more specific, the better. Say what was wrong and what the correct answer or desired direction was — it becomes this case’s answer key. Write it like the placeholder example:
The interaction is factual but has no source; fix by adding a citation, not by refusing.

After the verdict

Confirmed failures get grouped into clusters and become the raw material for improvement. From a cluster, Run simulation experiments with candidate fixes. See From signal to fix.