Core concepts
The mental model behind Tracira. Workspaces, projects, tasks, logs, and rules, plus how a single AI output travels from submitted to reviewed.
Tracira sits between your AI automation and your customers. Your automation produces an output, you send that output to Tracira, Tracira checks it against your rules, and anything risky is held back for a human to approve or reject. This page explains the pieces involved and how they fit together.
The building blocks
Everything in Tracira lives inside a few nested objects:
Workspace
└─ Project "support-replies"
├─ Task "draft"
│ ├─ Log
│ └─ Log
└─ Task "summary"
└─ Log- Workspace is the top-level boundary. It holds your members, billing, and integration settings (webhook token, API key, Slack, model keys). Every other object belongs to exactly one workspace.
- Project groups everything for one automation or use case. It collects logs and can carry its own rules. A project has a name and an optional icon.
- Task is an optional layer inside a project. Use it to separate different steps or output types of the same automation, for example a "draft" step and a "summary" step.
- Log is a single AI output you sent for evaluation. It carries the output text (and optionally the input that produced it), the model, cost, latency, any metadata you attach, and the evaluation results described below.
You do not pre-create anything
Name a project (and optionally a task) when you submit a log and Tracira creates them on the spot if they do not exist yet. You can also create, rename, and organize them in the dashboard.
Rules
A rule is one condition that every matching output is checked against. Rules come in two families:
- Deterministic rules run in code: exact, instant, and free. They cover keyword required or forbidden, regular expression matches, length limits, and checks on a field inside JSON output (a value exists, equals something, falls in a numeric range, is a boolean, or carries a date inside a window). No AI is involved, so they cost no credits.
- LLM judge rules are written in plain English, for example "Flag if the reply promises a refund". An AI model reads the output and decides whether the rule passed or failed. These handle nuance that exact matching cannot, and each evaluation costs credits.
Every rule applies at one of three scopes, which decides the logs it runs against:
| Scope | Applies to |
|---|---|
| Global | Every log in the workspace |
| Project | Only logs in that project |
| Task | Only logs for that task within a project |
When a log is evaluated, every rule whose scope matches runs against it.
What you get back
For each log, every matching rule produces an outcome: passed, failed, or
skipped (skipped when the rule could not apply, for example a JSON field it needed
was missing). Those individual outcomes roll up into three separate fields on the log.
They are easy to confuse, so it is worth keeping them straight:
| Field | Values | What it tells you |
|---|---|---|
| Status | pending, pass, flagged, error | Where the log is in its lifecycle. pending while evaluation runs, pass if nothing triggered, flagged if it needs a human, error if evaluation could not complete. |
| Verdict | pass, fail, unsure | The evaluation's judgment of the output itself. |
| Score | 0 to 100% | How confident Tracira is in that verdict. |
Each log also gets a short plain-English explanation summarizing why it landed where it did.
Human review
A flagged log waits for a person. Reviewers see it in the dashboard, and you can
also be notified by Slack or email. The reviewer makes one of three decisions:
- Approve: the output is fine, let it through.
- Reject: the output is bad, block it.
- Change: send the output back to the AI with a written instruction. Tracira records the new attempt as a revision linked to the original.
The decision is stored on the log, including who made it and when. If a step in your workflow is waiting on the result, Tracira can call back once the decision is made.
The lifecycle
Putting it together, a single output moves through four stages:
Submit
Your automation POSTs the AI output to your webhook. Tracira returns a log id
immediately.
Evaluate
Every in-scope rule runs against the output, and Tracira sets the status, verdict, and score.
Branch
If the status is pass, the log is done. If it is flagged, the log waits for human
review.
Decide
A reviewer approves, rejects, or sends the output back for a change, and any waiting workflow is notified.
Synchronous results
By default evaluation runs in the background and the webhook returns right away with
status: pending. Pass sync: true to hold the connection open and receive the
verdict in the same response, which is what you want when a workflow needs to gate on
the result before continuing.
Next steps
- Connect your automation: Make, n8n, or any HTTP client.
- Read the full API reference for every endpoint and field.
- Review rate limits before you go to production.