Skip to content
Kindgi

kindgi judgments

Judge items of a run's output, yes or no (add / list / show / remove).

kindgi judgments add

Section titled “kindgi judgments add”

Judge one item of a finished run's output: yes or no, with an optional reason. Judging the same item again as the same caller replaces the earlier judgment.

Terminal window
kindgi judgments add --run=<run-id> --item=<key> [--pointer=<json-pointer>] [--rank=<n>] (--yes | --no) [--reason=<text>] [--class=<judge-class-id>] [--participant=<id>]

Flags:

  • --class <value>: The judge class id to record the judgment under. Without one, the judgment is unclassified.
  • --item <value>: Your stable id for the judged item, e.g. a matched case id. Required.
  • --no: The verdict is no. Give --yes or --no.
  • --participant <value>: Your opaque id for the end user who judged, when you judge on their behalf.
  • --pointer <value>: Where the item is in the run's output, as a JSON Pointer such as /matches/2. Its value is kept with the judgment.
  • --rank <value>: The item's position in a ranked list (0 = first).
  • --reason <value>: Why, recorded with the judgment.
  • --run <value>: The run whose output is judged. Required.
  • --yes: The verdict is yes. Give --yes or --no.

kindgi judgments list

Section titled “kindgi judgments list”

List judgments, newest first (replaced and removed ones are left out).

Terminal window
kindgi judgments list [--run=<run-id>] [--agent=<id> [--agent-version=<v>]] [--flow=<id>] [--verdict=yes|no] [--class=<judge-class-id>] [--participant=<id>] [--project=<id>] [--limit=<n>] [--cursor=<c>]

Flags:

  • --agent <value>: Only judgments of runs of this agent.
  • --agent-version <value>: Only judgments of runs of this agent version. Needs --agent.
  • --class <value>: Only judgments under this judge class id.
  • --cursor <value>: Resume after this cursor, from the previous page's nextCursor.
  • --flow <value>: Only judgments of runs of this flow.
  • --limit <value>: The most judgments to return (default 25, at most 100).
  • --participant <value>: Only judgments made for this end user's opaque id.
  • --project <value>: Only judgments in this project.
  • --run <value>: Only judgments of this run.
  • --verdict <value>: Only this verdict: yes or no.

kindgi judgments show

Section titled “kindgi judgments show”

Show a judgment with the stored copies of the run's input and output, and the judged item's value.

Terminal window
kindgi judgments show <judgment-id>

kindgi judgments remove

Section titled “kindgi judgments remove”

Remove a judgment.

Terminal window
kindgi judgments remove <judgment-id>

Every command also takes the global flags.