kindgi test-sets

`kindgi test-sets`

Synopsis

kindgi test-sets <command>

Signature

Test sets (list / show / cases). An agent's corrections are its test set: kindgi agents has no command for it yet.

Commands

Command	Description
`kindgi test-sets list`	List test sets (the latest version of each).
`kindgi test-sets show`	Show a test set: its latest version, or the one named by `--test-set-version`.
`kindgi test-sets cases`	List the cases of a corrections test set version.

See also

`kindgi test-sets list`

Synopsis

kindgi test-sets list [--project=<id>] [--kind=accuracy|pairwise|regression|human-review|benchmark|custom|corrections] [--include-retired] [--limit=<n>] [--cursor=<c>]

Signature

List test sets (the latest version of each).

Options

Option	Default	Description
`--cursor <value>`	none	Resume after this cursor, from the previous page's `nextCursor`.
`--include-retired`	off	Include retired test sets (every version unregistered), each as its highest version with `unregisteredAt`.
`--kind <value>`	none	Only this kind: accuracy, pairwise, regression, human-review, benchmark, custom, corrections. `corrections` lists agents' own test sets, which the list leaves out otherwise.
`--limit <value>`	`25` (at most `100`)	The most to return (default 25, at most 100).
`--project <value>`	none	Only test sets in this project.

Every command also takes the global flags.

Examples

List the accuracy test sets of a project.

kindgi test-sets list --project=<project-id> --kind=accuracy

List test sets including retired ones.

kindgi test-sets list --include-retired

See also

`kindgi test-sets show`

Synopsis

kindgi test-sets show <test-set-id> [--test-set-version=<semver>]

Signature

Show a test set: its latest version, or the one named by --test-set-version.

Options

Option	Default	Description
`--test-set-version <value>`	the latest version	The version to show. Default: the latest.

Every command also takes the global flags.

Examples

Show a test set's latest version.

kindgi test-sets show acme.article-picks

Show one version of a test set.

kindgi test-sets show acme.article-picks --test-set-version=1.0.0

See also

`kindgi test-sets cases`

Synopsis

kindgi test-sets cases <test-set-id> --test-set-version=<semver> [--limit=<n>] [--cursor=<c>]

Signature

List the cases of a corrections test set version.

Options

Option	Default	Description
`--cursor <value>`	none	Resume after this cursor, from the previous page's `nextCursor`.
`--limit <value>`	`25` (at most `100`)	The most to return (default 25, at most 100).
`--test-set-version <value>`	required	The test set version. Required.

Every command also takes the global flags.

Examples

List the first page of the test cases.

kindgi test-sets cases acme.article-picks --test-set-version=1.0.0

Fetch the next page of cases.

kindgi test-sets cases acme.article-picks --test-set-version=1.0.0 --limit=50 --cursor=<cursor>

See also