kindgi proposals
kindgi proposals
Section titled “kindgi proposals”Synopsis
kindgi proposals <command>Suggested changes: new content for a data block an agent pins, for one scope; evaluated on the test cases, then made live through the scope's release gate policy (list / get / draft / evaluate / request / rollback / withdraw / improve / passes).
Commands
| Command | Description |
|---|---|
kindgi proposals list |
List suggested changes, newest first: only those of agents you can read. |
kindgi proposals get |
Show a suggested change: its change, status, candidate versions, the run on the test cases it was evaluated on and its request to make it live. |
kindgi proposals draft |
Draft a suggested change by hand: new content for one block the agent version pins (settings values, or the agent's instructions), for one scope. |
kindgi proposals evaluate |
Evaluate a suggested change on the test cases: a run on the test cases that tries the candidate against the version it changes. |
kindgi proposals request |
Ask to make a suggested change live: its candidate version, for its scope, through the scope's release gate policy with its evaluation. |
kindgi proposals rollback |
Roll back a suggested change that was made live: its scope goes back to the version that served it before. |
kindgi proposals withdraw |
Withdraw a suggested change before review, or after its request to make it live was refused, superseded or expired. |
kindgi proposals improve |
Ask the runtime to look for better values for the settings an agent version marks as what Improve may change — or, with --tier=prompt, have a model draft new instructions — for a scope, within a budget. |
kindgi proposals passes |
Improve runs: the runtime looking for better settings (list / get / cancel). |
See also
kindgi proposals list
Section titled “kindgi proposals list”Synopsis
kindgi proposals list [--agent=<agent-id>] [(--tenant | --org=<org-id> | --project=<project-id> [--segment=<key:value>]…)] [--tier=settings-block|prompt-block] [--status=<status>] [--limit=<n>] [--cursor=<cursor>] [--table]List suggested changes, newest first: only those of agents you can read. A scope flag keeps the suggested changes for exactly that scope. A status filter is applied after the page is read, so a page can hold fewer than --limit.
Options
| Option | Default | Description |
|---|---|---|
--agent <value> |
none | Only this agent's suggested changes. |
--cursor <value> |
none | The next page, from nextCursor. |
--limit <value> |
25 (at most 100) |
Page size. |
--org <value> |
none | An org, by id. |
--project <value> |
none | A project, by id; with --segment, a segment in it. |
--segment <value> |
none | One step of the segment path, key:value (e.g. company:acme); repeat it in order, coarse to fine. Needs --project. Repeatable. |
--status <value> |
none | One of: draft, evaluating, evaluated, not-better, evaluation-failed, in-review, promoted, refused, rejected, expired, superseded, rolled-back, withdrawn. |
--tenant |
off | The whole tenant. |
--tier <value> |
none | settings-block or prompt-block. |
Every command also takes the global flags.
Examples
From Suggest a change, and test it:
pnpm exec kindgi proposals list --agent=acme.rank.scorer --tableSee also
kindgi proposals get
Section titled “kindgi proposals get”Synopsis
kindgi proposals get <proposal-id>Show a suggested change: its change, status, candidate versions, the run on the test cases it was evaluated on and its request to make it live.
Options
Every command also takes the global flags.
Examples
From Suggest a change, and test it:
pnpm exec kindgi proposals get <proposal-id>See also
kindgi proposals draft
Section titled “kindgi proposals draft”Synopsis
kindgi proposals draft --agent=<agent-id> --from-version=<semver> (--tenant | --org=<org-id> | --project=<project-id> [--segment=<key:value>]…) --block=<block-id> (--values=<json>|@<file> | --template=<text>|@<file>) --hypothesis=<text> [--judgment=<judgment-id>]…Draft a suggested change by hand: new content for one block the agent version pins (settings values, or the agent's instructions), for one scope. The same change from the same version for the same scope returns the suggested change drafted before. Needs publish on the agent.
Options
| Option | Default | Description |
|---|---|---|
--agent <value> |
required | The agent. |
--block <value> |
required | The data block to change; the version must pin it. |
--from-version <value> |
required | The agent version the change applies to. |
--hypothesis <value> |
required | What the change should improve, and why. |
--idempotency-key <value> |
none | A retry with the same key returns the first call's result. |
--judgment <value> |
none | A correction behind the change (repeatable): kept as evidence. Repeatable. |
--org <value> |
none | An org, by id. |
--project <value> |
none | A project, by id; with --segment, a segment in it. |
--segment <value> |
none | One step of the segment path, key:value (e.g. company:acme); repeat it in order, coarse to fine. Needs --project. Repeatable. |
--template <value> |
none | The agent's instructions (a prompt block), new text: inline or @<file>. |
--tenant |
off | The whole tenant. |
--values <value> |
none | A settings block's new values: a JSON object, inline or @<file>. |
Every command also takes the global flags.
Examples
From Suggest a change, and test it:
pnpm exec kindgi proposals draft --agent=acme.rank.scorer --from-version=1.0.0 --tenant \See also
kindgi proposals evaluate
Section titled “kindgi proposals evaluate”Synopsis
kindgi proposals evaluate <proposal-id> --test-set=<suite-id> [--objective=weightedYesShare|weightedPrecisionAtK] [--reads=recorded|live] [--repetitions=<n>] [--k=<n>] [--class-weights=as-recorded|restricted-only] [--wait] kindgi proposals evaluate <proposal-id> --rescore [--wait]Evaluate a suggested change on the test cases: a run on the test cases that tries the candidate against the version it changes. The first evaluation publishes the block version and derives the agent version; they serve no scope until made live, so the agent needs a live version for the whole tenant (kindgi agents promote <agent-id> <version> --tenant). The suggested change is evaluating, then evaluated (better), not-better or evaluation-failed. With --rescore, after people corrected the new answers of its replay runs: the latest evaluation scored again, counting those corrections, on the same replays (no other flag). Needs publish on the agent.
Options
| Option | Default | Description |
|---|---|---|
--class-weights <value> |
as-recorded |
as-recorded (the default) or restricted-only: only corrections in restricted judge classes count. |
--idempotency-key <value> |
none | A retry with the same key returns the first call's result. |
--k <value> |
10 |
How many ranked items weighted precision@k looks at (1 to 100, default 10). |
--objective <value> |
weightedYesShare |
The metric that says whether the candidate is better: weightedYesShare (the default) or weightedPrecisionAtK. |
--reads <value> |
recorded |
Whether replayed reads use the past run's results when it has them (recorded, the default) or run live. |
--repetitions <value> |
1 |
Run each case this many times (1 to 10, default 1): a delta counts as better only above the spread. |
--rescore |
off | Score the latest evaluation's replays again, with what people corrected on them since: the same version of the test cases and settings, nothing replayed. |
--test-set <value> |
required | The test cases: a judged eval suite, by id. |
--wait |
off | Wait until the evaluation is done (at most 30 minutes), then print the suggested change. |
Every command also takes the global flags.
Examples
From Suggest a change, and test it:
pnpm exec kindgi proposals evaluate <proposal-id> --test-set=acme.rank-prompt-52080 --waitpnpm exec kindgi proposals evaluate <proposal-id> --rescore --waitSee also
kindgi proposals request
Section titled “kindgi proposals request”Synopsis
kindgi proposals request <proposal-id> [--reason=<text>]Ask to make a suggested change live: its candidate version, for its scope, through the scope's release gate policy with its evaluation. The suggested change is promoted, or in-review (a reviewer decides the approval to make it live: kindgi approvals complete); a refusal by the release gate policy lists every check. Allowed once evaluated, also when not-better: the release gate policy decides. Needs promote on the agent.
Options
| Option | Default | Description |
|---|---|---|
--idempotency-key <value> |
none | A retry with the same key returns the first call's result. |
--reason <value> |
none | Why, kept on the request to make it live. |
Every command also takes the global flags.
Examples
From Suggest a change, and test it:
pnpm exec kindgi proposals request <proposal-id> --reason="Live check: promote by hand."See also
kindgi proposals rollback
Section titled “kindgi proposals rollback”Synopsis
kindgi proposals rollback <proposal-id> [--reason=<text>]Roll back a suggested change that was made live: its scope goes back to the version that served it before. The suggested change and its versions stay, as history. Needs promote on the agent.
Options
| Option | Default | Description |
|---|---|---|
--idempotency-key <value> |
none | A retry with the same key returns the first call's result. |
--reason <value> |
none | Why, kept on the record. |
Every command also takes the global flags.
Examples
From Suggest a change, and test it:
pnpm exec kindgi proposals rollback <proposal-id> --reason="Live check: put it back."See also
kindgi proposals withdraw
Section titled “kindgi proposals withdraw”Synopsis
kindgi proposals withdraw <proposal-id> --reason=<text>Withdraw a suggested change before review, or after its request to make it live was refused, superseded or expired. Needs publish on the agent.
Options
| Option | Default | Description |
|---|---|---|
--idempotency-key <value> |
none | A retry with the same key returns the first call's result. |
--reason <value> |
required | Why, kept on the record (required). |
Every command also takes the global flags.
Examples
From Suggest a change, and test it:
pnpm exec kindgi proposals withdraw <proposal-id> --reason="Superseded by a better draft"See also
kindgi proposals improve
Section titled “kindgi proposals improve”Synopsis
kindgi proposals improve --agent=<agent-id> (--tenant | --org=<org-id> | --project=<project-id> [--segment=<key:value>]…) --test-set=<suite-id> [--pass-project=<project-id>] [--from-version=<semver>] [--tier=settings|prompt] [--objective=weightedYesShare|weightedPrecisionAtK] [--class-weights=as-recorded|restricted-only] [--provider=<id> --model=<model>] [--drafts=<n>] [--max-cost=<usd>] [--max-candidates=<n>] [--wait]Ask the runtime to look for better values for the settings an agent version marks as what Improve may change — or, with --tier=prompt, have a model draft new instructions — for a scope, within a budget. It searches on part of the test cases and checks its best candidate on the cases it didn't learn from; if that candidate is better, it writes a suggested change, which a reviewer decides (kindgi proposals request). The Improve run works in one project: the test cases must be ones that project reaches, and its eval runs run there. With --project, it's that project; with --tenant or --org, --pass-project, else the agent version's. Answers at once with the Improve run; --wait waits for its outcome. Needs publish on the agent, and write on the Improve run's project when it isn't the version's.
Options
| Option | Default | Description |
|---|---|---|
--agent <value> |
required | The agent. |
--class-weights <value> |
none (counts everyone until the test cases' project, its tenant, or the agent improved there has a restricted judge class, then only those) | Which corrections the Improve run learns from: as-recorded (all classes) or restricted-only (restricted judge classes only). Omitted, it counts everyone until the test cases' project, its tenant, or the agent improved there has a restricted judge class, then only those. |
--drafts <value> |
3 (1 to 5; with --tier=prompt only) |
With --tier=prompt: how many drafts of the instructions to write (1–5, default 3). |
--from-version <value> |
the version serving the scope | The version whose settings Improve may change (default: the one serving the scope). |
--idempotency-key <value> |
none | A retry with the same key returns the first call's result. |
--max-candidates <value> |
30 |
The most candidates it tries (default 30). |
--max-cost <value> |
5 (US dollars) |
The most its runs on the test cases may cost, in US dollars (default 5). |
--model <value> |
none (needed with --tier=prompt, with --provider) |
With --tier=prompt: the model that drafts the instructions (with --provider). |
--objective <value> |
weightedYesShare |
What better means: weightedYesShare (the default) or weightedPrecisionAtK. |
--org <value> |
none | An org, by id. |
--pass-project <value> |
the scope's project, else the agent version's | The project the Improve run works in, by id, for a tenant or org scope (default: the agent version's). With --project, it's that project, and another is refused. |
--project <value> |
none | A project, by id; with --segment, a segment in it. |
--provider <value> |
none (needed with --tier=prompt, with --model) |
With --tier=prompt: the provider whose model drafts the instructions (with --model). |
--segment <value> |
none | One step of the segment path, key:value (e.g. company:acme); repeat it in order, coarse to fine. Needs --project. Repeatable. |
--tenant |
off | The whole tenant. |
--test-set <value> |
required | The test cases (a judged suite) to search and check on, by id. |
--tier <value> |
settings |
What to improve: settings (the default) — values for the settings keys the version marks as what Improve may change — or prompt, where a model drafts new instructions (needs --provider and --model, and a drafted suggested change always waits for a reviewer). |
--wait |
off | Wait until the Improve run is done (at most 30 minutes), then print it. |
Every command also takes the global flags.
Examples
From Improve an agent:
pnpm exec kindgi proposals improve --agent=acme.rank.scorer --tenant --test-set=acme.rank-prompt-52080 --max-candidates=4 --waitpnpm exec kindgi proposals improve --agent=acme-ops.reply-drafter --tenant \See also
kindgi proposals passes
Section titled “kindgi proposals passes”Synopsis
kindgi proposals passes <command>Improve runs: the runtime looking for better settings (list / get / cancel).
Commands
| Command | Description |
|---|---|
kindgi proposals passes list |
List Improve runs, newest first: only those of agents you can read. |
kindgi proposals passes get |
Show an Improve run: how many candidates it tried, what that cost, and what it found (the suggested change it wrote, or why nothing). |
kindgi proposals passes cancel |
Stop a running Improve run: it ends cancelled and writes no suggested change. |
See also
kindgi proposals passes list
Section titled “kindgi proposals passes list”Synopsis
kindgi proposals passes list [--agent=<agent-id>] [--limit=<n>] [--cursor=<cursor>] [--table]List Improve runs, newest first: only those of agents you can read.
Options
| Option | Default | Description |
|---|---|---|
--agent <value> |
none | Only this agent's Improve runs. |
--cursor <value> |
none | The next page, from nextCursor. |
--limit <value> |
25 (at most 100) |
Page size. |
Every command also takes the global flags.
Examples
From Improve an agent:
pnpm exec kindgi proposals passes list --tableSee also
kindgi proposals passes get
Section titled “kindgi proposals passes get”Synopsis
kindgi proposals passes get <pass-id>Show an Improve run: how many candidates it tried, what that cost, and what it found (the suggested change it wrote, or why nothing).
Options
Every command also takes the global flags.
Examples
From Improve an agent:
pnpm exec kindgi proposals passes get <pass-id>See also
kindgi proposals passes cancel
Section titled “kindgi proposals passes cancel”Synopsis
kindgi proposals passes cancel <pass-id>Stop a running Improve run: it ends cancelled and writes no suggested change.
Options
| Option | Default | Description |
|---|---|---|
--idempotency-key <value> |
none | A retry with the same key returns the first call's result. |
Every command also takes the global flags.
Examples
From Improve an agent:
pnpm exec kindgi proposals passes cancel <pass-id>See also