clis.md

CLIs

CLIs can be saved organization resources or inline installation commands on an eval. Saved setup and installation commands are not exposed through list responses.

Command

Command	Description
`lightsage clis list`	List CLIs.

List CLIs

lightsage clis list --output-format json

The response includes CLI names, public binary names, and documentation links without exposing setup commands.

Use a saved CLI ID in an eval or configuration:

lightsage evals create \
  --name "Test CLI install" \
  --prompt "Install the CLI and list available commands." \
  --judge "The CLI installs and help output is shown." \
  --agent codex:gpt-5-4 \
  --cli 230f0c71-ed91-4a4a-9932-9cef267411bc

lightsage evals configurations create --eval-id eval_123 \
  --cli-ids cli_support_123 \
  --name "With supporting CLIs"

Pass any non-UUID --cli value as an inline installation command:

lightsage evals run \
  --prompt "Use the Lightsage CLI." \
  --judge "The workflow succeeds." \
  --agent codex:gpt-5-4 \
  --cli "brew install lightsagehq/tools/lightsage"

Repeat --cli to install multiple CLIs in order.