xlab(1)
NAME
xlab — a small laboratory for planned, paired experiments.
SYNOPSIS
xlab init ~/labs/demo
cd ~/labs/demo
xlab plan experiments/S1-demo.toml
xlab tree start trees/T0-demo.toml
xlab upDESCRIPTION
Write the question before collecting data. Name the control, the smallest effect that matters, and the conditions to compare. xlab creates randomized complete blocks, records every sample, and reports paired ratios with intervals and a verdict. The runner resumes after interruption; decision trees follow rules written in advance.
The core is Python and the standard library. The documentation website has a separate build; running a lab needs no Node.js, web service, or pip dependencies.
Current scope
The built-in adapters are command, compression, simulated, and manual. Agent task suites, isolated agent workspaces, automatic token pricing, pass-rate statistics, and calibrated model judges are planned. They are not current CLI features.
EXAMPLES
Start with the simulated walkthrough. It exercises the same runner and statistics without an API key or a paid model call.