Interface: RunEvalOptions

Properties

driver: EvalDriver;

Drives the agent and returns reply/tool-calls/success per send.

id: string;

Stable id for the eval (e.g. its file path relative to the evals dir).

optional row: DatasetRow;

Dataset row bound to t.input/t.expected for dataset-driven evals.

optional strict: boolean;

When true, soft assertion failures also fail the eval.

optional timeoutMs: number;

Runner-level default per-eval timeout (ms). def.timeoutMs wins over this; when both are unset the eval runs unbounded (current behavior).