diff --git a/.openclaw-sync/source.json b/.openclaw-sync/source.json index a76a8ff95..d6e97ec42 100644 --- a/.openclaw-sync/source.json +++ b/.openclaw-sync/source.json @@ -1,5 +1,5 @@ { "repository": "openclaw/openclaw", - "sha": "8cb73844c8005b8db9008dcc69a33ce7b4d3482d", - "syncedAt": "2026-04-19T10:22:09.385Z" + "sha": "d5b326523f82ca910ed73ef5389e884e71676e3d", + "syncedAt": "2026-04-20T02:14:14.957Z" } diff --git a/docs/concepts/qa-e2e-automation.md b/docs/concepts/qa-e2e-automation.md index 14953f3aa..c6219b2f1 100644 --- a/docs/concepts/qa-e2e-automation.md +++ b/docs/concepts/qa-e2e-automation.md @@ -80,6 +80,8 @@ disposable server. It requires `OPENCLAW_QA_TELEGRAM_GROUP_ID`, private group. The SUT bot must have a Telegram username, and bot-to-bot observation works best when both bots have Bot-to-Bot Communication Mode enabled in `@BotFather`. +The command exits non-zero when any scenario fails. Use `--allow-failures` when +you want artifacts without a failing exit code. Live transport lanes now share one smaller contract instead of each inventing their own scenario list shape: @@ -107,9 +109,11 @@ inside the guest, runs `qa suite`, then copies the normal QA report and summary back into `.artifacts/qa-e2e/...` on the host. It reuses the same scenario-selection behavior as `qa suite` on the host. Host and Multipass suite runs execute multiple selected scenarios in parallel -with isolated gateway workers by default, up to 64 workers or the selected -scenario count. Use `--concurrency ` to tune the worker count, or -`--concurrency 1` for serial execution. +with isolated gateway workers by default. `qa-channel` defaults to concurrency +4, capped by the selected scenario count. Use `--concurrency ` to tune +the worker count, or `--concurrency 1` for serial execution. +The command exits non-zero when any scenario fails. Use `--allow-failures` when +you want artifacts without a failing exit code. Live runs forward the supported QA auth inputs that are practical for the guest: env-based provider keys, the QA live provider config path, and `CODEX_HOME` when present. Keep `--output-dir` under the repo root so the guest diff --git a/docs/help/testing.md b/docs/help/testing.md index 3aa614396..a7260d816 100644 --- a/docs/help/testing.md +++ b/docs/help/testing.md @@ -49,9 +49,11 @@ These commands sit beside the main test suites when you need QA-lab realism: - `pnpm openclaw qa suite` - Runs repo-backed QA scenarios directly on the host. - Runs multiple selected scenarios in parallel by default with isolated - gateway workers, up to 64 workers or the selected scenario count. Use - `--concurrency ` to tune the worker count, or `--concurrency 1` for - the older serial lane. + gateway workers. `qa-channel` defaults to concurrency 4 (bounded by the + selected scenario count). Use `--concurrency ` to tune the worker + count, or `--concurrency 1` for the older serial lane. + - Exits non-zero when any scenario fails. Use `--allow-failures` when you + want artifacts without a failing exit code. - Supports provider modes `live-frontier`, `mock-openai`, and `aimock`. `aimock` starts a local AIMock-backed provider server for experimental fixture and protocol-mock coverage without replacing the scenario-aware @@ -86,6 +88,8 @@ These commands sit beside the main test suites when you need QA-lab realism: - Runs the Telegram live QA lane against a real private group using the driver and SUT bot tokens from env. - Requires `OPENCLAW_QA_TELEGRAM_GROUP_ID`, `OPENCLAW_QA_TELEGRAM_DRIVER_BOT_TOKEN`, and `OPENCLAW_QA_TELEGRAM_SUT_BOT_TOKEN`. The group id must be the numeric Telegram chat id. - Supports `--credential-source convex` for shared pooled credentials. Use env mode by default, or set `OPENCLAW_QA_CREDENTIAL_SOURCE=convex` to opt into pooled leases. + - Exits non-zero when any scenario fails. Use `--allow-failures` when you + want artifacts without a failing exit code. - Requires two distinct bots in the same private group, with the SUT bot exposing a Telegram username. - For stable bot-to-bot observation, enable Bot-to-Bot Communication Mode in `@BotFather` for both bots and ensure the driver bot can observe group bot traffic. - Writes a Telegram QA report, summary, and observed-messages artifact under `.artifacts/qa-e2e/...`. @@ -118,7 +122,7 @@ Required env vars: - `OPENCLAW_QA_CONVEX_SECRET_CI` for `ci` - Credential role selection: - CLI: `--credential-role maintainer|ci` - - Env default: `OPENCLAW_QA_CREDENTIAL_ROLE` (defaults to `maintainer`) + - Env default: `OPENCLAW_QA_CREDENTIAL_ROLE` (defaults to `ci` in CI, `maintainer` otherwise) Optional env vars: