From 97fb35fe50384f541d0242b97b75576aed20d435 Mon Sep 17 00:00:00 2001 From: "openclaw-docs-sync[bot]" Date: Fri, 24 Apr 2026 02:36:03 +0000 Subject: [PATCH] chore(sync): mirror docs from openclaw/openclaw@04066d246abc4e13a9507e1a93e12be75ae41753 --- .openclaw-sync/source.json | 4 +-- .../.generated/plugin-sdk-api-baseline.sha256 | 4 +-- docs/providers/openai.md | 26 +++++++++---------- docs/web/control-ui.md | 9 +++++++ 4 files changed, 26 insertions(+), 17 deletions(-) diff --git a/.openclaw-sync/source.json b/.openclaw-sync/source.json index 192861691..e9104981e 100644 --- a/.openclaw-sync/source.json +++ b/.openclaw-sync/source.json @@ -1,5 +1,5 @@ { "repository": "openclaw/openclaw", - "sha": "a59d1bd46d9fc0bd2d9194b3f17db2561efc51e3", - "syncedAt": "2026-04-24T02:18:25.330Z" + "sha": "04066d246abc4e13a9507e1a93e12be75ae41753", + "syncedAt": "2026-04-24T02:34:33.017Z" } diff --git a/docs/.generated/plugin-sdk-api-baseline.sha256 b/docs/.generated/plugin-sdk-api-baseline.sha256 index 9a694d664..627b848d3 100644 --- a/docs/.generated/plugin-sdk-api-baseline.sha256 +++ b/docs/.generated/plugin-sdk-api-baseline.sha256 @@ -1,2 +1,2 @@ -793ed905cb0ba93b9a2f8c2c85c3cfb4d194dd9263353e74952bf9e382b03dc2 plugin-sdk-api-baseline.json -032e7fd6f48344c9b3b98fd3e877e6d30cab92ed9a39dd309796cf1f0220820f plugin-sdk-api-baseline.jsonl +96905c33f4498446f612ae17dee6affdf84ef0e2e5a0f25bf7191c315f5b826f plugin-sdk-api-baseline.json +d8eb6331562fde29531eaac18409bb7fabcc70623bf25395f8e5710a49765f0f plugin-sdk-api-baseline.jsonl diff --git a/docs/providers/openai.md b/docs/providers/openai.md index c79a26d0f..ce1c6b7e0 100644 --- a/docs/providers/openai.md +++ b/docs/providers/openai.md @@ -25,19 +25,19 @@ API-enabled model such as `openai/gpt-5.4` for `OPENAI_API_KEY` setups. ## OpenClaw feature coverage -| OpenAI capability | OpenClaw surface | Status | -| ------------------------- | ------------------------------------------------------ | ------------------------------------------------------ | -| Chat / Responses | `openai/` model provider | Yes | -| Codex subscription models | `openai-codex/` with `openai-codex` OAuth | Yes | -| Codex app-server harness | `openai/` with `embeddedHarness.runtime: codex` | Yes | -| Server-side web search | Native OpenAI Responses tool | Yes, when web search is enabled and no provider pinned | -| Images | `image_generate` | Yes | -| Videos | `video_generate` | Yes | -| Text-to-speech | `messages.tts.provider: "openai"` / `tts` | Yes | -| Batch speech-to-text | `tools.media.audio` / media understanding | Yes | -| Streaming speech-to-text | Voice Call `streaming.provider: "openai"` | Yes | -| Realtime voice | Voice Call `realtime.provider: "openai"` | Yes | -| Embeddings | memory embedding provider | Yes | +| OpenAI capability | OpenClaw surface | Status | +| ------------------------- | ---------------------------------------------------------- | ------------------------------------------------------ | +| Chat / Responses | `openai/` model provider | Yes | +| Codex subscription models | `openai-codex/` with `openai-codex` OAuth | Yes | +| Codex app-server harness | `openai/` with `embeddedHarness.runtime: codex` | Yes | +| Server-side web search | Native OpenAI Responses tool | Yes, when web search is enabled and no provider pinned | +| Images | `image_generate` | Yes | +| Videos | `video_generate` | Yes | +| Text-to-speech | `messages.tts.provider: "openai"` / `tts` | Yes | +| Batch speech-to-text | `tools.media.audio` / media understanding | Yes | +| Streaming speech-to-text | Voice Call `streaming.provider: "openai"` | Yes | +| Realtime voice | Voice Call `realtime.provider: "openai"` / Control UI Talk | Yes | +| Embeddings | memory embedding provider | Yes | ## Getting started diff --git a/docs/web/control-ui.md b/docs/web/control-ui.md index b0a3da3c4..213f2e65f 100644 --- a/docs/web/control-ui.md +++ b/docs/web/control-ui.md @@ -105,6 +105,11 @@ locale picker lives in the Gateway Access card, not under Appearance. ## What it can do (today) - Chat with the model via Gateway WS (`chat.history`, `chat.send`, `chat.abort`, `chat.inject`) +- Talk to OpenAI Realtime directly from the browser via WebRTC. The Gateway + mints a short-lived Realtime client secret with `talk.realtime.session`; the + browser sends microphone audio directly to OpenAI and relays + `openclaw_agent_consult` tool calls back through `chat.send` for the larger + configured OpenClaw model. - Stream tool calls + live tool output cards in Chat (agent events) - Channels: built-in plus bundled/external plugin channels status, QR login, and per-channel config (`channels.status`, `web.login.*`, `config.patch`) - Instances: presence list + refresh (`system-presence`) @@ -151,6 +156,10 @@ Cron jobs panel notes: - `chat.history` also strips display-only inline directive tags from visible assistant text (for example `[[reply_to_*]]` and `[[audio_as_voice]]`), plain-text tool-call XML payloads (including `...`, `...`, `...`, `...`, and truncated tool-call blocks), and leaked ASCII/full-width model control tokens, and omits assistant entries whose whole visible text is only the exact silent token `NO_REPLY` / `no_reply`. - `chat.inject` appends an assistant note to the session transcript and broadcasts a `chat` event for UI-only updates (no agent run, no channel delivery). - The chat header model and thinking pickers patch the active session immediately through `sessions.patch`; they are persistent session overrides, not one-turn-only send options. +- Talk mode uses the registered realtime voice provider. Configure OpenAI with + `talk.provider: "openai"` plus `talk.providers.openai.apiKey`, or reuse the + Voice Call realtime provider config. The browser never receives the standard + OpenAI API key; it receives only the ephemeral Realtime client secret. - Stop: - Click **Stop** (calls `chat.abort`) - While a run is active, normal follow-ups queue. Click **Steer** on a queued message to inject that follow-up into the running turn.