forked from Blendman974/faceclaw
Voice: self-hosted Whisper server provider; Transcribe on iOS
- "Whisper server (self-hosted)" transcription provider for OpenAI-compatible Whisper servers (vLLM, speaches, LocalAI) over plain HTTP batch requests, with URL, model, language and key settings (Voice). Pause-ended spans are one request each, finalized in audio order, with provisional text while a span is open. See notes/whisper-server.md. - Transcribe (and other continuous capture) works on iOS with a cloud or Whisper-server provider; push-to-talk shares a running capture. - Transcribe saves each session's audio as transcribe-<time>.wav in Downloads (setting "Save Transcribe audio", on by default), written as it is captured so a crash leaves a playable file; a saved transcript uses the same stamp. - Calculator stops continuous listening when its window closes. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
This commit is contained in:
1 parent
ecb6c7f465
commit
e2caf28392
24 files changed
+1065
-43
No files matched your search
@@ -0,0 +1,44 @@
|
||||
# Self-hosted Whisper transcription
|
||||
|
||||
The "Whisper server (self-hosted)" transcription provider sends voice audio to
|
||||
any OpenAI-compatible Whisper server instead of a cloud service: vLLM, speaches
|
||||
(faster-whisper-server), LocalAI and similar. It uses the batch endpoint
|
||||
`POST {url}/audio/transcriptions` with a 16 kHz mono WAV. Push-to-talk
|
||||
utterances are one request each; in Transcribe, each span ended by a pause is
|
||||
one request. While a span is open its audio so far is re-sent every 1.5 s, so
|
||||
text appears while you are still talking.
|
||||
|
||||
## Server
|
||||
|
||||
Any server exposing `/v1/models` and `/v1/audio/transcriptions` works, e.g.
|
||||
|
||||
vllm serve openai/whisper-large-v3 --port 8004
|
||||
|
||||
## Settings (Settings > Voice)
|
||||
|
||||
- **Transcription Provider**: Whisper server (self-hosted). Disabled until the
|
||||
URL is set.
|
||||
- **Whisper server URL**: the API root, e.g. `http://host:8004/v1`. A bare
|
||||
`http://host:8004` gets `/v1` added.
|
||||
- **Whisper server model**: empty uses the first model the server lists.
|
||||
- **Whisper language**: an ISO code such as `en`, or empty to auto-detect.
|
||||
A wrong fixed language makes Whisper translate rather than transcribe.
|
||||
- **Whisper server key**: optional bearer token.
|
||||
|
||||
## iOS: plain http
|
||||
|
||||
iOS App Transport Security blocks plain `http://` to IP addresses (including
|
||||
Tailscale's 100.x addresses) unless the app's Info.plist has an exception for
|
||||
that host. Either serve the API over https (for example with `tailscale serve`)
|
||||
or add your server to `NSExceptionDomains` in `App_Resources/iOS/Info.plist`
|
||||
before building:
|
||||
|
||||
<key>192.0.2.10</key>
|
||||
<dict><key>NSExceptionAllowsInsecureHTTPLoads</key><true/></dict>
|
||||
|
||||
## Transcribe on iOS
|
||||
|
||||
Transcribe needs a cloud or Whisper-server provider on iOS (Apple's recognizer
|
||||
only handles short utterances). With "Save Transcribe audio" on (Voice
|
||||
settings), each session's audio is kept as `transcribe-<time>.wav` in Downloads,
|
||||
next to `transcript-<time>.txt` when the text is saved.
|
||||
Reference in new issue
Block a user