Commit Graph
361 Commits
Author SHA1 Message Date
JMO b361cdd934 Say how to leave silent mode, and drop the belief when it is contradicted
Silent mode is entered and exited only by long-pressing both touchpads. While
it is on the firmware ignores all input and blanks the display, so from the
phone the glasses look connected and simply answer nothing. The app cannot turn
it off either: the communicator exposes onSilentMode and a listener set, and no
setter.

The status read "Connected (Silent mode enabled)", which names the state but
not the way out of it, and someone who triggered the gesture by accident has no
reason to know the gesture exists. It now names it.

The belief can also go stale. silentMode is set by the firmware's push event
and cleared only when the phase goes to disconnected, on the assumption that it
is re-reported on the way back up. Toggle silent mode on the glasses without
the link ever dropping and that assumption does not hold: a missed "off" leaves
the phone claiming silent mode for as long as the connection lasts. Observed
with the status reading silent while the glasses were granting framebuffer
leases and rendering frames, which cannot happen in a mode whose whole
behaviour is to blank the display and ignore input.

So the belief is dropped whenever the glasses do something that mode makes
impossible: input from them, since the firmware discards input while silent, or
a shell render that gets past the display-target check, since silent mode does
not leave a display target standing. The second matters because it self-heals
without the user touching anything.

Not unit-tested. Both halves are in dashboard-controller.ts, which imports 56
modules, so a test there would mostly exercise mocks, and the stale-clear is
state management across events rather than a pure function. The refactor that
would make it testable is moving the silent-mode belief into a small state
holder taking the firmware's push events plus the two kinds of contradicting
evidence; glasses-display-state.ts next door is already exactly that shape.
2026-09-22 22:09:40 -07:00
JMO 662cbd75dc Fix the EvenHub sign-in form reopening every launch and never closing
Open EvenHub once without finishing sign in and the phone side form comes back
on every app start, with no way to close it. Back exits the app rather than
closing the form.

Three things combine:

- EvenHubStoreLayer.paint() opened the credential editor on its first paint
  when no credentials were stored. First paint includes the restore of a
  still-open EvenHub at startup, so an unfinished sign in put the form back
  every time. handleInput already opens it on a click, so the auto open only
  removed the choice of when.

- LayerActions.startTextSettingsEdit declares a fifth onCancel parameter, but
  the DashboardController wiring forwarded four and the method accepted four.
  Nothing failed to compile, because a 4-parameter function is assignable to a
  5-parameter function type. That callback resets openCredentialEditor's
  phoneEditor guard, so with it dropped the guard latched at "credentials":
  the screen timeout hid the panel without resetting the state behind it, and
  the form could then be neither closed nor reopened. ios-preview-controller.ts
  already forwards all five, so this was the G2 path only.

- The panel has no Cancel control, so the keyboard's Done key on the password
  field is the only way to end the edit. On an untouched form that reached
  submitCredentials, which called enterLogin("Email and password are
  required."), which reopens the editor. A loop with no exit.

The auto open is removed; onCancel is forwarded, stored and fired from
endTextSettingEdit, with finishTextSettingEdit clearing it first so a completed
edit does not also report a cancel; and a wholly empty submission is treated as
a cancel. A half-filled form is a real mistake and still reopens with the
message.

tests/evenhub-signin.test.cjs covers the open and close contract through the
existing load-typescript.cjs loader. Two of its five tests fail against the
current store-layer.ts and pass with this change.
2026-09-22 19:07:22 -07:00
James Babcock 313ccd86d9 Ungate some settings on iOS 2026-09-20 18:33:24 -07:00
James Babcock 146fe66bdd Add "map around me" mode to Navigate app 2026-09-20 17:02:24 -07:00
James Babcock 07828db0bf Refactor texture cache usage to shared Kotlin for iOS 2026-09-20 15:12:13 -07:00
James Babcock ccb320c66f Add tokens and faceclaw-input script, which allows using a CLI utility as an input device for the glasses 2026-09-20 00:34:58 -07:00
James Babcock 6c3144cc31 Make iOS app main screen match the Android UI 2026-09-19 21:54:18 -07:00
James Babcock 3f6e5e2cba Tweak iOS calendar permission-request text 2026-09-19 20:59:59 -07:00
James Babcock 32063e57cd iOS calendar integration 2026-09-19 20:52:36 -07:00
James Babcock 50431c7c6f Version 0.7.2 2026-09-19 19:19:29 -07:00
James Babcock 7b19c00443 Forward ring input events before filtering, and include swipe info 2026-09-19 19:02:11 -07:00
James Babcock b972cd7682 Rebase firmware on 2.3.0, fixing issue with lost ring input events 2026-09-19 17:19:21 -07:00
James Babcock 3e2ce2210c Version 0.7.1 2026-09-19 12:06:07 -07:00
James Babcock e50da605e0 Add support for buzzer sound effects on iOS 2026-09-19 12:03:57 -07:00
James Babcock cef879fec0 Display proper app name in iOS notifications 2026-09-19 11:46:46 -07:00
James Babcock 67823f66ef Implement notifications on iOS 2026-09-19 11:07:37 -07:00
James Babcock 64bf600ef9 Porting onboarding/flashing flow io iOS 2026-09-19 09:19:26 -07:00
James Babcock 68b459751e iOS QR scanning for opening EvenHub apps 2026-09-19 03:06:56 -07:00
James Babcock e2b35ada1a Port lock screen to iOS 2026-09-19 02:55:13 -07:00
James Babcock ef7878359f Merge branch 'main' into ios-port 2026-09-19 02:33:59 -07:00
James Babcock 0337470c05 Mark stock firmware 2.3 as validated for installing custom firmware over 2026-09-19 02:18:23 -07:00
James Babcock 15a3e129b2 iOS wakeword support 2026-09-19 01:37:36 -07:00
James Babcock d1df4bf046 Fix missing EvenHub app icons; ungate Assistant section of settings 2026-09-19 01:27:01 -07:00
James Babcock 7e58c7c05f EvenHub compatibility for iOS 2026-09-19 00:48:26 -07:00
James Babcock 617cdc39eb Port assistant integration (with cloud AIs) to iOS 2026-09-19 00:02:15 -07:00
James Babcock 9e18745e53 Port navigate and weather 2026-09-18 23:46:27 -07:00
James Babcock 2b3e068a23 Port Compass to iOS 2026-09-18 23:30:07 -07:00
James Babcock 5ae2c245c6 Nightscout works on iOS 2026-09-18 23:16:22 -07:00
James Babcock 68810197a8 Refactor Java to shared kotlin 2026-09-18 22:48:20 -07:00
James Babcock 410fd5840b Refactor a bunch of Java to Kotlin, making it usable in an iOS port 2026-09-18 22:46:08 -07:00
James Babcock bc8e80c533 Kotlin on iOS 2026-09-18 19:59:13 -07:00
James Babcock 63b2a7d545 Merge branch 'main' into ios-port
# Conflicts:
#	app/app.ts
2026-09-18 19:38:10 -07:00
James Babcock 1e1c3f799d Introduce Kotlin 2026-09-18 19:35:50 -07:00
James Babcock b71fdde099 Add unicode test pages to the Developer app 2026-09-18 19:10:50 -07:00
James Babcock fc50c7314c Don't discard calibration when compass is off 2026-09-18 11:30:27 -07:00
James Babcock 14fbbe66ff iOS porting: Glanceboard wake gestures 2026-09-17 23:50:14 -07:00
James Babcock e8e144f3f2 Merge main into ios-port and update the iOS CFW transport 2026-09-17 23:33:51 -07:00
James Babcock 17274746a7 Glanceboard has a 2x3 layout option 2026-09-17 22:59:00 -07:00
James Babcock bed21c9a5f Short-then-long-press from off opens the glanceboard 2026-09-17 22:31:50 -07:00
James Babcock 25c398d60f Wait for final results from Whisper before completing
<details>
<summary>Prompts Used</summary>
User: This checkout corresponds to https://github.com/jimrandomh/faceclaw/pull/27. Review this branch.

GPT-6 Astra:
> Found one issue:
>
> - **[P2] Wait for Whisper’s final result before completing dictation** — [FaceclawVoiceController.java:729](/Users/jbabcock/repositories/g2/faceclaw/App_Resources/Android/src/main/java/com/faceclaw/app/FaceclawVoiceController.java:729). Skipping partial decodes leaves short utterances without text until release, but the dialog still finalizes after its existing timeout. If decoding exceeds roughly 2.7 seconds (native stop’s 1.5-second wait plus the dialog’s 1.2-second timeout), auto-send can abandon a short command or send an incomplete longer one. Continue can append the late editing instruction literally instead of refining the message. I reproduced these outcomes with delayed transcript events. These flows should await recognition completion.
>
> Validation: TypeScript and a clean Android build passed. All 21 test failures also occur on `main`. Actual Whisper latency was not tested on hardware.

<hr>

User: Thanks, let's fix that issue.

GPT-6 Astra:
> Fixed. Dictation now waits for native recognition to finish before fallback timers run. Auto-send, Continue, and AI Chat preserve delayed Whisper results; cancellation ignores late transcripts.
>
> TypeScript and Android builds pass. All 11 new regression tests pass. The full suite still has the same 21 pre-existing failures.
</details>
2026-09-17 22:12:33 -07:00
James Babcock 91890a25ac Merge branch 'pr-ondevice-whisper' of https://github.com/leofingal/faceclaw into pr-ondevice-whisper 2026-09-17 21:59:28 -07:00
James Babcock 5698c584a3 Expand texture cache to 256kb 2026-09-17 18:52:50 -07:00
James Babcock b9b8128756 BLE bandwidth benchmark uses incompressible messages 2026-09-17 18:52:14 -07:00
James Babcock 720f6af8f8 Do message compression at the transport level, rather than in individual messages 2026-09-16 22:47:56 -07:00
Chris LeeandClaude Sonnet 5 2d717a9cdb Add on-device Whisper as a second offline transcription option
sherpa-onnx's native library already reads an offline Whisper config
(verified against sherpa-onnx/jni/offline-recognizer.cc at v1.13.0);
only the Java wrapper was a package-private stub. This adds a public
OfflineWhisperModelConfig builder and wires base.en (int8) in as a
second on-device model next to Moonshine.

- FaceclawVoiceController: setOnboardModelKind() selects the model
  before start("onboard"); defaults to Moonshine. Whisper skips the
  700ms live-partial redecode (each call re-encodes the whole utterance
  plus ~10s of tail padding) and gates near-silent segments before
  decode.
- asr-model.ts: ASR_MODELS registry with per-model download state.
- Settings > Voice: "On-device (Moonshine)", "On-device (Whisper)",
  and "OpenAI (Whisper)" for the existing cloud provider (stored
  value unchanged); one model row per on-device model.
- Microphones live captions pass "moonshine" explicitly (unchanged).

Co-Authored-By: Claude Sonnet 5 <noreply@anthropic.com>
Co-Authored-By: Claude Opus 5 <noreply@anthropic.com>
2026-09-14 22:46:22 -04:00
James Babcock 33bfdcf1d1 Send messages through a new SID, rather than image messages 2026-09-13 21:42:29 -07:00
James Babcock dcb071621d Merge branch 'main' of https://github.com/jimrandomh/faceclaw 2026-09-12 23:50:36 -07:00
James Babcock c9e95a3f69 Refinements to bulitin games
All: settings persistence
All: pause on menu
Flappy: both swipe directions trigger flaps
Freecell: skip irrelevant locations
Blocks: Lower speed/difficulty
Pinball: remove the half-implemented Nudge gesture.
2026-09-12 23:50:23 -07:00
James Babcock 2971999467 Glanceboard tap setting includes a Disable option 2026-09-12 23:23:31 -07:00
James Babcock 937c73d81b Add battery indicator for Android Wear watch 2026-09-12 19:35:38 -07:00