Commit Graph
98 Commits
Author SHA1 Message Date
James Babcock e592058dc2 Fix the aspect ratio of the screen preview 2026-08-01 23:01:53 -07:00
James BabcockandClaude Fable 5 48bac85cbe External assistant backend: agent bridge client + MCP server
Phase 3 of the voice-assistant design: assistant.backend=external routes
utterances over a dial-out websocket to faceclaw-agent-bridge (an OpenClaw
plugin on the user's machine). The phone serves its ToolRegistry as MCP on
the same socket, with proactive gating and rate limiting enforced locally.
New Assistant settings section with backend/bridge settings.

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01XCdkQyB3RUVPTuEmhxVEdp
2026-08-01 18:28:47 -07:00
James Babcock 474844f961 App-launcher UI: Wrapping, fix a minor folder-selection UI bug 2026-08-01 16:23:52 -07:00
James Babcock 37e95627b1 Add window persistence across app restarts 2026-08-01 15:27:44 -07:00
James Babcock 02c09ef889 Fix broken wakeword handling 2026-08-01 14:37:30 -07:00
James Babcock 4d1182599b Add privacy policy; update README; incorporate both into Settings app 2026-07-31 22:19:51 -07:00
James Babcock 65c73ad144 Two-column app switcher 2026-07-31 22:17:31 -07:00
James Babcock 7d2a41bd56 Apps are variable height; add vertical position setting 2026-07-31 14:52:51 -07:00
James Babcock 6d42f0e65e Expand screen resolution to the full 640x480 2026-07-31 12:57:10 -07:00
James Babcock 818f33ce33 Increase screen size a little bit past 576x288, to exercise the corresponding new firmware 2026-07-30 00:45:31 -07:00
James Babcock b738ce4bb2 Add screen-recording option 2026-07-28 10:16:44 -07:00
James Babcock 4c946631e0 Add a pinball game 2026-07-26 21:03:52 -07:00
James Babcock 434419c8e4 Add a minesweeper game, a freecell game, and some voice assistant tools for window management 2026-07-26 19:45:14 -07:00
James Babcock 57d8d2fc79 Add long-press and mic buttons to preview form; fix canula-age display in Nightscout when outside 4-day window 2026-07-26 17:31:55 -07:00
James Babcock 93d98965de Add support for g2mirror lanuch presets to Terminal app 2026-07-26 14:31:21 -07:00
James Babcock ccdeedd687 Add a model picker and support for the OpenAI API 2026-07-26 13:09:28 -07:00
James Babcock 1c2e445519 Refactor prompt construction into prompts.ts 2026-07-26 12:33:10 -07:00
James Babcock d07e22b458 Add descriptions to config settings, and make Suspend EvenHub setting default on 2026-07-26 12:23:18 -07:00
James Babcock 205d393415 Refactor to remove some duplicated functiosn 2026-07-26 11:33:16 -07:00
James Babcock 797682a386 Add a falling-blocks game 2026-07-26 02:48:41 -07:00
James Babcock bde70ac380 Add a Navigate app (requires a Mapbox API token) 2026-07-25 23:32:01 -07:00
James Babcock 3c2f53ed75 Rename the Teleprompt app to Files, improve its navigation and add support for images 2026-07-25 21:33:58 -07:00
James Babcock fe205c0164 Add app tool registration for voice assistant; voice assistant can read and send to terminals 2026-07-25 01:19:07 -07:00
James Babcock 0aeb24ed00 Implement a basic voice assistant 2026-07-25 00:44:04 -07:00
James Babcock d2c987d48a Add media-browser to Music app 2026-07-24 10:02:03 -07:00
James Babcock d42e11e2a5 Fix scrolling in Terminal 2026-07-24 01:52:12 -07:00
James Babcock 8ffccad7f0 Use extended CFW options for sleep/wake handling to wake from sleep without a flash of dashboard 2026-07-23 23:54:56 -07:00
James Babcock e5649e9782 Add experimental option to end EvenHub session when the screen is off for power saving 2026-07-23 18:40:48 -07:00
James Babcock 7455775390 Add brightness setting 2026-07-23 10:48:35 -07:00
James Babcock afc05d6a19 Redesign handling of long-press gesture and context menus 2026-07-22 22:45:14 -07:00
James Babcock 3452945322 Voice input suspends the screen-off timer; add menu to Nightscout; fix defocused highlight style in Terminal menu 2026-07-21 09:40:43 -07:00
James Babcock 026a8ed439 UI refinements to Music app 2026-07-20 18:34:49 -07:00
James Babcock a5c6f18795 Add silent-mode and low-battery indicators to Android preview form 2026-07-20 12:02:20 -07:00
James Babcock bbd3bbcf13 Updated embedded firwmare patches from g2flash 2026-07-20 10:57:22 -07:00
James Babcock 5c73ba2a4d Add Timer, Weather apps; build out UI of music app; add wakeword action setting 2026-07-20 02:04:21 -07:00
James Babcock 008f2277ca Add OpenAI Whisper Realtime integration 2026-07-20 00:19:31 -07:00
James Babcock 161dbd104e Add wakeword support 2026-07-19 20:45:51 -07:00
James Babcock 4401a4a416 Add a brief delay between terminal voice input text and the trailing newline, so that claude code doesn't interpret the newline as part of a paste 2026-07-19 18:24:22 -07:00
James Babcock 1550c0ca32 Add support for voice-input refinement prompts, and other improvements to Temrinal 2026-07-14 15:57:14 -07:00
James Babcock 915aa78653 Fixed doubled border on terminal app 2026-07-13 03:11:22 -07:00
James Babcock abfec1b372 Terminal supports g2mirror scrollback 2026-07-13 01:58:31 -07:00
James Babcock 7ca3735c23 Add voice input support to terminal 2026-07-13 00:27:03 -07:00
James Babcock b2c90bc043 Performance optimizations; add TerminusV variable-width font 2026-07-11 23:41:57 -07:00
James Babcock ff447d5161 Add calendar app and accelerometer demo 2026-07-11 14:15:10 -07:00
James Babcock 3cdc5ba262 Fix notifications app unfocused styling 2026-07-11 13:31:50 -07:00
James Babcock c71dbbc9f2 Notifications app checks for and requests notifications access 2026-07-10 23:44:17 -07:00
James Babcock 17cc0bba83 Repaint top bar on settings changes; add 12/24-hour time setting 2026-07-10 23:39:36 -07:00
James Babcock d97429a21a Autoconnect on reaching main screen; play sound effect on first launch 2026-07-10 23:24:17 -07:00
James Babcock ea80d05607 Detect custom firmware during onboarding; add uninstall option 2026-07-10 23:08:15 -07:00
James Babcock cb78841a9d Add (NOT YET TESTED) firmware flashing/OTA-updating
We're going to extend the Faceclaw app onboarding process to include checking for and installing the custom firmware (currently handled externally with the scripts in ../g2flash). We'll add script scripts/resetOnboarding.sh that uses adb to reset the app on the attached phone to default/pre-onboarding state for testing. The onboarding process will explain that it's only compatible with custom firmware, with options to either skip and try out the app using only the phone-screen preview (instead of pairing with glasses), or proceed with flashing.
If the user proceeds with flashing, we first connect to the glasses (with the existing mechanism), and display an on-glasses confirmation prompt. Because this prompt needs compatibility with stock firmware, it will use a different subset of the BLE protocol than the main app does (in particular, no image containers), so we'll have a separate bluetooth communication class rather than extending FaceclawBleCommunicator. We'll send an init message to start a Hub app, initialize a layout with a text container and a list, populate the text container with a message saying that flashing will void warranty and the list with No and Yes, set up a keepalive/heartbeat message timer, and wait for a menu selection. (Refer to ../g2-kit-unofficial/ble/docs and ../g2-kit-unofficial/ble/gen for protocol details). If the prompt is approved, we go to the flashing screen.
On the flashing screen, we first download the official firmware, apply patches to it, and check that it has the expected result hash. See ../g2flash/build_cfw.sh and ../g2flash/apply_patches.py for details.
Let's implement everything prior to the update itself now, ie, the on-device confirmation prompt, and downloading, patching and verifying the modded firmware.
scripts/resetOnboarding.sh is meant to reset a pref so that Faceclaw reruns its first-run onboarding on next launch, but fails with "No onboarding keys were set. App is already in pre-onboarding state." (And onboarding doesn't trigger on next launch)
Thanks. I tested the on-glasses prompt on real hardware and it worked as expected. Next up, let's port the flashing procedure itself.
One detail of the flashing procedure worth noting: the two lenses get updated separately, and at the end of updating either lens, both lenses get rebooted, creating a brief period when neither is reachable, so the timeout to look for the second lens should not be too short.
2026-07-10 12:07:15 -07:00