AI · desktop
Ultronshipped
A stealth desktop AI copilot for live conversations.
Dual-stream audio, 6 STT providers, multi-LLM routing, and local RAG over your meeting history.
context
An Electron desktop app that sits as a stealth overlay, invisible to screen-capture and sharing via a macOS window-layer trick. It captures both sides of a conversation and lets you summon AI assistance with a hotkey, mid-meeting.
the problem
Most "AI meeting" tools only hear your mic. To actually be useful the AI needs full conversational context (both sides of the audio) plus low latency, provider resilience, and a UI that never blocks while tokens stream.
what i built
- Dual-stream capture: microphone + system loopback transcribed concurrently for full context
- Six STT providers including on-device ONNX Whisper (no cloud); multi-provider LLM routing with a fallback chain and circuit breakers
- Meeting RAG: live transcript indexed into sqlite-vec for semantic search over past sessions, with structured summaries on session end
- Screenshot vision analysis and a phone-mirror that streams transcript + answers to any device on local Wi-Fi
- All API keys stored with Electron safeStorage (OS-level encryption), never in plaintext
outcome
A genuinely hard desktop app: real-time audio on dedicated threads bridged to an async runtime, token-by-token markdown streaming over IPC, and a ~3k-line settings hub driving every provider, keybinding and mode.
A production-grade AI desktop app with real provider resilience: fallback chains, circuit breakers, encrypted keys.