Skip to main content
Back

Farza's Open-Source Clicky Hits 7K Stars Pointing at Your Screen

An open-source macOS assistant that watches your screen, talks back, and flies a blue pointer to the exact UI element you asked about.

Pro

Repo, Full Access
  • Clicky is an open-source macOS AI buddy that lives next to your cursor and points at UI elements. Repo
  • Pipeline: push-to-talk to AssemblyAI, screenshot plus transcript to Claude, response spoken by ElevenLabs
  • Claude embeds [POINT:x,y] tags that a Swift overlay parses to fly a blue triangle to the target
  • All API calls proxied via a Cloudflare Worker so keys never ship in the app binary
  • MIT licensed, ~7k stars; requires macOS 14.2+, Xcode 15+, and your own API keys
  • New development moves private, but the prototype remains hackable. Deep dive

A new kind of desktop assistant is making the rounds on GitHub, and it does something ChatGPT tabs cannot: it lives beside your cursor, watches your screen, and physically points at the button you should click next. Clicky, built by Farza Majeed, has crossed 7,000 stars under an MIT license, and the codebase is a compact case study in gluing together vision, voice, and desktop overlays into something that feels like a tutor sitting next to you.

Press to talk, watch the triangle fly

The interaction model is simple: you press a key, talk, and a glowing blue triangle flies across your screen, points at whatever you asked about, and talks you through the answer. Farza has been using it to learn DaVinci Resolve, and community demos show it walking users through Blender, After Effects, Figma, writing, debugging, and even analyzing stock charts.

The pipeline behind the blue triangle

The architecture is small enough to fit in your head. It's a menu bar app (no dock icon) with two NSPanel windows: one for the control panel dropdown, one for the full-screen transparent cursor overlay. Push-to-talk streams audio over a websocket to AssemblyAI, sends the transcript plus a screenshot to Claude via streaming SSE, and plays the response through ElevenLabs TTS. Claude can embed