Let your agents draw arrows and boxes on your screen

A developer made a tool so coding agents can point at things on your screen with big arrows, boxes and text.

Difficulty
BeginnerOur rating
Time to build
Not reportedOur estimate
Monthly cost
Not reported
Revenue
Not reportedWe only show revenue the source states
Engagement
419 HN points195 comments · fetched Oct 15, 2026

What they did

franze built a way for AI agents to paint overlays on your screen to show you things.

How it went

It got 419 points on HN.

Worth knowing

A tool launch rather than a usage report.

Builder recipe

Our own starting point, written from the source. Adapt it to your setup.

Stack

  • Overlay tool
  • Your coding agent

Steps

  1. Open the repo in your coding agent and describe the goal and constraints.
  2. Ask for a plan first, then let it implement in small, reviewable steps.
  3. Run the tests or the app after each step and feed errors back.
  4. Review the diff before merging.

Starter prompt

Point at the setting I need to change with an arrow and a one-line label.

Tags

Read the original

Related use cases

The Daily 5.

Five real AI agent use cases each morning, each with a recipe and a source. Plus a Sunday roundup. Free.