Building With AI
$definecomputer-use--plain-english
TLDRAI that clicks and types like a person at the desk.
Most tools are ticket windows. Computer use is a remote intern who can only see your screen and borrow the mouse.
The model gets a screenshot (multimodal), aims at a rectangle, types in a box. Look, point, click. The same loop you run without thinking — handed to a machine that will sometimes nail it and sometimes click the other blue button.
When there is a window, use the window.
An API is faster, cheaper, and cannot "miss." This product's agents should call MCP (npx create-hackhaton-space-stack@latest mcp) or paste a CLI line — not click Generate on the builder like a person. The builder is for you. The phone is for them.
Reach for the mouse only when the software never shipped a window: a 2009 vendor portal, an internal dashboard with no SDK, a government form. Hands are for the leftovers.
It is slow. It is brittle. A popup can lose it. A hand that can click "Pay" can click "Delete account." Put it in a sandbox. Prefer a real tool menu when one exists.
What this unlocks
Reach. The mountain of software that never offered a tidy order form is no longer a dead end. You give up speed and reliability. You get a cursor that can operate anything a human can operate.
Watch the cursor the first few times. A posted menu can only order what's printed. A mouse can click anything on the glass.
