What To Measure Instead
Apply these measures to a defined job under the same conditions. The recurring meeting example checks an action table against supplied notes: all assigned actions, correct owners and deadlines, no invented details. Which AI Assistant Fits The Job? lays out the task families, conditions and completion tests. Compare Two Assistants On One Real Job turns them into a practical exercise.
Track active human effort separately from elapsed waiting. The time-cost calculator values time spent reaching a usable result and going further; it does not include AI usage fees.
Don't just compare price per message or per token. Walk through these instead:
- Capability — can it do this kind of task at all?
- Efficiency — how much back-and-forth does it need to get there?
- Reliability — does it get it right consistently, or only sometimes?
- Speed — how long from your prompt to a usable result?
- Operating envelope — the conditions where it performs well versus where it starts breaking down.
- Human correction cost — how much of your own time you'll spend fixing what it gives you.
This is exactly why the same question can feel cheap in one AI tool and expensive in another, even when both are free or similarly priced. If one tool nails your request in one try and another needs three rounds of clarification, that second tool was the more expensive choice for that task — regardless of what either one charges.
You don't need a formal budget to use this day-to-day. A simple rule works: if you've re-prompted the same request three times and it's still not right, stop fixing it in place. Rewrite your original ask from scratch. The issue is usually that the first prompt was missing context, not that it needs a fourth nudge.
Comments
Share a useful example, question or correction. Comments appear immediately. Please keep the discussion relevant and respectful.