How we measure
Last updated: 2026-10-16
Human hours
We track active work time with a day-map dashboard and split hours by phase: prompting, review, debugging, and deploy. We do not count waiting on CI or model latency as human hours.
Estimated vs billed token $
Estimated uses usage logs (ccusage, Tokscale, or provider dashboards) priced at public list rates on the price date.
Billed comes from invoices or plan usage pages. Subscription plans may show $0 marginal token spend even when estimated list-price equivalent is non-zero — we show both numbers and never merge them.
Price dating
Every receipt has a price_date. All dollar figures on that page were checked on that date. SaaS comparisons link to a public pricing URL stored on /prices.
Reproducible setup
Benchmark-style comparisons include repo, commit, prompts, model settings, and steps. Check current tool terms before publishing benchmarks (for example Cursor Terms of Service).
Security test basics
- Secrets not in repo or client bundles
- Auth/session handling on protected routes
- Dependency audit and known CVEs
- HTTP security headers
- Form abuse: rate limits, honeypots, basic bot protection
- AI-specific: prompt injection into tools where applicable
Verification levels
- measured — we ran the work and captured logs/invoices
- partially_verified — some fields reader-supplied or pending invoice
- reader_reported — submitted by a reader until we verify
Corrections
Errors get a dated correction on the receipt and in the public changelog (coming with first real receipts). Email jordan@bot2botlabs.com.
AI crawlers
robots.txt allows major AI crawlers by default so receipts stay quotable. Opt-out requests are honored. See /data for machine-readable feeds.
Methods FAQ
- What is the difference between estimated and billed token dollars?
- Estimated token dollars convert your usage logs (e.g. ccusage or Tokscale) to public list prices on the receipt's price date. Billed token dollars come from invoices or plan usage pages. They are never merged on a receipt because subscriptions often include tokens with $0 marginal line items while estimated list-price equivalent is still useful for comparison.
- What is a price date?
- The calendar date when every dollar figure on that receipt was checked against provider pricing pages or invoices. SaaS comparisons must link to a public pricing URL stored on /prices with the same checked-on date.
- How do I cite a Bot2Bot receipt?
- Use the 'How to cite' block on each receipt page, or quote: Bot2Bot Labs (published_date). title. AI Receipt id. Price date price_date. https://bot2botlabs.com/receipts/id — include price date whenever you cite a dollar amount.
- Are AI crawlers allowed?
- Yes. robots.txt allows major AI crawlers including GPTBot, ClaudeBot, PerplexityBot, Google-Extended, and CCBot. Machine-readable exports live at /api/receipts.json, /llms.txt, and /data.