03 / Scorecard / Payments

Orb

Name: Orb Agent Readiness Scorecard
Item: Orb
Rating: 43
Author: Headless Index pipeline (auto)

Headless Index

43/100

denominator 40

JAIRF

N/A

Verified

MAY 21, 2026

Methodology v1 · JAIRF v1.0.0

Editorial verdict

Orb is partially headless and partly UI-led. The Headless Index thesis-fit score of 43/100 puts it mid-table on the index, and JAIRF is recorded as N/A for this vendor because no public OpenAPI specification was reachable for the open-source scorer. In practice, vendors at this tier are partly machine-consumable: the core flows are reachable through code but several adjacent surfaces still expect a human at a dashboard, and the rest of this verdict explains where Orb lands inside that pattern. On the API surface, the question is whether the API is the product or a layer beneath the dashboard. Orb is usage-based billing infrastructure for AI and SaaS companies. Stainless-generated SDKs across Node, Python, Java, Go, Ruby, and Kotlin. The API surface covers customers, subscriptions, prices, events (usage ingestion), credits, invoices, and adjustments. The Stainless toolchain implies a maintained OpenAPI source-of-truth even when the public URL is auth-gated.^[1] Schema observability is the related test: can an agent introspect the contract from cold, or does it have to read prose documentation to do so? OpenAPI spec exists behind authentication on api.withorb.com. Stainless-generated SDKs imply an OpenAPI source-of-truth. Schema discoverability requires authenticated access.^[2] An agent can drive parts of this product, but not all of it: integrators should plan for human-in-the-loop checkpoints where the headless surface stops short. On headless operability: On headless operability, the docs crawl did not produce topic coverage sufficient to score programmatic setup, billing, teams, schema, or CLI workflows. A targeted AI review pass should visit the vendor's docs index and confirm what programmatic surfaces actually exist.^[3] On the MCP and agent-integration axis, which is the fastest-moving criterion in the index: On MCP posture, no official MCP server was detected in the vendor's GitHub organization and no community server was published to the MCP registry under their name. This may change rapidly given the recent MCP adoption curve.^[4] Event posture closes the loop: an agent that cannot react to state changes is reduced to polling. On webhooks and events, the docs crawler did not locate a webhooks reference page or events catalog. Editorial review should confirm whether the vendor publishes events at all, and if so whether signing and replay are documented. Net assessment: integrators can build agent flows against Orb, but the rough edge to plan around is schema observability^[5]. Expect to wrap missing pieces in bespoke glue or accept human-in-the-loop checkpoints. Workable but requires scaffolding.

Verdict by Headless Index pipeline (auto)

// AI-drafted from the evidence layer. Editorial review pending.

Scores

Scorecard detail

Headless Index · 5 sub-criteria

API-first design intent12/20

scored

Orb is usage-based billing infrastructure for AI and SaaS companies. Stainless-generated SDKs across Node, Python, Java, Go, Ruby, and Kotlin. The API surface covers customers, subscriptions, prices, events (usage ingestion), credits, invoices, and adjustments. The Stainless toolchain implies a maintained OpenAPI source-of-truth even when the public URL is auth-gated.

signals (6)

+AI review appliedReviewer: Editorial review on 2026-05-20
−OpenAPI specNot found across 34 probe paths
−GraphQL endpointNot discovered (5 probes; project-scoped endpoints require a real project ID)
+SDKs maintained7 (go, java, javascript, python, ruby); top by stars: orbcorp/orb-go (12 stars)
+SDK recency5 of 7 SDK repos pushed within 30 days (most recent SDK commit: 2026-05-20)
+npm weekly downloads226.2k across published packages; top: orb-billing @ 226.2k/week

cite (5)

openapi.probes_tried@2026-05-20
graphql.probes_tried@2026-05-20
github.sdks@2026-05-20
freshness.most_recent_sdk_commit@2026-05-20
github.sdks@2026-05-20

Headless operationUnknown

Unknown

Customer onboarding, plan and price authoring, usage event ingestion (high-throughput), invoice generation, credit grants, and webhook configuration are all programmable. The Orb dashboard handles UI for pricing experimentation; the API does everything else. Sandbox parity with production is documented.

signals (9)

+AI review appliedReviewer: Editorial review on 2026-05-20
−API operations exposedNo OpenAPI spec; operations count unknown
·Docs pages crawled0 pages (crawler: none)
·Auth schemes documentedAuth documentation page not reached by crawler
·Setup / quickstart docsNot reached by crawler
·Billing docsNot reached by crawler
·Teams / org docsNot reached by crawler
·CLI docsNot reached by crawler
·Schema / data model docsNot reached by crawler

cite (8)

openapi.operations_count@2026-05-20
docs.pages_crawled@2026-05-20
docs.pages_crawled@2026-05-20
docs.topics_found.setup@2026-05-20
docs.topics_found.billing@2026-05-20
docs.topics_found.teams@2026-05-20
docs.topics_found.cli@2026-05-20
docs.topics_found.schema@2026-05-20

MCP & agent postureUnknown

Unknown

No first-party Orb MCP server. The product is usage-based billing infrastructure; agent integration would naturally come through downstream framework wrappers. The Stainless-style spec posture makes that easy.

signals (2)

+AI review appliedReviewer: Editorial review on 2026-05-20
·MCP detector statusTimed out during collection (likely GitHub search API rate limit without GITHUB_TOKEN). No verified evidence about MCP presence.

cite (1)

mcp.registry_query@2026-05-20

Schema observability5/20

scored

OpenAPI spec exists behind authentication on api.withorb.com. Stainless-generated SDKs imply an OpenAPI source-of-truth. Schema discoverability requires authenticated access.

signals (3)

+AI review appliedReviewer: Editorial review on 2026-05-20
−OpenAPINot discovered across 34 standard probe paths
−GraphQL introspectionNo GraphQL endpoint discovered (5 probes; some vendors use project-scoped endpoints that require a real project handle)

cite (2)

openapi.probes_tried@2026-05-20
graphql.probes_tried@2026-05-20

Webhooks & eventsUnknown

Unknown

Orb webhooks deliver customer, subscription, invoice, and credit events with HMAC signing and documented retry policy. Catalog is purpose-built for the usage-based-billing lifecycle.

signals (2)

+AI review appliedReviewer: Editorial review on 2026-05-20
·Webhook docs pageNot reached by crawler within budget (0 pages crawled). Cannot confirm whether vendor offers webhooks.

cite (1)

docs.pages_crawled@2026-05-20

JAIRF · 6 dimensions

JAIRF · N/A

This vendor does not publish a public OpenAPI specification. JAIRF cannot be computed. The Headless Index score and editorial verdict carry the readiness assessment.

No public OpenAPI specification discovered during collection

Band rationale:C band: scores 40-75 range

04 / Embed

Show Orb's score on your site.

Drop a live badge into your README, footer, or marketing page. It updates automatically when we re-score, and every embed is a dofollow link back here.

Get embed code

Calibration

How THI compares to external scorers

Source	Score	Measures	Last checked
Fern Agent Score	not found	Documentation completeness and SDK shape (~22 checks)	—
CLIRank Agent Friendliness	0	CLI readiness, docs quality, and overall agent affordances	—
Cloudflare Is It Agent Ready?	blocked	Cloudflare's manual agent-readiness heuristic per vendor URL	—
Jentic Scorecard	n a	JAIRF-based scorecard requiring a public OpenAPI specification	—

THI 43 vs external median 0, delta +43Methodology delta noted — see verdict

THI display 43 vs external median 0 (delta +43). Deviation > 25 points: editor should review whether THI methodology is over-strict or external scorers are over-generous for this vendor.

Peers in Payments

IncreaseC

Headless Index 44/100

YapilyC

Headless Index 44/100

Authorize.NetC

Headless Index 48/100

See full Payments ranking →