$HEADLESS SYSTEMS
03 / Scorecard / AI Platforms

AssemblyAI

D
Headless Index
31/100
denominator 80
JAIRF
77.9/100
AI-Ready
Verified
MAY 21, 2026
Methodology v1 · JAIRF v1.0.0

Powered by JAIRF v1.0.0 by Jentic · open methodology at /the-headless-index/methodology

Editorial verdict
AssemblyAI remains a dashboard-first product with a limited programmatic surface. The Headless Index thesis-fit score of 31/100 sits in the lower band of the index, and JAIRF v1.0.0 puts it at 77.9/100 (Level 3, AI-Ready). In practice, vendors at this tier ship enough API to be useful but not enough to be operated end to end by agents without a human in the loop, and the rest of this verdict explains where AssemblyAI lands inside that pattern. On the API surface, the question is whether the API is the product or a layer beneath the dashboard. AssemblyAI is speech-to-text plus the LeMUR LLM layer for audio understanding. The REST API at api.assemblyai.com exposes transcripts, real-time streaming, lemur prompts, and audio intelligence features (sentiment, topic detection, summarization). SDKs in Python, Node, Go, Java, C#, Ruby, and Rust. Published OpenAPI specification.[1] Schema observability is the related test: can an agent introspect the contract from cold, or does it have to read prose documentation to do so? Public OpenAPI at www.assemblyai.com/docs/api-reference/openapi.json. Schema discoverability is reference-class for audio-AI.[2] An agent cannot drive this product end to end today: the headless surface covers basic CRUD but tapers out before reaching the workflows that matter most. On headless operability: Transcripts, real-time sessions, LeMUR queries, project configuration, and webhook subscriptions are all programmable. The AssemblyAI dashboard handles billing and team management. Sandbox parity with production is documented.[3] On the MCP and agent-integration axis, which is the fastest-moving criterion in the index: No first-party AssemblyAI MCP server. The Voice Agent reference architectures show the platform integrated into agent stacks (typically as the STT plus understanding layer in a voice-first agent). Agent integration is community-led at the protocol level.[4] Event posture closes the loop: an agent that cannot react to state changes is reduced to polling. On webhooks and events, the docs crawler did not locate a webhooks reference page or events catalog. Editorial review should confirm whether the vendor publishes events at all, and if so whether signing and replay are documented. Net assessment: AssemblyAI is not a strong target for agent-driven workflows today. The weakest link is MCP posture[5], and the broader surface gives agents too little to operate against. Pick it only when the rest of your stack already mandates it. Use only when locked in.
Verdict by Headless Index pipeline (auto)
// AI-drafted from the evidence layer. Editorial review pending.
Scores

Scorecard detail

Headless Index · 5 sub-criteria
API-first design intent10/20
scored

AssemblyAI is speech-to-text plus the LeMUR LLM layer for audio understanding. The REST API at api.assemblyai.com exposes transcripts, real-time streaming, lemur prompts, and audio intelligence features (sentiment, topic detection, summarization). SDKs in Python, Node, Go, Java, C#, Ruby, and Rust. Published OpenAPI specification.

signals (6)
  • +AI review appliedReviewer: Editorial review on 2026-05-20
  • +OpenAPI specPublished, 14 operations
  • ·GraphQL endpointDiscovered at https://www.assemblyai.com/graphql, introspection disabled or scoped
  • ·SDKs maintained2 (javascript, python); top by stars: AssemblyAI/assemblyai-python-sdk (206 stars)
  • +SDK recency2 of 2 SDK repos pushed within 30 days (most recent SDK commit: 2026-05-19)
  • +npm weekly downloads361.3k across published packages; top: assemblyai @ 361.3k/week
cite (5)
  • openapi.url@2026-05-20
  • graphql.url@2026-05-20
  • github.sdks@2026-05-20
  • freshness.most_recent_sdk_commit@2026-05-20
  • github.sdks@2026-05-20
Headless operation5/20
scored

Transcripts, real-time sessions, LeMUR queries, project configuration, and webhook subscriptions are all programmable. The AssemblyAI dashboard handles billing and team management. Sandbox parity with production is documented.

signals (9)
  • +AI review appliedReviewer: Editorial review on 2026-05-20
  • ·API operations exposed14 operations in OpenAPI spec
  • ·Docs pages crawled0 pages (crawler: none)
  • ·Auth schemes documentedAuth documentation page not reached by crawler
  • ·Setup / quickstart docsNot reached by crawler
  • ·Billing docsNot reached by crawler
  • ·Teams / org docsNot reached by crawler
  • ·CLI docsNot reached by crawler
  • ·Schema / data model docsNot reached by crawler
cite (8)
  • openapi.operations_count@2026-05-20
  • docs.pages_crawled@2026-05-20
  • docs.pages_crawled@2026-05-20
  • docs.topics_found.setup@2026-05-20
  • docs.topics_found.billing@2026-05-20
  • docs.topics_found.teams@2026-05-20
  • docs.topics_found.cli@2026-05-20
  • docs.topics_found.schema@2026-05-20
MCP & agent posture0/20
scored

No first-party AssemblyAI MCP server. The Voice Agent reference architectures show the platform integrated into agent stacks (typically as the STT plus understanding layer in a voice-first agent). Agent integration is community-led at the protocol level.

signals (4)
  • +AI review appliedReviewer: Editorial review on 2026-05-20
  • Official MCP serverNone found in vendor's GitHub org or the official MCP registry
  • Community MCP serversNone found
  • +Agent-friendly SDKs1 TS/JS SDKs available; top: assemblyai (361.3k/week downloads)
cite (3)
  • mcp.registry_query@2026-05-20
  • mcp.github_search_query@2026-05-20
  • github.sdks@2026-05-20
Schema observability10/20
scored

Public OpenAPI at www.assemblyai.com/docs/api-reference/openapi.json. Schema discoverability is reference-class for audio-AI.

signals (3)
  • +AI review appliedReviewer: Editorial review on 2026-05-20
  • +OpenAPIPublished at https://www.assemblyai.com/docs/api-reference/openapi.json (OpenAPI 3.1.0, 14 operations)
  • ·GraphQL introspectionGraphQL endpoint at https://www.assemblyai.com/graphql but introspection is disabled, scoped, or behind authentication
cite (2)
  • openapi.url@2026-05-20
  • graphql.url@2026-05-20
Webhooks & eventsUnknown
Unknown

AssemblyAI webhooks deliver transcript completion events with documented signature verification. Catalog is appropriate for asynchronous audio-pipeline use cases.

signals (2)
  • +AI review appliedReviewer: Editorial review on 2026-05-20
  • ·Webhook docs pageNot reached by crawler within budget (0 pages crawled). Cannot confirm whether vendor offers webhooks.
cite (1)
  • docs.pages_crawled@2026-05-20
JAIRF · 6 dimensions
FCFoundational Compliance
55/100

Structural validity, standards conformance, and parsability of the OpenAPI specification.

DXJDeveloper Experience & Tooling Compatibility
77.5/100

Documentation clarity, example coverage, response completeness, and ingestion health.

ARAXAI-Readiness & Agent Experience
93.7/100

Semantic clarity, intent expression, datatype specificity, and error standardization.

AUAgent Usability
100/100

Operational composability, complexity comfort, navigation affordances, and safety patterns.

SECSecurity
70/100

Authentication strength, transport security, secret hygiene, and OWASP risk posture.

AIDAI Discoverability
60.7/100

Descriptive richness, intent phrasing, workflow context, and registry signals.

Band rationale:D band triggered: HeadlessIndex=31

04 / Embed

Show AssemblyAI's score on your site.

Drop a live badge into your README, footer, or marketing page. It updates automatically when we re-score, and every embed is a dofollow link back here.

Calibration

How THI compares to external scorers

SourceScoreMeasuresLast checked
Fern Agent Scorenot foundDocumentation completeness and SDK shape (~22 checks)
CLIRank Agent Friendliness78 · GoodCLI readiness, docs quality, and overall agent affordances
Cloudflare Is It Agent Ready?blockedCloudflare's manual agent-readiness heuristic per vendor URL
Jentic ScorecardJAIRF-based scorecard requiring a public OpenAPI specification
THI 31 vs external median 78, delta -47Methodology delta noted — see verdict

THI display 31 vs external median 78 (delta -47). Deviation > 25 points: editor should review whether THI methodology is over-strict or external scorers are over-generous for this vendor.