LiteLLM
Powered by JAIRF v1.0.0 by Jentic · open methodology at /the-headless-index/methodology
LiteLLM earns Band B in the AI Platforms category of The Headless Index, with a thesis-fit score of 77/100. Its strongest dimension is headless operation (18/20); its weakest scored dimension is webhooks and events (12/20). No public OpenAPI specification was found when LiteLLM was scored, which limits how far an agent can go without human integration work.
Scorecard detail
LiteLLM is a proxy, so its request surface is OpenAI-shaped by construction, but the admin plane is the interesting part: /key/generate, /user/new, /team/new, /model/new and /spend/logs turn tenancy and budgets into ordinary HTTP calls. The Python package doubles as both SDK and server (pypi.org/project/litellm). TypeScript coverage stays thin, with @litellm/agent-sdk barely used.
signals (6)
- +AI review appliedReviewer: Editorial review on 2026-08-19
- −OpenAPI specNot found across 34 probe paths
- ·GraphQL endpointDiscovered at https://www.litellm.ai/graphql, introspection disabled or scoped
- ·SDKs maintained2 (python, typescript); top by stars: BerriAI/litellm (56766 stars)
- +SDK recency1 of 2 SDK repos pushed within 30 days (most recent SDK commit: 2026-08-19)
- −npm weekly downloadsNo published npm package detected for the JS/TS SDKs
cite (1)
- github.sdks@2026-08-19
You own the process, which settles most of the question. A YAML config file defines models, routing and guardrails, the proxy starts from the command line, and Helm charts in the repository cover Kubernetes (github.com/BerriAI/litellm). Every action in the admin UI maps to a documented endpoint because that UI is a client of the same API. Self-hosting is the default.
signals (9)
- +AI review appliedReviewer: Editorial review on 2026-08-19
- −API operations exposedNo OpenAPI spec; operations count unknown
- ·Docs pages crawled0 pages (crawler: none)
- ·Auth schemes documentedAuth documentation page not reached by crawler
- ·Setup / quickstart docsNot reached by crawler
- ·Billing docsNot reached by crawler
- ·Teams / org docsNot reached by crawler
- ·CLI docsNot reached by crawler
- ·Schema / data model docsNot reached by crawler
cite (1)
- ai_review_browser.topics_found@2026-08-19
LiteLLM operates as an MCP gateway, fronting registered MCP servers with the same key and budget controls it applies to models, and the repository carries mcp-gateway among its declared topics. It also publishes agent skills for driving live deployments (github.com/BerriAI/litellm-skills). What is absent is a plain MCP server exposing the admin API itself to a client.
signals (4)
- +AI review appliedReviewer: Editorial review on 2026-08-19
- +Official MCP serverhttps://github.com/BerriAI/mock-oauth2-mcp-server (2 stars, last commit 191 days ago)
- ·Community MCP servers1 community MCP repos; top by stars: https://github.com/BerriAI/litellm-skills (80 stars)
- +Agent-friendly SDKs1 TS/JS SDKs available; top: @litellm/agent-sdk
cite (1)
- ai_review_browser.mcp@2026-08-19
The proxy is FastAPI, so any running instance serves its own OpenAPI document and Swagger UI at /docs. That is real schema discoverability with one caveat: no hosted canonical spec URL exists, so an agent needs a live deployment before it can introspect anything. The typed Python definitions remain the practical reference (litellm/proxy/_types.py), which is source reading, not schema fetching.
signals (3)
- +AI review appliedReviewer: Editorial review on 2026-08-19
- −OpenAPINot discovered across 34 standard probe paths
- ·GraphQL introspectionGraphQL endpoint at https://www.litellm.ai/graphql but introspection is disabled, scoped, or behind authentication
cite (1)
- ai_review_browser.schema@2026-08-19
Real events exist and they are typed in code: WebhookEvent carries budget_crossed, soft_budget_crossed, threshold_crossed, projected_limit_exceeded and spend_tracked, each scoped by an entity group (litellm/proxy/_types.py). Delivery is a plain POST to a configured webhook URL. There is no signature header, no retry policy and no replay endpoint, so a receiver cannot verify origin.
signals (2)
- +AI review appliedReviewer: Editorial review on 2026-08-19
- ·Webhook docs pageNot reached by crawler within budget (0 pages crawled). Cannot confirm whether vendor offers webhooks.
cite (1)
- github.sdks@2026-08-19
This vendor does not publish a public OpenAPI specification. JAIRF cannot be computed. The Headless Index score and editorial verdict carry the readiness assessment.
No public OpenAPI specification discovered during collection
Powered by JAIRF v1.0.0 by Jentic
Band rationale:A band: JAIRF=N/A HeadlessIndex=77; JAIRF N/A ceiling applied: max band B when OpenAPI not available
Show LiteLLM's score on your site.
Drop a live badge into your README, footer, or marketing page. It updates automatically when we re-score, and every embed is a dofollow link back here.
How THI compares to external scorers
| Source | Score | Measures | Last checked |
|---|---|---|---|
| Fern Agent Score | 67 · D | Documentation completeness and SDK shape (~22 checks) | June 11, 2026 |
| CLIRank Agent Friendliness | not found | CLI readiness, docs quality, and overall agent affordances | — |
| Cloudflare Is It Agent Ready? | blocked | Cloudflare's manual agent-readiness heuristic per vendor URL | — |
| Jentic Scorecard | n a | JAIRF-based scorecard requiring a public OpenAPI specification | — |
THI display 77 vs external median 67 (delta +10). Within calibration band.
LiteLLM and agent readiness
- Is LiteLLM agent-ready?
- LiteLLM scores Band B on The Headless Index. Its JAIRF rating is not available because no machine-readable spec was scored. Its strongest area for agent use is headless operation; its weakest is webhooks and events.
- Does LiteLLM publish an OpenAPI spec?
- No published OpenAPI specification was found when LiteLLM was scored. That caps its JAIRF dimensions and forces agents to rely on documentation or reverse engineering to operate it.
- What is LiteLLM's Headless Index score?
- LiteLLM scores 77/100 on the Headless Index thesis-fit rubric and sits in Band B in the AI Platforms category. The score weighs API-first design, headless operation, MCP and agent posture, schema observability, and webhooks.