Boeingboeing.com

ScoredOct 27, 2026, 08:42 PM

Boeing's API program has a meaningful foundation in API design and security, but it is effectively invisible to both partners and AI agents today. The two most critical gaps are discoverability — no machine-readable docs surface, no registry presence, and no agent instruction file — and executability, meaning partners have no runnable workspace to make a first call against.

API DesignA clean, typed, well-governed API contract agents can reason about0 pass1 warn0 fail61C
SignalPointsFindingsRationale
warnSecurity & governance hygienevia wellknown7.5/15security.txt is present but served only at the legacy /security.txt path. Investigated: wellknown 50%.
Fix: Serve security.txt at /.well-known/ with a Contact line and a future Expires date (RFC 9116).
No leaked secrets, no critical lint violations, no OWASP API Top-10 spec smells, and a published vulnerability-disclosure channel.
naMachine-readable, versioned contract—/25No surface produced evidence for this capability in this run.A current OpenAPI version with a declared versioning scheme lets agents reason about the contract.
naSchema coverage & depth—/25No surface produced evidence for this capability in this run.Typed, complete request/response schemas are what make agent function-calling possible.
naAuth declared & discoverable—/25No surface produced evidence for this capability in this run.Agents can only call an API when they can determine its auth posture — a declared scheme, or an explicit statement that none is required.
naExample coverage—/10No surface produced evidence for this capability in this run.Examples carry shape semantics schemas under-specify — for humans and agents alike.
Developer ExperienceThe context both developers and agents need to integrate fast — onboarding, code samples, complete descriptions and worked examples1 pass0 warn0 fail100A+
SignalPointsFindingsRationale
passSelf-service developer portalvia docs29/29Signup page found at http://pages.info.boeing-message.com/signup/, but no free tier or sandbox is documented in docs/pricing, so an agent may hit a paywall. Investigated: docs 100%.A first call without a human in the loop — self-serve credentials, a free tier, or an API that needs none.
naQuickstart present—/25No surface produced evidence for this capability in this run.A quickstart is the fastest path from landing page to first successful call.
naCode samples in docs—/18No surface produced evidence for this capability in this run.Multi-language samples shorten time-to-first-call.
naDescription completeness—/15No surface produced evidence for this capability in this run.Complete descriptions are the context humans and agents need to use endpoints.
naChangelog published—/13No surface produced evidence for this capability in this run.A published changelog lets partners track changes without surprise.
Agent DiscoveryPartners and their agents can find your APIs — llms.txt, registries, crawlable and reachable docs1 pass0 warn2 fail44F
SignalPointsFindingsRationale
passCrawlable / AEOvia wellknown12/12Sitemap has lastmod on 100% of entries, and the newest is under 90 days old. Investigated: wellknown 100%.Bots allowed plus a fresh sitemap make docs findable by agent crawlers.
failllms.txt present, valid & comprehensivevia docs0/30No llms-full.txt was found at any candidate origin, so agents can't grab your full docs in one fetch. Investigated: docs 0%.
Fix: Publish a concatenated, agent-readable copy of your documentation at /llms-full.txt on your docs site.
A valid, comprehensive llms.txt is the machine-readable entry point for agents.
failRegistry & SDK presencevia docs0/28Not indexed on Context7 — agents can't pull this API's docs on demand via Context7. Investigated: docs 0%, sdk 0%, cli 0%.
Fix: Submit the docs to context7.com so coding agents can retrieve up-to-date docs on demand.
Listing in MCP registries and publishing SDKs puts the API where agents and their tooling look.
naDocs reachable, not hard auth-gated—/30No surface produced evidence for this capability in this run.Agents can only index and fetch docs they can reach — past auth gates and over correct HTTP semantics.
Agent UnderstandingAgents can correctly interpret your APIs — machine-readable errors, consistent descriptions, structured data, parseable docs0 pass0 warn1 fail40F
SignalPointsFindingsRationale
failAgent instructions file (AGENTS.md)via wellknown0/10No AGENTS.md at the site root or /.well-known/, so coding agents have no ready-made setup and usage instructions. Investigated: wellknown 0%.
Fix: Publish an AGENTS.md with setup, auth, and usage instructions a coding agent can follow.
An AGENTS.md gives coding agents explicit setup, auth, and usage instructions to interpret and operate the API — beyond llms.txt's link index.
naMachine-readable errors (RFC 9457)—/28No surface produced evidence for this capability in this run.RFC 9457 problem details and a documented error-code inventory let agents parse failures without burning tokens.
naOperation purpose clarity—/25No surface produced evidence for this capability in this run.Agents select the right endpoint from its summary + operationId; clear, named operations make tool-selection reliable — the strongest driver of correct tool choice.
naAgent-navigable, token-efficient docs—/22No surface produced evidence for this capability in this run.Server-rendered, clean, small-footprint docs are what an agent can cheaply fetch and parse correctly.
naDocs structured data—/8No surface produced evidence for this capability in this run.Structured data (JSON-LD/schema.org) on docs pages gives agents an unambiguous parse target and is what answer engines cite. Detected on the JS-rendered head (Firecrawl) for a bounded page budget, so JS-injected JSON-LD is now caught; pages we can't render are excluded rather than failed.
naDescription consistency across surfaces—/7Only 0 surface description(s) with ≥6 tokens available; need at least 2 to compare.Every surface tells the same story about what the product is.
Agent UsabilityAgents have the context to use your APIs reliably, not just find them0 pass0 warn1 fail40F
SignalPointsFindingsRationale
failRunnable collection with test scriptsvia platform0/9No public Postman workspace found for the org, so there's no runnable collection an agent can execute against. Investigated: platform 0%.
Fix: Publish at least one public Postman workspace and link it from your developer portal so agents can use Run-in-Postman.
A public, maintained collection with assertions is runnable truth agents validate against.
naIdempotency documented—/27No surface produced evidence for this capability in this run.Documented idempotency lets agents retry safely.
naRate-limit signaling—/22No surface produced evidence for this capability in this run.Machine-readable rate-limit headers let agents throttle adaptively.
naPagination documented & consistent—/22No surface produced evidence for this capability in this run.Consistent, documented pagination lets agents traverse collections.
naSandbox separation—/20No surface produced evidence for this capability in this run.An isolated environment lets agents exercise destructive operations safely.
Want to improve your results?