# Railway — API Agent Score

> Score: 74/100 (Grade: B) | Domain: railway.app | Rubric: 1.0.0 | Checked: July 24, 2026

Railway scored 74/100 (B), classified "partially-ready".

[View full report](https://www.postman.com/ai/ai-ready-apis/company/railway)
[All organizations](https://www.postman.com/ai/ai-ready-apis/llms.txt)

## Summary

- Overall: 74/100 (B)
- Classification: partially-ready

## Category Scores

- API Design: 52/100 (D)
- Developer Experience: 55/100 (D)
- Agent Discovery: 87/100 (A)
- Agent Understanding: 88/100 (A)
- Agent Usability: 86/100 (A)

## Check Results

### API Design

- [warn] Schema coverage & depth — 76/77 (99%) public params are fully typed (no any/**kwargs). Analyzer reports not all methods have a derivable input schema. Investigated: sdk 99%.
- [pass] Example coverage — Code samples in 4 language(s) across docs (top: shell, typescript, javascript); 2/20 pages have ≥ 2 languages on the same page. Investigated: docs 100%, sdk 100%, cli 0%.
- [fail] Machine-readable, versioned contract — no machine-readable help (`--help --format json` unsupported). Investigated: cli 0%.
- [fail] Auth declared & discoverable — no auth/config hint in --help. Investigated: cli 0%.
- [fail] Security & governance hygiene — No security.txt at /.well-known/security.txt or /security.txt. Investigated: wellknown 0%.

### Developer Experience

- [pass] Code samples in docs — Code samples in 4 language(s) across docs (top: shell, typescript, javascript); 2/20 pages have ≥ 2 languages on the same page. Investigated: docs 100%.
- [warn] Quickstart present — Quickstart page reachable (1 variants scanned starting at https://docs.railway.com/quick-start) but no runnable code sample detected in HTML or .md variant. Investigated: docs 50%.
- [warn] Description completeness — 42/55 operations lack a description. Investigated: sdk 24%.
- [fail] Self-service developer portal — No signup page detected across conventional paths (/signup, /sign-up, /register, /get-started, /console/signup, /dashboard/signup, /try, /try-free, /free, /free-trial, /start, /start-free). Investigated: docs 0%.
- [skip] Changelog published — No surface produced evidence for this capability in this run.

### Agent Discovery

- [pass] Registry & SDK presence — Indexed on Context7 (websites/railway, 4917 snippets). Investigated: docs 100%, sdk 100%, cli 100%, mcp 100%, wellknown 0%.
- [warn] Docs reachable, not hard auth-gated — 1 of 50 sampled pages require authentication (49 accessible). Investigated: docs 90%.
- [warn] llms.txt present, valid & comprehensive — No llms.txt directive found in HTML of any of 50 sampled pages. Investigated: docs 69%, sdk 0%.
- [warn] Crawlable / AEO — Sitemap present (1 entries) but carries no lastmod values. Investigated: wellknown 75%.

### Agent Understanding

- [pass] Machine-readable errors (RFC 9457) — Single base error "RailwayError" with 32 subclasses. Investigated: sdk 100%, cli 0%.
- [warn] Agent-navigable, token-efficient docs — 2 of 50 pages have substantive content differences between markdown and HTML (avg 4% missing). Investigated: docs 80%.
- [pass] Agent instructions file (AGENTS.md) — Agent instructions file found at https://railway.app/AGENTS.md. Investigated: wellknown 100%.
- [pass] Docs structured data — JSON-LD Article markup on 13/13 assessed pages (100%) with dateModified present. Investigated: docs 100%.
- [warn] Description consistency across surfaces — Mean pairwise description similarity across 2 surfaces (docs, sdk) is 6% (threshold 35% for full credit).
- [skip] Operation purpose clarity — No surface produced evidence for this capability in this run.

### Agent Usability

- [pass] Idempotency documented — Built-in retry machinery is present (grep-derived). Investigated: sdk 100%, cli 0%.
- [pass] Sandbox separation — Sandbox environments are exposed (sandbox). Investigated: sdk 100%.
- [fail] Runnable collection with test scripts — No public Postman workspace discovered for the org. Investigated: platform 0%.
- [skip] Rate-limit signaling — No surface produced evidence for this capability in this run.
- [skip] Pagination documented & consistent — No surface produced evidence for this capability in this run.

## Executive Summary

Railway's API Discovery and Understanding capabilities are strong, showing that partners and agents can find and parse your APIs. However, the program's two critical weaknesses — a missing machine-readable contract with no declared auth or security model, and no runnable collections for partners to execute against — mean partners and AI agents cannot confidently build integrations today. Fixing the contract foundation first unblocks everything downstream; adding a self-service portal and runnable truth closes the onboarding gap and makes the program partner-ready end-to-end.