Postman

APIFlow-Bench 1.0 Leaderboard | Pagination

Whether a model walks paginated collections to completion — cursors, offsets, and page limits — instead of answering from the first page. 51 tasks × 24 models in this slice.

Ranking◴ Generated 2026-07-31☑ 6,120 trials▤ 24 models
Pass rate
82.9%
Error Rate
0.1%
Trials
6,120
Tasks
51
Models
24
p95 Time
15.5m
p95 Tokens
1,111,810
Tool Calls Avg
24.1
Rank
Rank Spread
Model
Pass rate ± 90% CI
Pass (no abstain)
Abstain%
p95 Time
p95 Tokens
Avg Tools
11 ↔ 11gpt-5.592.2% 86.3%–98.0%94.0% 235/2502.0% 5/2552.8m411,78419.3
21 ↔ 12gpt-5.6-sol91.8% 85.5%–97.6%94.0% 234/2492.4% 6/25511.5m332,65917.5
31 ↔ 13deepseek-v4-flash91.4% 85.1%–96.9%92.1% 233/2530.8% 2/2553.7m883,44425.6
31 ↔ 14kimi-k2p7-code91.4% 84.7%–97.3%92.5% 233/2521.2% 3/25513.0m678,74917.9
51 ↔ 14claude-haiku-4-5-2025100191.0% 84.3%–96.9%91.7% 232/2530.8% 2/2552.0m585,23820.1
51 ↔ 14claude-opus-4-891.0% 84.7%–96.5%94.7% 232/2453.9% 10/2552.8m277,96214.2
51 ↔ 14claude-sonnet-591.0% 84.3%–96.5%92.8% 232/2502.0% 5/2554.6m630,16219.2
51 ↔ 14claude-sonnet-4-691.0% 85.1%–96.5%91.0% 232/2550.0% 0/2559.8m964,53430.1
92 ↔ 15kimi-k390.6% 83.5%–96.5%90.6% 231/2550.0% 0/25538.8m1,239,87726.7
102 ↔ 16gpt-5.6-terra90.2% 83.5%–96.1%92.4% 230/2492.4% 6/2553.8m158,63614.4
102 ↔ 16kimi-k2p690.2% 82.4%–96.1%90.2% 230/2550.0% 0/25511.1m2,214,24322.9
123 ↔ 17kimi-k2p589.4% 82.4%–96.1%90.8% 228/2511.6% 4/2552.7m457,52817.3
123 ↔ 16glm-5p289.4% 82.7%–95.3%89.4% 228/2550.0% 0/25530.2m1,848,90721.6
145 ↔ 18gpt-5.6-luna88.6% 81.6%–94.9%90.0% 226/2511.6% 4/2554.3m152,37214.8
157 ↔ 20deepseek-v4-pro87.5% 80.0%–94.1%87.8% 223/2540.4% 1/25518.1m824,32023.9
1611 ↔ 21minimax-m2p786.3% 78.4%–92.9%87.6% 220/2511.6% 4/2551.8m324,53915.1
1611 ↔ 21qwen3p6-plus86.3% 79.6%–92.9%86.6% 220/2540.4% 1/25511.7m1,215,54323.7
1814 ↔ 21gpt-5-mini84.7% 77.6%–91.4%90.4% 216/2396.3% 16/2551.4m160,08612.7
1813 ↔ 21gpt-oss-20b84.7% 77.6%–91.0%87.1% 216/2482.7% 7/2554.2m159,64116
1814 ↔ 21qwen3p7-plus84.7% 77.6%–91.4%86.1% 216/2511.6% 4/25511.7m554,67314
2114 ↔ 21gpt-oss-120b84.3% 76.5%–91.4%84.6% 215/2540.4% 1/25549.7s164,60715.1
2222 ↔ 22gpt-5.4-mini70.2% 62.0%–78.4%75.5% 179/2377.1% 18/25524.0s42,40711.4
2323 ↔ 23minimax-m334.1% 27.4%–41.6%58.4% 87/14941.6% 106/25566.1m15,061,100159.3
2424 ↔ 24claude-fable-516.9% 9.4%–24.7%16.9% 43/2550.0% 0/2553.9m66,6855.7

Diagnostics

Loading the full trial dataset for this view…