Postman

APIFlow-Bench 1.0 Leaderboard | Pagination

Whether a model walks paginated collections to completion — cursors, offsets, and page limits — instead of answering from the first page. 51 tasks × 24 models in this slice.

Ranking◴ Generated 2026-07-316,120 trials24 models
Pass rate
82.9%
Error Rate
0.1%
Trials
6,120
Tasks
51
Models
24
p95 Time
15.5m
p95 Tokens
1,111,810
Tool Calls Avg
24.1
Rank
Rank Spread
Model
Pass rate ± 90% CI
Pass (no abstain)
Abstain%
p95 Time
p95 Tokens
Avg Tools
1111gpt-5.592.2% 86.3%98.0%94.0% 235/2502.0% 5/2552.8m411,78419.3
2112gpt-5.6-sol91.8% 85.5%97.6%94.0% 234/2492.4% 6/25511.5m332,65917.5
3113deepseek-v4-flash91.4% 85.1%96.9%92.1% 233/2530.8% 2/2553.7m883,44425.6
3114kimi-k2p7-code91.4% 84.7%97.3%92.5% 233/2521.2% 3/25513.0m678,74917.9
5114claude-haiku-4-5-2025100191.0% 84.3%96.9%91.7% 232/2530.8% 2/2552.0m585,23820.1
5114claude-opus-4-891.0% 84.7%96.5%94.7% 232/2453.9% 10/2552.8m277,96214.2
5114claude-sonnet-591.0% 84.3%96.5%92.8% 232/2502.0% 5/2554.6m630,16219.2
5114claude-sonnet-4-691.0% 85.1%96.5%91.0% 232/2550.0% 0/2559.8m964,53430.1
9215kimi-k390.6% 83.5%96.5%90.6% 231/2550.0% 0/25538.8m1,239,87726.7
10216gpt-5.6-terra90.2% 83.5%96.1%92.4% 230/2492.4% 6/2553.8m158,63614.4
10216kimi-k2p690.2% 82.4%96.1%90.2% 230/2550.0% 0/25511.1m2,214,24322.9
12317kimi-k2p589.4% 82.4%96.1%90.8% 228/2511.6% 4/2552.7m457,52817.3
12316glm-5p289.4% 82.7%95.3%89.4% 228/2550.0% 0/25530.2m1,848,90721.6
14518gpt-5.6-luna88.6% 81.6%94.9%90.0% 226/2511.6% 4/2554.3m152,37214.8
15720deepseek-v4-pro87.5% 80.0%94.1%87.8% 223/2540.4% 1/25518.1m824,32023.9
161121minimax-m2p786.3% 78.4%92.9%87.6% 220/2511.6% 4/2551.8m324,53915.1
161121qwen3p6-plus86.3% 79.6%92.9%86.6% 220/2540.4% 1/25511.7m1,215,54323.7
181421gpt-5-mini84.7% 77.6%91.4%90.4% 216/2396.3% 16/2551.4m160,08612.7
181321gpt-oss-20b84.7% 77.6%91.0%87.1% 216/2482.7% 7/2554.2m159,64116
181421qwen3p7-plus84.7% 77.6%91.4%86.1% 216/2511.6% 4/25511.7m554,67314
211421gpt-oss-120b84.3% 76.5%91.4%84.6% 215/2540.4% 1/25549.7s164,60715.1
222222gpt-5.4-mini70.2% 62.0%78.4%75.5% 179/2377.1% 18/25524.0s42,40711.4
232323minimax-m334.1% 27.4%41.6%58.4% 87/14941.6% 106/25566.1m15,061,100159.3
242424claude-fable-516.9% 9.4%24.7%16.9% 43/2550.0% 0/2553.9m66,6855.7

Diagnostics

Loading the full trial dataset for this view…