kimi-k3
2,335 trials on 467 tasks across all task sets — 2,098 passed, 237 failed. Click any task row for a quick view of its trials; every trial's raw transcript (JSON) is available for download. Use the task-set bar to reproduce any overview slice.
Showing All tasks: 467 tasks · 2335 trials · pass rate 89.9% (2098/2335) — same numbers as that overview slice.
| Task | Result | Trials | Passed | Rate | Bucket | Horizon | Axes | Time | Tokens |
|---|---|---|---|---|---|---|---|---|---|
| v56-w01-chain-1to02 | 1/5 passed | 5 | 1 | 20.0% | Hard + Long-horizon | Long | Pagination | 43.9mavg of 5 | 729.1Kavg of 5 |
| v56-w01-chain-1to03 | 5/5 passed | 5 | 5 | 100.0% | Hard + Long-horizon | Long | Discovery | 4.5mavg of 5 | 29.4Kavg of 5 |
| v56-w01-chain-1to04 | 5/5 passed | 5 | 5 | 100.0% | Hard + Long-horizon | Long | Statefulness | 6.3mavg of 5 | 45.4Kavg of 5 |
| v56-w01-chain-1to05 | 1/5 passed | 5 | 1 | 20.0% | Hard + Long-horizon | Long | Schema | 63.7mavg of 5 | 1.2Mavg of 5 |
| v56-w01-chain-1to06 | 5/5 passed | 5 | 5 | 100.0% | Hard + Long-horizon | Long | Multi-step Workflow | 22.7mavg of 5 | 276.1Kavg of 5 |
| v56-w01-chain-1to07 | 5/5 passed | 5 | 5 | 100.0% | Hard + Long-horizon | Long | Authentication | 3.8mavg of 5 | 23.3Kavg of 5 |
| v56-w01-chain-1to08 | 2/5 passed | 5 | 2 | 40.0% | Hard + Long-horizon | Long | Error Recovery | 55.5mavg of 5 | 1.0Mavg of 5 |
| v56-w01-chain-1to09 | 5/5 passed | 5 | 5 | 100.0% | Hard + Long-horizon | Long | Statefulness | 14.3mavg of 5 | 134.8Kavg of 5 |
| v56-w01-chain-1to10 | 4/5 passed | 5 | 4 | 80.0% | Hard + Long-horizon | Long | Discovery | 9.6mavg of 5 | 87.8Kavg of 5 |
| v56-w01-chain-1to11 | 5/5 passed | 5 | 5 | 100.0% | Hard + Long-horizon | Long | Statefulness | 3.6mavg of 5 | 20.7Kavg of 5 |
| v56-w01-chain-1to12 | 5/5 passed | 5 | 5 | 100.0% | Hard + Long-horizon | Long | Discovery | 3.8mavg of 5 | 22.4Kavg of 5 |
| v56-w01-chain-1to13 | 5/5 passed | 5 | 5 | 100.0% | Hard + Long-horizon | Long | Schema | 5.8mavg of 5 | 36.1Kavg of 5 |
| v56-w01-chain-1to14 | 5/5 passed | 5 | 5 | 100.0% | Hard + Long-horizon | Long | Multi-step Workflow | 10.1mavg of 5 | 78.0Kavg of 5 |
| v56-w01-chain-1to15 | 5/5 passed | 5 | 5 | 100.0% | Hard + Long-horizon | Long | Error Recovery | 7.6mavg of 5 | 53.2Kavg of 5 |
| v56-w01-chain-1to16 | 5/5 passed | 5 | 5 | 100.0% | Hard + Long-horizon | Long | Pagination | 5.9mavg of 5 | 35.7Kavg of 5 |
| v56-w01-chain-1to17 | 5/5 passed | 5 | 5 | 100.0% | Hard + Long-horizon | Long | Discovery | 5.6mavg of 5 | 30.4Kavg of 5 |
| v56-w01-chain-1to18 | 5/5 passed | 5 | 5 | 100.0% | Hard + Long-horizon | Long | Schema | 5.5mavg of 5 | 35.2Kavg of 5 |
| v56-w01-chain-1to19 | 4/5 passed | 5 | 4 | 80.0% | Hard + Long-horizon | Long | Multi-step Workflow | 67.9mavg of 5 | 1.8Mavg of 5 |
| v56-w01-chain-1to20 | 4/5 passed | 5 | 4 | 80.0% | Hard + Long-horizon | Long | Authentication | 34.9mavg of 5 | 513.4Kavg of 5 |
| v56-w01-sub01 | 4/5 passed | 5 | 4 | 80.0% | Hard | Medium | Statefulness | 44.8mavg of 5 | 668.3Kavg of 5 |
| v56-w01-sub02 | 5/5 passed | 5 | 5 | 100.0% | Easy | Short | Pagination | 4.0mavg of 5 | 21.0Kavg of 5 |
| v56-w01-sub03 | 5/5 passed | 5 | 5 | 100.0% | Easy | Short | Discovery | 4.7mavg of 5 | 26.4Kavg of 5 |
| v56-w01-sub04 | 5/5 passed | 5 | 5 | 100.0% | Easy | Short | Statefulness | 5.5mavg of 5 | 31.3Kavg of 5 |
| v56-w01-sub05 | 5/5 passed | 5 | 5 | 100.0% | Hard | Short | Schema | 18.2mavg of 5 | 164.8Kavg of 5 |
| v56-w01-sub06 | 5/5 passed | 5 | 5 | 100.0% | Hard | Medium | Multi-step Workflow | 54.2mavg of 5 | 750.5Kavg of 5 |
| v56-w01-sub07 | 5/5 passed | 5 | 5 | 100.0% | Easy | Short | Authentication | 5.8mavg of 5 | 27.2Kavg of 5 |
| v56-w01-sub08 | 4/5 passed | 5 | 4 | 80.0% | Hard | Medium | Error Recovery | 72.0mavg of 5 | 1.8Mavg of 5 |
| v56-w01-sub09 | 5/5 passed | 5 | 5 | 100.0% | Easy | Short | Statefulness | 5.3mavg of 5 | 23.6Kavg of 5 |
| v56-w01-sub10 | 4/5 passed | 5 | 4 | 80.0% | Hard | Short | Discovery | 11.2mavg of 5 | 74.0Kavg of 5 |
| v56-w01-sub11 | 5/5 passed | 5 | 5 | 100.0% | Easy | Short | Statefulness | 6.2mavg of 5 | 25.3Kavg of 5 |
| v56-w01-sub12 | 5/5 passed | 5 | 5 | 100.0% | Easy | Short | Discovery | 7.4mavg of 5 | 35.0Kavg of 5 |
| v56-w01-sub13 | 5/5 passed | 5 | 5 | 100.0% | Easy | Short | Schema | 5.3mavg of 5 | 19.2Kavg of 5 |
| v56-w01-sub14 | 5/5 passed | 5 | 5 | 100.0% | Hard | Medium | Multi-step Workflow | 11.0mavg of 5 | 51.8Kavg of 5 |
| v56-w01-sub15 | 2/5 passed | 5 | 2 | 40.0% | Hard | Short | Error Recovery | 7.8mavg of 5 | 35.9Kavg of 5 |
| v56-w01-sub16 | 5/5 passed | 5 | 5 | 100.0% | Easy | Short | Pagination | 8.4mavg of 5 | 21.5Kavg of 5 |
| v56-w01-sub17 | 5/5 passed | 5 | 5 | 100.0% | Easy | Short | Discovery | 11.4mavg of 5 | 48.2Kavg of 5 |
| v56-w01-sub18 | 5/5 passed | 5 | 5 | 100.0% | Hard | Short | Schema | 8.0mavg of 5 | 30.2Kavg of 5 |
| v56-w01-sub19 | 2/5 passed | 5 | 2 | 40.0% | Hard | Medium | Multi-step Workflow | 45.3mavg of 5 | 612.8Kavg of 5 |
| v56-w01-sub20 | 3/5 passed | 5 | 3 | 60.0% | Hard | Short | Authentication | 36.7mavg of 5 | 351.4Kavg of 5 |
| v56-w02-chain-1to02 | 5/5 passed | 5 | 5 | 100.0% | Hard + Long-horizon | Long | Error Recovery | 7.8mavg of 5 | 33.0Kavg of 5 |
| v56-w02-chain-1to03 | 5/5 passed | 5 | 5 | 100.0% | Hard + Long-horizon | Long | Statefulness | 7.7mavg of 5 | 32.3Kavg of 5 |
| v56-w02-chain-1to04 | 5/5 passed | 5 | 5 | 100.0% | Hard + Long-horizon | Long | Schema | 10.2mavg of 5 | 43.9Kavg of 5 |
| v56-w02-chain-1to05 | 5/5 passed | 5 | 5 | 100.0% | Hard + Long-horizon | Long | Discovery | 9.6mavg of 5 | 36.8Kavg of 5 |
| v56-w02-chain-1to06 | 5/5 passed | 5 | 5 | 100.0% | Hard + Long-horizon | Long | Statefulness | 8.5mavg of 5 | 31.0Kavg of 5 |
| v56-w02-chain-1to07 | 5/5 passed | 5 | 5 | 100.0% | Hard + Long-horizon | Long | Error Recovery | 9.4mavg of 5 | 36.3Kavg of 5 |
| v56-w02-chain-1to08 | 5/5 passed | 5 | 5 | 100.0% | Hard + Long-horizon | Long | Error Recovery | 7.6mavg of 5 | 28.7Kavg of 5 |
| v56-w02-chain-1to09 | 5/5 passed | 5 | 5 | 100.0% | Hard + Long-horizon | Long | Statefulness | 8.3mavg of 5 | 36.9Kavg of 5 |
| v56-w02-chain-1to10 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Discovery | 7.0mavg of 5 | 32.4Kavg of 5 |
| v56-w02-chain-1to11 | 5/5 passed | 5 | 5 | 100.0% | Hard + Long-horizon | Long | Multi-step Workflow | 8.0mavg of 5 | 36.8Kavg of 5 |
| v56-w02-chain-1to12 | 5/5 passed | 5 | 5 | 100.0% | Hard + Long-horizon | Long | Schema | 7.6mavg of 5 | 31.7Kavg of 5 |
| v56-w02-chain-1to13 | 5/5 passed | 5 | 5 | 100.0% | Hard + Long-horizon | Long | Statefulness | 6.5mavg of 5 | 30.1Kavg of 5 |
| v56-w02-chain-1to14 | 4/5 passed | 5 | 4 | 80.0% | Hard + Long-horizon | Long | Multi-step Workflow | 8.7mavg of 5 | 43.5Kavg of 5 |
| v56-w02-chain-1to15 | 5/5 passed | 5 | 5 | 100.0% | Hard + Long-horizon | Long | Statefulness | 13.5mavg of 5 | 46.1Kavg of 5 |
| v56-w02-chain-1to16 | 5/5 passed | 5 | 5 | 100.0% | Hard + Long-horizon | Long | Statefulness | 7.5mavg of 5 | 38.2Kavg of 5 |
| v56-w02-chain-1to17 | 5/5 passed | 5 | 5 | 100.0% | Hard + Long-horizon | Long | Authentication | 6.0mavg of 5 | 30.1Kavg of 5 |
| v56-w02-chain-1to18 | 5/5 passed | 5 | 5 | 100.0% | Hard + Long-horizon | Long | Error Recovery | 4.9mavg of 5 | 21.9Kavg of 5 |
| v56-w02-chain-1to19 | 5/5 passed | 5 | 5 | 100.0% | Hard + Long-horizon | Long | Statefulness | 15.5mavg of 5 | 42.8Kavg of 5 |
| v56-w02-chain-1to20 | 5/5 passed | 5 | 5 | 100.0% | Hard + Long-horizon | Long | Statefulness | 16.4mavg of 5 | 38.1Kavg of 5 |
| v56-w02-sub01 | 5/5 passed | 5 | 5 | 100.0% | Hard | Medium | Discovery | 14.1mavg of 5 | 39.7Kavg of 5 |
| v56-w02-sub02 | 5/5 passed | 5 | 5 | 100.0% | Hard | Medium | Error Recovery | 14.0mavg of 5 | 39.6Kavg of 5 |
| v56-w02-sub03 | 5/5 passed | 5 | 5 | 100.0% | Easy | Short | Statefulness | 14.7mavg of 5 | 24.7Kavg of 5 |
| v56-w02-sub04 | 5/5 passed | 5 | 5 | 100.0% | Easy | Short | Schema | 15.3mavg of 5 | 49.2Kavg of 5 |
| v56-w02-sub05 | 5/5 passed | 5 | 5 | 100.0% | Easy | Short | Discovery | 14.2mavg of 5 | 30.8Kavg of 5 |
| v56-w02-sub06 | 5/5 passed | 5 | 5 | 100.0% | Easy | Short | Statefulness | 13.2mavg of 5 | 22.1Kavg of 5 |
| v56-w02-sub07 | 5/5 passed | 5 | 5 | 100.0% | Hard | Medium | Error Recovery | 3.3mavg of 5 | 29.3Kavg of 5 |
| v56-w02-sub08 | 5/5 passed | 5 | 5 | 100.0% | Long-horizon | Medium | Error Recovery | 3.2mavg of 5 | 30.6Kavg of 5 |
| v56-w02-sub09 | 5/5 passed | 5 | 5 | 100.0% | Easy | Short | Statefulness | 3.0mavg of 5 | 31.1Kavg of 5 |
| v56-w02-sub10 | 5/5 passed | 5 | 5 | 100.0% | Easy | Short | Discovery | 3.0mavg of 5 | 31.8Kavg of 5 |
| v56-w02-sub11 | 5/5 passed | 5 | 5 | 100.0% | Easy | Short | Multi-step Workflow | 2.5mavg of 5 | 17.5Kavg of 5 |
| v56-w02-sub12 | 5/5 passed | 5 | 5 | 100.0% | Easy | Short | Schema | 2.1mavg of 5 | 18.7Kavg of 5 |
| v56-w02-sub13 | 5/5 passed | 5 | 5 | 100.0% | Easy | Short | Statefulness | 2.9mavg of 5 | 27.2Kavg of 5 |
| v56-w02-sub14 | 5/5 passed | 5 | 5 | 100.0% | Easy | Short | Multi-step Workflow | 1.8mavg of 5 | 15.0Kavg of 5 |
| v56-w02-sub15 | 5/5 passed | 5 | 5 | 100.0% | Hard | Short | Statefulness | 2.4mavg of 5 | 21.5Kavg of 5 |
| v56-w02-sub16 | 5/5 passed | 5 | 5 | 100.0% | Easy | Short | Statefulness | 3.5mavg of 5 | 21.9Kavg of 5 |
| v56-w02-sub17 | 5/5 passed | 5 | 5 | 100.0% | Long-horizon | Medium | Authentication | 4.5mavg of 5 | 35.7Kavg of 5 |
| v56-w02-sub18 | 5/5 passed | 5 | 5 | 100.0% | Long-horizon | Medium | Error Recovery | 4.7mavg of 5 | 40.5Kavg of 5 |
| v56-w02-sub19 | 5/5 passed | 5 | 5 | 100.0% | Easy | Short | Statefulness | 3.9mavg of 5 | 24.2Kavg of 5 |
| v56-w02-sub20 | 5/5 passed | 5 | 5 | 100.0% | Long-horizon | Medium | Statefulness | 3.8mavg of 5 | 26.2Kavg of 5 |
| v56-w03-chain-1to02 | 5/5 passed | 5 | 5 | 100.0% | Hard + Long-horizon | Long | Multi-step Workflow | 10.4mavg of 5 | 73.1Kavg of 5 |
| v56-w03-chain-1to03 | 5/5 passed | 5 | 5 | 100.0% | Hard + Long-horizon | Long | Error Recovery | 11.7mavg of 5 | 171.7Kavg of 5 |
| v56-w03-chain-1to04 | 5/5 passed | 5 | 5 | 100.0% | Hard + Long-horizon | Long | Error Recovery | 19.3mavg of 5 | 340.9Kavg of 5 |
| v56-w03-chain-1to05 | 5/5 passed | 5 | 5 | 100.0% | Hard + Long-horizon | Long | Error Recovery | 11.6mavg of 5 | 116.9Kavg of 5 |
| v56-w03-chain-1to06 | 5/5 passed | 5 | 5 | 100.0% | Hard + Long-horizon | Long | Pagination | 13.8mavg of 5 | 221.3Kavg of 5 |
| v56-w03-chain-1to07 | 5/5 passed | 5 | 5 | 100.0% | Hard + Long-horizon | Long | Discovery | 2.8mavg of 5 | 17.8Kavg of 5 |
| v56-w03-chain-1to08 | 5/5 passed | 5 | 5 | 100.0% | Hard + Long-horizon | Long | Error Recovery | 4.1mavg of 5 | 31.9Kavg of 5 |
| v56-w03-chain-1to09 | 5/5 passed | 5 | 5 | 100.0% | Hard + Long-horizon | Long | Authentication | 5.3mavg of 5 | 44.0Kavg of 5 |
| v56-w03-chain-1to10 | 5/5 passed | 5 | 5 | 100.0% | Hard + Long-horizon | Long | Statefulness | 7.4mavg of 5 | 62.8Kavg of 5 |
| v56-w03-chain-1to11 | 5/5 passed | 5 | 5 | 100.0% | Hard + Long-horizon | Long | Error Recovery | 6.3mavg of 5 | 52.1Kavg of 5 |
| v56-w03-chain-1to12 | 5/5 passed | 5 | 5 | 100.0% | Hard + Long-horizon | Long | Authentication | 4.1mavg of 5 | 28.1Kavg of 5 |
| v56-w03-chain-1to13 | 5/5 passed | 5 | 5 | 100.0% | Hard + Long-horizon | Long | Error Recovery | 3.9mavg of 5 | 29.2Kavg of 5 |
| v56-w03-chain-1to14 | 5/5 passed | 5 | 5 | 100.0% | Hard + Long-horizon | Long | Multi-step Workflow | 8.1mavg of 5 | 66.3Kavg of 5 |
| v56-w03-chain-1to15 | 5/5 passed | 5 | 5 | 100.0% | Hard + Long-horizon | Long | Multi-step Workflow | 5.4mavg of 5 | 36.6Kavg of 5 |
| v56-w03-chain-1to16 | 5/5 passed | 5 | 5 | 100.0% | Hard + Long-horizon | Long | Schema | 5.3mavg of 5 | 25.8Kavg of 5 |
| v56-w03-chain-1to17 | 5/5 passed | 5 | 5 | 100.0% | Hard + Long-horizon | Long | Pagination | 29.7mavg of 5 | 919.9Kavg of 5 |
| v56-w03-chain-1to18 | 5/5 passed | 5 | 5 | 100.0% | Hard + Long-horizon | Long | Error Recovery | 7.3mavg of 5 | 61.6Kavg of 5 |
| v56-w03-chain-1to19 | 5/5 passed | 5 | 5 | 100.0% | Hard + Long-horizon | Long | Authentication | 5.6mavg of 5 | 40.7Kavg of 5 |
| v56-w03-chain-1to20 | 5/5 passed | 5 | 5 | 100.0% | Hard + Long-horizon | Long | Multi-step Workflow | 4.6mavg of 5 | 40.1Kavg of 5 |
| v56-w03-sub01 | 5/5 passed | 5 | 5 | 100.0% | Long-horizon | Medium | Error Recovery | 4.1mavg of 5 | 38.3Kavg of 5 |
| v56-w03-sub02 | 5/5 passed | 5 | 5 | 100.0% | Hard | Medium | Multi-step Workflow | 7.9mavg of 5 | 95.7Kavg of 5 |
| v56-w03-sub03 | 5/5 passed | 5 | 5 | 100.0% | Hard | Medium | Error Recovery | 10.7mavg of 5 | 147.0Kavg of 5 |
| v56-w03-sub04 | 5/5 passed | 5 | 5 | 100.0% | Hard | Short | Error Recovery | 4.2mavg of 5 | 44.6Kavg of 5 |
| v56-w03-sub05 | 5/5 passed | 5 | 5 | 100.0% | Hard | Short | Error Recovery | 2.7mavg of 5 | 27.0Kavg of 5 |
| v56-w03-sub06 | 5/5 passed | 5 | 5 | 100.0% | Long-horizon | Medium | Pagination | 6.6mavg of 5 | 68.2Kavg of 5 |
| v56-w03-sub07 | 5/5 passed | 5 | 5 | 100.0% | Easy | Short | Discovery | 2.8mavg of 5 | 19.5Kavg of 5 |
| v56-w03-sub08 | 5/5 passed | 5 | 5 | 100.0% | Easy | Short | Error Recovery | 5.2mavg of 5 | 28.9Kavg of 5 |
| v56-w03-sub09 | 5/5 passed | 5 | 5 | 100.0% | Hard | Medium | Authentication | 4.2mavg of 5 | 32.1Kavg of 5 |
| v56-w03-sub10 | 5/5 passed | 5 | 5 | 100.0% | Hard | Short | Statefulness | 4.4mavg of 5 | 29.1Kavg of 5 |
| v56-w03-sub11 | 5/5 passed | 5 | 5 | 100.0% | Hard | Short | Error Recovery | 5.4mavg of 5 | 43.4Kavg of 5 |
| v56-w03-sub12 | 5/5 passed | 5 | 5 | 100.0% | Hard | Medium | Authentication | 5.5mavg of 5 | 33.6Kavg of 5 |
| v56-w03-sub13 | 5/5 passed | 5 | 5 | 100.0% | Hard | Medium | Error Recovery | 4.5mavg of 5 | 37.3Kavg of 5 |
| v56-w03-sub14 | 5/5 passed | 5 | 5 | 100.0% | Long-horizon | Medium | Multi-step Workflow | 5.2mavg of 5 | 46.0Kavg of 5 |
| v56-w03-sub15 | 5/5 passed | 5 | 5 | 100.0% | Hard | Medium | Multi-step Workflow | 5.8mavg of 5 | 55.8Kavg of 5 |
| v56-w03-sub16 | 5/5 passed | 5 | 5 | 100.0% | Easy | Short | Schema | 3.7mavg of 5 | 24.7Kavg of 5 |
| v56-w03-sub17 | 5/5 passed | 5 | 5 | 100.0% | Hard | Medium | Pagination | 49.6mavg of 5 | 2.3Mavg of 5 |
| v56-w03-sub18 | 5/5 passed | 5 | 5 | 100.0% | Hard | Medium | Error Recovery | 4.8mavg of 5 | 42.9Kavg of 5 |
| v56-w03-sub19 | 5/5 passed | 5 | 5 | 100.0% | Long-horizon | Medium | Authentication | 5.0mavg of 5 | 45.7Kavg of 5 |
| v56-w03-sub20 | 5/5 passed | 5 | 5 | 100.0% | Hard | Medium | Multi-step Workflow | 5.4mavg of 5 | 52.0Kavg of 5 |
| v56-w04-chain-1to02 | 5/5 passed | 5 | 5 | 100.0% | Long-horizon | Long | Pagination | 18.1mavg of 5 | 197.3Kavg of 5 |
| v56-w04-chain-1to03 | 5/5 passed | 5 | 5 | 100.0% | Long-horizon | Long | Discovery | 13.0mavg of 5 | 122.3Kavg of 5 |
| v56-w04-chain-1to04 | 5/5 passed | 5 | 5 | 100.0% | Hard + Long-horizon | Long | Error Recovery | 17.0mavg of 5 | 190.6Kavg of 5 |
| v56-w04-chain-1to05 | 5/5 passed | 5 | 5 | 100.0% | Hard + Long-horizon | Long | Pagination | 16.8mavg of 5 | 181.2Kavg of 5 |
| v56-w04-chain-1to06 | 3/5 passed | 5 | 3 | 60.0% | Hard + Long-horizon | Long | Discovery | 8.0mavg of 5 | 61.1Kavg of 5 |
| v56-w04-chain-1to07 | 5/5 passed | 5 | 5 | 100.0% | Hard + Long-horizon | Long | Multi-step Workflow | 10.6mavg of 5 | 83.3Kavg of 5 |
| v56-w04-chain-1to08 | 5/5 passed | 5 | 5 | 100.0% | Hard + Long-horizon | Long | Schema | 13.5mavg of 5 | 113.7Kavg of 5 |
| v56-w04-chain-1to09 | 5/5 passed | 5 | 5 | 100.0% | Hard + Long-horizon | Long | Authentication | 7.2mavg of 5 | 32.6Kavg of 5 |
| v56-w04-chain-1to10 | 5/5 passed | 5 | 5 | 100.0% | Hard + Long-horizon | Long | Error Recovery | 9.1mavg of 5 | 41.2Kavg of 5 |
| v56-w04-chain-1to11 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Discovery | 8.8mavg of 5 | 46.9Kavg of 5 |
| v56-w04-chain-1to12 | 5/5 passed | 5 | 5 | 100.0% | Hard + Long-horizon | Long | Pagination | 11.8mavg of 5 | 45.3Kavg of 5 |
| v56-w04-chain-1to13 | 5/5 passed | 5 | 5 | 100.0% | Hard + Long-horizon | Long | Pagination | 11.2mavg of 5 | 54.6Kavg of 5 |
| v56-w04-chain-1to14 | 3/5 passed | 5 | 3 | 60.0% | Hard + Long-horizon | Long | Authentication | 8.8mavg of 5 | 90.6Kavg of 5 |
| v56-w04-chain-1to15 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Discovery | 5.7mavg of 5 | 38.1Kavg of 5 |
| v56-w04-chain-1to16 | 5/5 passed | 5 | 5 | 100.0% | Hard + Long-horizon | Long | Authentication | 4.6mavg of 5 | 31.4Kavg of 5 |
| v56-w04-chain-1to17 | 5/5 passed | 5 | 5 | 100.0% | Hard + Long-horizon | Long | Discovery | 6.2mavg of 5 | 55.4Kavg of 5 |
| v56-w04-chain-1to18 | 5/5 passed | 5 | 5 | 100.0% | Hard + Long-horizon | Long | Authentication | 5.0mavg of 5 | 44.6Kavg of 5 |
| v56-w04-chain-1to19 | 5/5 passed | 5 | 5 | 100.0% | Hard + Long-horizon | Long | Authentication | 5.2mavg of 5 | 43.6Kavg of 5 |
| v56-w04-chain-1to20 | 5/5 passed | 5 | 5 | 100.0% | Hard + Long-horizon | Long | Error Recovery | 5.0mavg of 5 | 42.9Kavg of 5 |
| v56-w04-sub01 | 5/5 passed | 5 | 5 | 100.0% | Easy | Short | Authentication | 4.5mavg of 5 | 46.0Kavg of 5 |
| v56-w04-sub02 | 5/5 passed | 5 | 5 | 100.0% | Easy | Short | Pagination | 3.2mavg of 5 | 25.4Kavg of 5 |
| v56-w04-sub03 | 5/5 passed | 5 | 5 | 100.0% | Easy | Short | Discovery | 3.5mavg of 5 | 34.4Kavg of 5 |
| v56-w04-sub04 | 5/5 passed | 5 | 5 | 100.0% | Easy | Short | Error Recovery | 3.1mavg of 5 | 29.2Kavg of 5 |
| v56-w04-sub05 | 5/5 passed | 5 | 5 | 100.0% | Easy | Short | Pagination | 4.1mavg of 5 | 40.4Kavg of 5 |
| v56-w04-sub06 | 5/5 passed | 5 | 5 | 100.0% | Long-horizon | Medium | Discovery | 5.3mavg of 5 | 42.7Kavg of 5 |
| v56-w04-sub07 | 5/5 passed | 5 | 5 | 100.0% | Long-horizon | Medium | Multi-step Workflow | 9.1mavg of 5 | 103.3Kavg of 5 |
| v56-w04-sub08 | 5/5 passed | 5 | 5 | 100.0% | Easy | Short | Schema | 3.7mavg of 5 | 30.9Kavg of 5 |
| v56-w04-sub09 | 5/5 passed | 5 | 5 | 100.0% | Easy | Short | Authentication | 3.2mavg of 5 | 22.2Kavg of 5 |
| v56-w04-sub10 | 5/5 passed | 5 | 5 | 100.0% | Hard | Medium | Error Recovery | 6.0mavg of 5 | 54.7Kavg of 5 |
| v56-w04-sub11 | 5/5 passed | 5 | 5 | 100.0% | Easy | Short | Discovery | 6.1mavg of 5 | 48.6Kavg of 5 |
| v56-w04-sub12 | 5/5 passed | 5 | 5 | 100.0% | Easy | Short | Pagination | 4.0mavg of 5 | 28.6Kavg of 5 |
| v56-w04-sub13 | 5/5 passed | 5 | 5 | 100.0% | Easy | Short | Pagination | 7.4mavg of 5 | 43.0Kavg of 5 |
| v56-w04-sub14 | 5/5 passed | 5 | 5 | 100.0% | Hard | Medium | Authentication | 9.8mavg of 5 | 97.0Kavg of 5 |
| v56-w04-sub15 | 5/5 passed | 5 | 5 | 100.0% | Easy | Short | Discovery | 5.8mavg of 5 | 36.6Kavg of 5 |
| v56-w04-sub16 | 5/5 passed | 5 | 5 | 100.0% | Hard | Short | Authentication | 4.2mavg of 5 | 29.4Kavg of 5 |
| v56-w04-sub17 | 5/5 passed | 5 | 5 | 100.0% | Easy | Short | Discovery | 4.5mavg of 5 | 29.6Kavg of 5 |
| v56-w04-sub18 | 5/5 passed | 5 | 5 | 100.0% | Hard | Short | Authentication | 6.9mavg of 5 | 66.1Kavg of 5 |
| v56-w04-sub19 | 5/5 passed | 5 | 5 | 100.0% | Long-horizon | Medium | Authentication | 3.9mavg of 5 | 25.9Kavg of 5 |
| v56-w04-sub20 | 5/5 passed | 5 | 5 | 100.0% | Hard | Medium | Error Recovery | 5.9mavg of 5 | 40.7Kavg of 5 |
| v56-w05-chain-1to02 | 5/5 passed | 5 | 5 | 100.0% | Hard + Long-horizon | Long | Schema | 8.8mavg of 5 | 61.7Kavg of 5 |
| v56-w05-chain-1to03 | 5/5 passed | 5 | 5 | 100.0% | Hard + Long-horizon | Long | Statefulness | 15.7mavg of 5 | 193.5Kavg of 5 |
| v56-w05-chain-1to04 | 5/5 passed | 5 | 5 | 100.0% | Hard + Long-horizon | Long | Pagination | 10.6mavg of 5 | 72.0Kavg of 5 |
| v56-w05-chain-1to05 | 5/5 passed | 5 | 5 | 100.0% | Hard + Long-horizon | Long | Authentication | 12.5mavg of 5 | 126.7Kavg of 5 |
| v56-w05-chain-1to06 | 3/5 passed | 5 | 3 | 60.0% | Hard + Long-horizon | Long | Authentication | 65.0mavg of 5 | 3.0Mavg of 5 |
| v56-w05-chain-1to07 | 5/5 passed | 5 | 5 | 100.0% | Hard + Long-horizon | Long | Schema | 5.3mavg of 5 | 32.9Kavg of 5 |
| v56-w05-chain-1to08 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Statefulness | 28.6mavg of 5 | 620.7Kavg of 5 |
| v56-w05-chain-1to09 | 5/5 passed | 5 | 5 | 100.0% | Hard + Long-horizon | Long | Pagination | 36.4mavg of 5 | 745.5Kavg of 5 |
| v56-w05-chain-1to10 | 5/5 passed | 5 | 5 | 100.0% | Hard + Long-horizon | Long | Statefulness | 6.6mavg of 5 | 47.6Kavg of 5 |
| v56-w05-chain-1to11 | 5/5 passed | 5 | 5 | 100.0% | Hard + Long-horizon | Long | Schema | 5.5mavg of 5 | 39.4Kavg of 5 |
| v56-w05-chain-1to12 | 1/5 passed | 5 | 1 | 20.0% | Hard + Long-horizon | Long | Schema | 60.6mavg of 5 | 2.2Mavg of 5 |
| v56-w05-chain-1to13 | 2/5 passed | 5 | 2 | 40.0% | Hard + Long-horizon | Long | Discovery | 6.2mavg of 5 | 44.1Kavg of 5 |
| v56-w05-chain-1to14 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Pagination | 56.3mavg of 5 | 1.9Mavg of 5 |
| v56-w05-chain-1to15 | 5/5 passed | 5 | 5 | 100.0% | Hard + Long-horizon | Long | Schema | 4.5mavg of 5 | 35.5Kavg of 5 |
| v56-w05-chain-1to16 | 1/5 passed | 5 | 1 | 20.0% | Hard + Long-horizon | Long | Discovery | 6.6mavg of 5 | 60.4Kavg of 5 |
| v56-w05-chain-1to17 | 5/5 passed | 5 | 5 | 100.0% | Hard + Long-horizon | Long | Pagination | 4.0mavg of 5 | 31.4Kavg of 5 |
| v56-w05-chain-1to18 | 5/5 passed | 5 | 5 | 100.0% | Hard + Long-horizon | Long | Discovery | 6.6mavg of 5 | 51.8Kavg of 5 |
| v56-w05-chain-1to19 | 5/5 passed | 5 | 5 | 100.0% | Hard + Long-horizon | Long | Authentication | 3.9mavg of 5 | 25.4Kavg of 5 |
| v56-w05-chain-1to20 | 1/5 passed | 5 | 1 | 20.0% | Hard + Long-horizon | Long | Error Recovery | 39.6mavg of 5 | 909.7Kavg of 5 |
| v56-w05-sub01 | 4/5 passed | 5 | 4 | 80.0% | Hard | Medium | Statefulness | 14.4mavg of 5 | 145.0Kavg of 5 |
| v56-w05-sub02 | 5/5 passed | 5 | 5 | 100.0% | Hard | Short | Schema | 5.9mavg of 5 | 38.2Kavg of 5 |
| v56-w05-sub03 | 5/5 passed | 5 | 5 | 100.0% | Easy | Short | Statefulness | 4.6mavg of 5 | 28.0Kavg of 5 |
| v56-w05-sub04 | 5/5 passed | 5 | 5 | 100.0% | Easy | Short | Pagination | 12.3mavg of 5 | 99.1Kavg of 5 |
| v56-w05-sub05 | 5/5 passed | 5 | 5 | 100.0% | Hard | Short | Authentication | 4.1mavg of 5 | 25.8Kavg of 5 |
| v56-w05-sub06 | 5/5 passed | 5 | 5 | 100.0% | Hard | Medium | Authentication | 51.8mavg of 5 | 1.6Mavg of 5 |
| v56-w05-sub07 | 5/5 passed | 5 | 5 | 100.0% | Easy | Short | Schema | 5.1mavg of 5 | 25.2Kavg of 5 |
| v56-w05-sub08 | 5/5 passed | 5 | 5 | 100.0% | Hard | Medium | Statefulness | 27.0mavg of 5 | 402.6Kavg of 5 |
| v56-w05-sub09 | 5/5 passed | 5 | 5 | 100.0% | Easy | Short | Pagination | 6.0mavg of 5 | 29.1Kavg of 5 |
| v56-w05-sub10 | 5/5 passed | 5 | 5 | 100.0% | Easy | Short | Statefulness | 4.4mavg of 5 | 20.7Kavg of 5 |
| v56-w05-sub11 | 5/5 passed | 5 | 5 | 100.0% | Hard | Short | Schema | 5.9mavg of 5 | 29.2Kavg of 5 |
| v56-w05-sub12 | 5/5 passed | 5 | 5 | 100.0% | Hard | Short | Schema | 10.3mavg of 5 | 71.3Kavg of 5 |
| v56-w05-sub13 | 5/5 passed | 5 | 5 | 100.0% | Easy | Short | Discovery | 5.9mavg of 5 | 30.9Kavg of 5 |
| v56-w05-sub14 | 5/5 passed | 5 | 5 | 100.0% | Long-horizon | Medium | Pagination | 18.1mavg of 5 | 94.9Kavg of 5 |
| v56-w05-sub15 | 5/5 passed | 5 | 5 | 100.0% | Easy | Short | Schema | 5.1mavg of 5 | 24.5Kavg of 5 |
| v56-w05-sub16 | 5/5 passed | 5 | 5 | 100.0% | Easy | Short | Discovery | 10.8mavg of 5 | 68.9Kavg of 5 |
| v56-w05-sub17 | 5/5 passed | 5 | 5 | 100.0% | Easy | Short | Pagination | 5.1mavg of 5 | 25.2Kavg of 5 |
| v56-w05-sub18 | 5/5 passed | 5 | 5 | 100.0% | Easy | Short | Discovery | 5.4mavg of 5 | 27.2Kavg of 5 |
| v56-w05-sub19 | 5/5 passed | 5 | 5 | 100.0% | Easy | Short | Authentication | 6.0mavg of 5 | 34.7Kavg of 5 |
| v56-w05-sub20 | 5/5 passed | 5 | 5 | 100.0% | Hard | Short | Error Recovery | 8.8mavg of 5 | 56.2Kavg of 5 |
| v56-w06-chain-1to02 | 5/5 passed | 5 | 5 | 100.0% | Hard + Long-horizon | Long | Multi-step Workflow | 10.8mavg of 5 | 71.5Kavg of 5 |
| v56-w06-chain-1to03 | 5/5 passed | 5 | 5 | 100.0% | Hard + Long-horizon | Long | Authentication | 18.0mavg of 5 | 203.5Kavg of 5 |
| v56-w06-chain-1to04 | 5/5 passed | 5 | 5 | 100.0% | Hard + Long-horizon | Long | Statefulness | 10.7mavg of 5 | 74.5Kavg of 5 |
| v56-w06-chain-1to05 | 5/5 passed | 5 | 5 | 100.0% | Hard + Long-horizon | Long | Statefulness | 12.8mavg of 5 | 116.4Kavg of 5 |
| v56-w06-sub01 | 5/5 passed | 5 | 5 | 100.0% | Hard | Medium | Error Recovery | 10.2mavg of 5 | 71.2Kavg of 5 |
| v56-w06-sub02 | 5/5 passed | 5 | 5 | 100.0% | Hard | Short | Multi-step Workflow | 5.6mavg of 5 | 35.2Kavg of 5 |
| v56-w06-sub03 | 5/5 passed | 5 | 5 | 100.0% | Long-horizon | Medium | Authentication | 3.9mavg of 5 | 25.1Kavg of 5 |
| v56-w06-sub04 | 5/5 passed | 5 | 5 | 100.0% | Hard | Short | Statefulness | 5.8mavg of 5 | 41.0Kavg of 5 |
| v56-w06-sub05 | 5/5 passed | 5 | 5 | 100.0% | Hard | Short | Statefulness | 4.5mavg of 5 | 32.0Kavg of 5 |
| v56-w06-sub06 | 0/5 passed | 5 | 0 | 0.0% | — | — | Pagination | 24.7mavg of 5 | 8.9Mavg of 5 |
| v56-w08-chain-1to02 | 5/5 passed | 5 | 5 | 100.0% | Long-horizon | Long | Error Recovery | 3.6mavg of 5 | 31.0Kavg of 5 |
| v56-w08-chain-1to03 | 0/5 passed | 5 | 0 | 0.0% | Long-horizon | Long | Pagination | 4.1mavg of 5 | 35.8Kavg of 5 |
| v56-w08-chain-1to04 | 5/5 passed | 5 | 5 | 100.0% | Long-horizon | Long | Authentication | 5.2mavg of 5 | 43.2Kavg of 5 |
| v56-w08-chain-1to05 | 5/5 passed | 5 | 5 | 100.0% | Long-horizon | Long | Error Recovery | 4.6mavg of 5 | 32.4Kavg of 5 |
| v56-w08-chain-1to06 | 5/5 passed | 5 | 5 | 100.0% | Long-horizon | Long | Multi-step Workflow | 4.3mavg of 5 | 38.5Kavg of 5 |
| v56-w08-chain-1to07 | 5/5 passed | 5 | 5 | 100.0% | Hard + Long-horizon | Long | Error Recovery | 4.2mavg of 5 | 35.0Kavg of 5 |
| v56-w08-chain-1to08 | 5/5 passed | 5 | 5 | 100.0% | Hard + Long-horizon | Long | Schema | 5.8mavg of 5 | 52.6Kavg of 5 |
| v56-w08-chain-1to09 | 5/5 passed | 5 | 5 | 100.0% | Hard + Long-horizon | Long | Multi-step Workflow | 4.4mavg of 5 | 39.3Kavg of 5 |
| v56-w08-chain-1to10 | 5/5 passed | 5 | 5 | 100.0% | Hard + Long-horizon | Long | Discovery | 8.2mavg of 5 | 96.0Kavg of 5 |
| v56-w08-chain-1to11 | 5/5 passed | 5 | 5 | 100.0% | Hard + Long-horizon | Long | Multi-step Workflow | 4.0mavg of 5 | 29.1Kavg of 5 |
| v56-w08-chain-1to12 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Schema | 19.8mavg of 5 | 427.8Kavg of 5 |
| v56-w08-chain-1to13 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Discovery | 4.4mavg of 5 | 34.4Kavg of 5 |
| v56-w08-chain-1to14 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Discovery | 4.1mavg of 5 | 30.1Kavg of 5 |
| v56-w08-chain-1to15 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Discovery | 5.6mavg of 5 | 34.5Kavg of 5 |
| v56-w08-chain-1to16 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Error Recovery | 4.6mavg of 5 | 34.5Kavg of 5 |
| v56-w08-chain-1to17 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Pagination | 5.4mavg of 5 | 40.0Kavg of 5 |
| v56-w08-chain-1to18 | 1/5 passed | 5 | 1 | 20.0% | Hard + Long-horizon | Long | Schema | 7.5mavg of 5 | 82.5Kavg of 5 |
| v56-w08-chain-1to19 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Discovery | 4.9mavg of 5 | 37.3Kavg of 5 |
| v56-w08-chain-1to20 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Authentication | 4.4mavg of 5 | 34.8Kavg of 5 |
| v56-w08-sub01 | 5/5 passed | 5 | 5 | 100.0% | Easy | Short | Discovery | 5.1mavg of 5 | 41.9Kavg of 5 |
| v56-w08-sub02 | 5/5 passed | 5 | 5 | 100.0% | Easy | Medium | Error Recovery | 4.7mavg of 5 | 36.2Kavg of 5 |
| v56-w08-sub03 | 5/5 passed | 5 | 5 | 100.0% | Easy | Short | Pagination | 3.8mavg of 5 | 28.2Kavg of 5 |
| v56-w08-sub04 | 5/5 passed | 5 | 5 | 100.0% | Easy | Short | Authentication | 4.2mavg of 5 | 30.3Kavg of 5 |
| v56-w08-sub05 | 5/5 passed | 5 | 5 | 100.0% | Easy | Short | Error Recovery | 2.6mavg of 5 | 18.6Kavg of 5 |
| v56-w08-sub06 | 5/5 passed | 5 | 5 | 100.0% | Easy | Short | Multi-step Workflow | 3.5mavg of 5 | 24.3Kavg of 5 |
| v56-w08-sub07 | 5/5 passed | 5 | 5 | 100.0% | Hard | Short | Error Recovery | 4.0mavg of 5 | 25.3Kavg of 5 |
| v56-w08-sub08 | 5/5 passed | 5 | 5 | 100.0% | Hard | Short | Schema | 3.4mavg of 5 | 21.6Kavg of 5 |
| v56-w08-sub09 | 5/5 passed | 5 | 5 | 100.0% | Long-horizon | Medium | Multi-step Workflow | 3.1mavg of 5 | 21.9Kavg of 5 |
| v56-w08-sub10 | 5/5 passed | 5 | 5 | 100.0% | Hard | Short | Discovery | 5.6mavg of 5 | 47.7Kavg of 5 |
| v56-w08-sub11 | 5/5 passed | 5 | 5 | 100.0% | Hard | Short | Multi-step Workflow | 3.8mavg of 5 | 21.2Kavg of 5 |
| v56-w08-sub12 | 5/5 passed | 5 | 5 | 100.0% | Hard | Short | Schema | 4.3mavg of 5 | 30.8Kavg of 5 |
| v56-w08-sub13 | 5/5 passed | 5 | 5 | 100.0% | Easy | Short | Discovery | 4.0mavg of 5 | 32.9Kavg of 5 |
| v56-w08-sub14 | 5/5 passed | 5 | 5 | 100.0% | Hard | Short | Discovery | 3.0mavg of 5 | 20.2Kavg of 5 |
| v56-w08-sub15 | 5/5 passed | 5 | 5 | 100.0% | Easy | Short | Discovery | 5.1mavg of 5 | 42.9Kavg of 5 |
| v56-w08-sub16 | 5/5 passed | 5 | 5 | 100.0% | Hard | Medium | Error Recovery | 3.2mavg of 5 | 27.5Kavg of 5 |
| v56-w08-sub17 | 5/5 passed | 5 | 5 | 100.0% | Hard | Short | Pagination | 3.5mavg of 5 | 28.3Kavg of 5 |
| v56-w08-sub18 | 5/5 passed | 5 | 5 | 100.0% | Hard | Short | Schema | 4.2mavg of 5 | 33.0Kavg of 5 |
| v56-w08-sub19 | 5/5 passed | 5 | 5 | 100.0% | Easy | Short | Discovery | 3.8mavg of 5 | 31.4Kavg of 5 |
| v56-w08-sub20 | 5/5 passed | 5 | 5 | 100.0% | Easy | Short | Authentication | 3.4mavg of 5 | 29.6Kavg of 5 |
| v56-w10-chain-1to02 | 5/5 passed | 5 | 5 | 100.0% | Hard + Long-horizon | Long | Pagination | 4.7mavg of 5 | 40.8Kavg of 5 |
| v56-w10-chain-1to03 | 5/5 passed | 5 | 5 | 100.0% | Hard + Long-horizon | Long | Pagination | 7.4mavg of 5 | 72.7Kavg of 5 |
| v56-w10-chain-1to04 | 5/5 passed | 5 | 5 | 100.0% | Hard + Long-horizon | Long | Statefulness | 3.7mavg of 5 | 31.9Kavg of 5 |
| v56-w10-chain-1to05 | 5/5 passed | 5 | 5 | 100.0% | Hard + Long-horizon | Long | Multi-step Workflow | 7.0mavg of 5 | 54.2Kavg of 5 |
| v56-w10-chain-1to06 | 5/5 passed | 5 | 5 | 100.0% | Hard + Long-horizon | Long | Multi-step Workflow | 3.7mavg of 5 | 31.4Kavg of 5 |
| v56-w10-chain-1to07 | 5/5 passed | 5 | 5 | 100.0% | Hard + Long-horizon | Long | Multi-step Workflow | 6.4mavg of 5 | 53.0Kavg of 5 |
| v56-w10-chain-1to08 | 5/5 passed | 5 | 5 | 100.0% | Hard + Long-horizon | Long | Error Recovery | 7.9mavg of 5 | 76.2Kavg of 5 |
| v56-w10-chain-1to09 | 5/5 passed | 5 | 5 | 100.0% | Hard + Long-horizon | Long | Schema | 9.8mavg of 5 | 91.7Kavg of 5 |
| v56-w10-chain-1to10 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Error Recovery | 6.2mavg of 5 | 56.1Kavg of 5 |
| v56-w10-chain-1to11 | 5/5 passed | 5 | 5 | 100.0% | Hard + Long-horizon | Long | Statefulness | 9.3mavg of 5 | 80.4Kavg of 5 |
| v56-w10-chain-1to12 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Error Recovery | 5.5mavg of 5 | 43.0Kavg of 5 |
| v56-w10-chain-1to13 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Authentication | 4.8mavg of 5 | 34.8Kavg of 5 |
| v56-w10-chain-1to14 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Statefulness | 4.9mavg of 5 | 33.8Kavg of 5 |
| v56-w10-chain-1to15 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Multi-step Workflow | 5.7mavg of 5 | 41.7Kavg of 5 |
| v56-w10-chain-1to16 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Statefulness | 6.0mavg of 5 | 40.1Kavg of 5 |
| v56-w10-chain-1to17 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Schema | 6.6mavg of 5 | 45.9Kavg of 5 |
| v56-w10-chain-1to18 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Error Recovery | 5.3mavg of 5 | 37.2Kavg of 5 |
| v56-w10-chain-1to19 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Authentication | 4.9mavg of 5 | 32.8Kavg of 5 |
| v56-w10-chain-1to20 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Authentication | 3.9mavg of 5 | 24.1Kavg of 5 |
| v56-w10-sub01 | 5/5 passed | 5 | 5 | 100.0% | Long-horizon | Long | Multi-step Workflow | 10.5mavg of 5 | 74.4Kavg of 5 |
| v56-w10-sub02 | 5/5 passed | 5 | 5 | 100.0% | Long-horizon | Medium | Pagination | 8.1mavg of 5 | 25.9Kavg of 5 |
| v56-w10-sub03 | 5/5 passed | 5 | 5 | 100.0% | Easy | Short | Pagination | 5.5mavg of 5 | 28.3Kavg of 5 |
| v56-w10-sub04 | 5/5 passed | 5 | 5 | 100.0% | Long-horizon | Medium | Statefulness | 4.1mavg of 5 | 20.2Kavg of 5 |
| v56-w10-sub05 | 5/5 passed | 5 | 5 | 100.0% | Hard | Medium | Multi-step Workflow | 16.8mavg of 5 | 186.4Kavg of 5 |
| v56-w10-sub06 | 5/5 passed | 5 | 5 | 100.0% | Easy | Short | Multi-step Workflow | 6.0mavg of 5 | 27.0Kavg of 5 |
| v56-w10-sub07 | 5/5 passed | 5 | 5 | 100.0% | Hard | Medium | Multi-step Workflow | 6.4mavg of 5 | 45.6Kavg of 5 |
| v56-w10-sub08 | 5/5 passed | 5 | 5 | 100.0% | Hard | Medium | Error Recovery | 6.9mavg of 5 | 50.0Kavg of 5 |
| v56-w10-sub09 | 5/5 passed | 5 | 5 | 100.0% | Hard | Medium | Schema | 9.3mavg of 5 | 77.8Kavg of 5 |
| v56-w10-sub10 | 5/5 passed | 5 | 5 | 100.0% | Easy | Short | Error Recovery | 3.6mavg of 5 | 20.0Kavg of 5 |
| v56-w10-sub11 | 5/5 passed | 5 | 5 | 100.0% | Easy | Short | Statefulness | 6.0mavg of 5 | 27.5Kavg of 5 |
| v56-w10-sub12 | 5/5 passed | 5 | 5 | 100.0% | Easy | Short | Error Recovery | 7.1mavg of 5 | 23.2Kavg of 5 |
| v56-w10-sub13 | 5/5 passed | 5 | 5 | 100.0% | Easy | Short | Authentication | 6.6mavg of 5 | 37.1Kavg of 5 |
| v56-w10-sub14 | 5/5 passed | 5 | 5 | 100.0% | Long-horizon | Medium | Statefulness | 7.9mavg of 5 | 27.7Kavg of 5 |
| v56-w10-sub15 | 5/5 passed | 5 | 5 | 100.0% | Long-horizon | Medium | Multi-step Workflow | 6.1mavg of 5 | 31.7Kavg of 5 |
| v56-w10-sub16 | 5/5 passed | 5 | 5 | 100.0% | Easy | Short | Statefulness | 4.5mavg of 5 | 23.6Kavg of 5 |
| v56-w10-sub17 | 4/5 passed | 5 | 4 | 80.0% | Easy | Short | Schema | 8.3mavg of 5 | 54.2Kavg of 5 |
| v56-w10-sub18 | 5/5 passed | 5 | 5 | 100.0% | Easy | Short | Error Recovery | 4.8mavg of 5 | 22.4Kavg of 5 |
| v56-w10-sub19 | 5/5 passed | 5 | 5 | 100.0% | Long-horizon | Medium | Authentication | 8.0mavg of 5 | 55.1Kavg of 5 |
| v56-w10-sub20 | 5/5 passed | 5 | 5 | 100.0% | Easy | Short | Authentication | 6.6mavg of 5 | 38.3Kavg of 5 |
| v56-w11-chain-1to02 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Discovery | 7.1mavg of 5 | 38.1Kavg of 5 |
| v56-w11-chain-1to03 | 5/5 passed | 5 | 5 | 100.0% | Hard + Long-horizon | Long | Schema | 7.4mavg of 5 | 39.9Kavg of 5 |
| v56-w11-chain-1to04 | 5/5 passed | 5 | 5 | 100.0% | Hard + Long-horizon | Long | Multi-step Workflow | 8.5mavg of 5 | 38.4Kavg of 5 |
| v56-w11-chain-1to05 | 5/5 passed | 5 | 5 | 100.0% | Hard + Long-horizon | Long | Discovery | 8.7mavg of 5 | 73.6Kavg of 5 |
| v56-w11-chain-1to06 | 5/5 passed | 5 | 5 | 100.0% | Hard + Long-horizon | Long | Multi-step Workflow | 22.1mavg of 5 | 385.4Kavg of 5 |
| v56-w11-chain-1to07 | 4/5 passed | 5 | 4 | 80.0% | Hard + Long-horizon | Long | Multi-step Workflow | 6.8mavg of 5 | 48.2Kavg of 5 |
| v56-w11-chain-1to08 | 5/5 passed | 5 | 5 | 100.0% | Hard + Long-horizon | Long | Statefulness | 11.6mavg of 5 | 138.1Kavg of 5 |
| v56-w11-chain-1to09 | 5/5 passed | 5 | 5 | 100.0% | Hard + Long-horizon | Long | Pagination | 5.2mavg of 5 | 34.7Kavg of 5 |
| v56-w11-chain-1to10 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Discovery | 9.0mavg of 5 | 83.0Kavg of 5 |
| v56-w11-chain-1to11 | 5/5 passed | 5 | 5 | 100.0% | Hard + Long-horizon | Long | Error Recovery | 5.4mavg of 5 | 37.1Kavg of 5 |
| v56-w11-chain-1to12 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Discovery | 6.9mavg of 5 | 60.9Kavg of 5 |
| v56-w11-chain-1to13 | 5/5 passed | 5 | 5 | 100.0% | Hard + Long-horizon | Long | Error Recovery | 4.7mavg of 5 | 31.9Kavg of 5 |
| v56-w11-chain-1to14 | 5/5 passed | 5 | 5 | 100.0% | Hard + Long-horizon | Long | Multi-step Workflow | 6.1mavg of 5 | 40.5Kavg of 5 |
| v56-w11-chain-1to15 | 5/5 passed | 5 | 5 | 100.0% | Hard + Long-horizon | Long | Statefulness | 5.5mavg of 5 | 36.7Kavg of 5 |
| v56-w11-chain-1to16 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Discovery | 6.5mavg of 5 | 51.2Kavg of 5 |
| v56-w11-chain-1to17 | 5/5 passed | 5 | 5 | 100.0% | Hard + Long-horizon | Long | Discovery | 12.3mavg of 5 | 133.4Kavg of 5 |
| v56-w11-chain-1to18 | 5/5 passed | 5 | 5 | 100.0% | Hard + Long-horizon | Long | Error Recovery | 7.0mavg of 5 | 55.1Kavg of 5 |
| v56-w11-chain-1to19 | 5/5 passed | 5 | 5 | 100.0% | Hard + Long-horizon | Long | Multi-step Workflow | 5.5mavg of 5 | 42.5Kavg of 5 |
| v56-w11-chain-1to20 | 5/5 passed | 5 | 5 | 100.0% | Hard + Long-horizon | Long | Multi-step Workflow | 9.7mavg of 5 | 89.6Kavg of 5 |
| v56-w11-sub01 | 5/5 passed | 5 | 5 | 100.0% | Hard | Medium | Pagination | 14.3mavg of 5 | 192.1Kavg of 5 |
| v56-w11-sub02 | 5/5 passed | 5 | 5 | 100.0% | Long-horizon | Medium | Discovery | 7.7mavg of 5 | 63.1Kavg of 5 |
| v56-w11-sub03 | 5/5 passed | 5 | 5 | 100.0% | Hard | Medium | Schema | 5.3mavg of 5 | 41.0Kavg of 5 |
| v56-w11-sub04 | 5/5 passed | 5 | 5 | 100.0% | Long-horizon | Medium | Multi-step Workflow | 4.7mavg of 5 | 31.3Kavg of 5 |
| v56-w11-sub05 | 5/5 passed | 5 | 5 | 100.0% | Long-horizon | Medium | Discovery | 6.0mavg of 5 | 40.6Kavg of 5 |
| v56-w11-sub06 | 5/5 passed | 5 | 5 | 100.0% | Long-horizon | Medium | Multi-step Workflow | 11.6mavg of 5 | 128.4Kavg of 5 |
| v56-w11-sub07 | 5/5 passed | 5 | 5 | 100.0% | Long-horizon | Medium | Multi-step Workflow | 5.4mavg of 5 | 33.1Kavg of 5 |
| v56-w11-sub08 | 5/5 passed | 5 | 5 | 100.0% | Long-horizon | Long | Statefulness | 10.9mavg of 5 | 118.7Kavg of 5 |
| v56-w11-sub09 | 5/5 passed | 5 | 5 | 100.0% | Long-horizon | Medium | Pagination | 4.9mavg of 5 | 27.5Kavg of 5 |
| v56-w11-sub10 | 5/5 passed | 5 | 5 | 100.0% | Long-horizon | Medium | Discovery | 6.1mavg of 5 | 36.7Kavg of 5 |
| v56-w11-sub11 | 5/5 passed | 5 | 5 | 100.0% | Long-horizon | Medium | Error Recovery | 6.3mavg of 5 | 44.8Kavg of 5 |
| v56-w11-sub12 | 5/5 passed | 5 | 5 | 100.0% | Easy | Short | Discovery | 4.7mavg of 5 | 28.2Kavg of 5 |
| v56-w11-sub13 | 5/5 passed | 5 | 5 | 100.0% | Easy | Short | Error Recovery | 3.9mavg of 5 | 21.9Kavg of 5 |
| v56-w11-sub14 | 5/5 passed | 5 | 5 | 100.0% | Long-horizon | Medium | Multi-step Workflow | 5.0mavg of 5 | 32.1Kavg of 5 |
| v56-w11-sub15 | 5/5 passed | 5 | 5 | 100.0% | Long-horizon | Medium | Statefulness | 5.1mavg of 5 | 31.3Kavg of 5 |
| v56-w11-sub16 | 5/5 passed | 5 | 5 | 100.0% | Long-horizon | Medium | Discovery | 6.3mavg of 5 | 43.8Kavg of 5 |
| v56-w11-sub17 | 5/5 passed | 5 | 5 | 100.0% | Long-horizon | Medium | Discovery | 7.9mavg of 5 | 83.7Kavg of 5 |
| v56-w11-sub18 | 5/5 passed | 5 | 5 | 100.0% | Long-horizon | Medium | Error Recovery | 5.1mavg of 5 | 33.9Kavg of 5 |
| v56-w11-sub19 | 5/5 passed | 5 | 5 | 100.0% | Hard | Short | Multi-step Workflow | 5.7mavg of 5 | 43.2Kavg of 5 |
| v56-w11-sub20 | 5/5 passed | 5 | 5 | 100.0% | Hard | Medium | Multi-step Workflow | 5.7mavg of 5 | 45.6Kavg of 5 |
| v56-w13-chain-1to02 | 5/5 passed | 5 | 5 | 100.0% | Hard + Long-horizon | Long | Error Recovery | 5.9mavg of 5 | 49.6Kavg of 5 |
| v56-w13-chain-1to03 | 5/5 passed | 5 | 5 | 100.0% | Hard + Long-horizon | Long | Pagination | 7.8mavg of 5 | 78.6Kavg of 5 |
| v56-w13-chain-1to04 | 5/5 passed | 5 | 5 | 100.0% | Hard + Long-horizon | Long | Pagination | 5.7mavg of 5 | 49.2Kavg of 5 |
| v56-w13-chain-1to05 | 5/5 passed | 5 | 5 | 100.0% | Hard + Long-horizon | Long | Error Recovery | 5.1mavg of 5 | 39.5Kavg of 5 |
| v56-w13-chain-1to06 | 5/5 passed | 5 | 5 | 100.0% | Hard + Long-horizon | Long | Schema | 3.9mavg of 5 | 26.2Kavg of 5 |
| v56-w13-chain-1to07 | 5/5 passed | 5 | 5 | 100.0% | Hard + Long-horizon | Long | Authentication | 4.4mavg of 5 | 32.0Kavg of 5 |
| v56-w13-chain-1to08 | 5/5 passed | 5 | 5 | 100.0% | Hard + Long-horizon | Long | Multi-step Workflow | 6.0mavg of 5 | 59.2Kavg of 5 |
| v56-w13-chain-1to09 | 5/5 passed | 5 | 5 | 100.0% | Hard + Long-horizon | Long | Statefulness | 6.7mavg of 5 | 61.4Kavg of 5 |
| v56-w13-chain-1to10 | 5/5 passed | 5 | 5 | 100.0% | Hard + Long-horizon | Long | Schema | 5.3mavg of 5 | 48.2Kavg of 5 |
| v56-w13-chain-1to11 | 5/5 passed | 5 | 5 | 100.0% | Hard + Long-horizon | Long | Discovery | 8.2mavg of 5 | 94.6Kavg of 5 |
| v56-w13-chain-1to12 | 5/5 passed | 5 | 5 | 100.0% | Hard + Long-horizon | Long | Multi-step Workflow | 5.8mavg of 5 | 57.1Kavg of 5 |
| v56-w13-chain-1to13 | 5/5 passed | 5 | 5 | 100.0% | Hard + Long-horizon | Long | Authentication | 4.0mavg of 5 | 34.2Kavg of 5 |
| v56-w13-chain-1to14 | 5/5 passed | 5 | 5 | 100.0% | Hard + Long-horizon | Long | Pagination | 10.4mavg of 5 | 142.0Kavg of 5 |
| v56-w13-chain-1to15 | 5/5 passed | 5 | 5 | 100.0% | Hard + Long-horizon | Long | Authentication | 9.0mavg of 5 | 98.6Kavg of 5 |
| v56-w13-chain-1to16 | 5/5 passed | 5 | 5 | 100.0% | Hard + Long-horizon | Long | Schema | 7.6mavg of 5 | 81.4Kavg of 5 |
| v56-w13-chain-1to17 | 5/5 passed | 5 | 5 | 100.0% | Hard + Long-horizon | Long | Discovery | 4.3mavg of 5 | 31.3Kavg of 5 |
| v56-w13-chain-1to18 | 5/5 passed | 5 | 5 | 100.0% | Hard + Long-horizon | Long | Statefulness | 5.3mavg of 5 | 46.0Kavg of 5 |
| v56-w13-chain-1to19 | 4/5 passed | 5 | 4 | 80.0% | Hard + Long-horizon | Long | Schema | 10.7mavg of 5 | 115.2Kavg of 5 |
| v56-w13-chain-1to20 | 5/5 passed | 5 | 5 | 100.0% | Hard + Long-horizon | Long | Multi-step Workflow | 10.3mavg of 5 | 106.7Kavg of 5 |
| v56-w13-sub01 | 5/5 passed | 5 | 5 | 100.0% | Hard | Medium | Authentication | 5.8mavg of 5 | 38.2Kavg of 5 |
| v56-w13-sub02 | 5/5 passed | 5 | 5 | 100.0% | Hard | Short | Error Recovery | 4.1mavg of 5 | 30.0Kavg of 5 |
| v56-w13-sub03 | 5/5 passed | 5 | 5 | 100.0% | Easy | Short | Pagination | 4.0mavg of 5 | 25.6Kavg of 5 |
| v56-w13-sub04 | 5/5 passed | 5 | 5 | 100.0% | Easy | Short | Pagination | 6.2mavg of 5 | 31.6Kavg of 5 |
| v56-w13-sub05 | 5/5 passed | 5 | 5 | 100.0% | Long-horizon | Medium | Error Recovery | 4.8mavg of 5 | 30.1Kavg of 5 |
| v56-w13-sub06 | 5/5 passed | 5 | 5 | 100.0% | Hard | Short | Schema | 4.2mavg of 5 | 27.3Kavg of 5 |
| v56-w13-sub07 | 5/5 passed | 5 | 5 | 100.0% | Easy | Short | Authentication | 5.2mavg of 5 | 33.5Kavg of 5 |
| v56-w13-sub08 | 5/5 passed | 5 | 5 | 100.0% | Long-horizon | Medium | Multi-step Workflow | 5.0mavg of 5 | 33.9Kavg of 5 |
| v56-w13-sub09 | 5/5 passed | 5 | 5 | 100.0% | Hard | Short | Statefulness | 10.5mavg of 5 | 142.1Kavg of 5 |
| v56-w13-sub10 | 5/5 passed | 5 | 5 | 100.0% | Easy | Short | Schema | 5.3mavg of 5 | 32.3Kavg of 5 |
| v56-w13-sub11 | 5/5 passed | 5 | 5 | 100.0% | Easy | Short | Discovery | 7.3mavg of 5 | 88.6Kavg of 5 |
| v56-w13-sub12 | 5/5 passed | 5 | 5 | 100.0% | Long-horizon | Medium | Multi-step Workflow | 5.1mavg of 5 | 38.0Kavg of 5 |
| v56-w13-sub13 | 5/5 passed | 5 | 5 | 100.0% | Easy | Short | Authentication | 5.2mavg of 5 | 37.1Kavg of 5 |
| v56-w13-sub14 | 5/5 passed | 5 | 5 | 100.0% | Easy | Short | Pagination | 5.9mavg of 5 | 67.4Kavg of 5 |
| v56-w13-sub15 | 5/5 passed | 5 | 5 | 100.0% | Easy | Short | Authentication | 4.1mavg of 5 | 31.3Kavg of 5 |
| v56-w13-sub16 | 4/5 passed | 5 | 4 | 80.0% | Easy | Short | Schema | 4.1mavg of 5 | 31.6Kavg of 5 |
| v56-w13-sub17 | 5/5 passed | 5 | 5 | 100.0% | Easy | Short | Discovery | 3.7mavg of 5 | 26.3Kavg of 5 |
| v56-w13-sub18 | 5/5 passed | 5 | 5 | 100.0% | Long-horizon | Medium | Statefulness | 4.5mavg of 5 | 54.1Kavg of 5 |
| v56-w13-sub19 | 5/5 passed | 5 | 5 | 100.0% | Hard | Short | Schema | 3.8mavg of 5 | 40.7Kavg of 5 |
| v56-w13-sub20 | 5/5 passed | 5 | 5 | 100.0% | Hard | Medium | Multi-step Workflow | 4.8mavg of 5 | 122.4Kavg of 5 |
| v56-w14-chain-1to02 | 5/5 passed | 5 | 5 | 100.0% | Hard | Long | Statefulness | 3.9mavg of 5 | 36.6Kavg of 5 |
| v56-w14-chain-1to03 | 5/5 passed | 5 | 5 | 100.0% | Hard + Long-horizon | Long | Authentication | 5.3mavg of 5 | 55.4Kavg of 5 |
| v56-w14-chain-1to04 | 5/5 passed | 5 | 5 | 100.0% | Hard + Long-horizon | Long | Schema | 3.3mavg of 5 | 28.0Kavg of 5 |
| v56-w14-chain-1to05 | 5/5 passed | 5 | 5 | 100.0% | Hard + Long-horizon | Long | Error Recovery | 3.9mavg of 5 | 34.3Kavg of 5 |
| v56-w14-chain-1to06 | 5/5 passed | 5 | 5 | 100.0% | Hard + Long-horizon | Long | Discovery | 4.5mavg of 5 | 39.3Kavg of 5 |
| v56-w14-chain-1to07 | 5/5 passed | 5 | 5 | 100.0% | Hard + Long-horizon | Long | Error Recovery | 4.1mavg of 5 | 36.1Kavg of 5 |
| v56-w14-chain-1to08 | 5/5 passed | 5 | 5 | 100.0% | Hard + Long-horizon | Long | Statefulness | 4.6mavg of 5 | 41.2Kavg of 5 |
| v56-w14-chain-1to09 | 5/5 passed | 5 | 5 | 100.0% | Hard + Long-horizon | Long | Authentication | 3.1mavg of 5 | 23.7Kavg of 5 |
| v56-w14-chain-1to10 | 5/5 passed | 5 | 5 | 100.0% | Hard + Long-horizon | Long | Discovery | 5.6mavg of 5 | 52.5Kavg of 5 |
| v56-w14-chain-1to11 | 5/5 passed | 5 | 5 | 100.0% | Hard + Long-horizon | Long | Statefulness | 5.2mavg of 5 | 50.1Kavg of 5 |
| v56-w14-chain-1to12 | 5/5 passed | 5 | 5 | 100.0% | Hard + Long-horizon | Long | Statefulness | 4.7mavg of 5 | 38.0Kavg of 5 |
| v56-w14-chain-1to13 | 5/5 passed | 5 | 5 | 100.0% | Hard + Long-horizon | Long | Error Recovery | 5.6mavg of 5 | 51.2Kavg of 5 |
| v56-w14-chain-1to14 | 5/5 passed | 5 | 5 | 100.0% | Hard + Long-horizon | Long | Statefulness | 4.7mavg of 5 | 33.9Kavg of 5 |
| v56-w14-chain-1to15 | 5/5 passed | 5 | 5 | 100.0% | Hard + Long-horizon | Long | Schema | 4.7mavg of 5 | 37.6Kavg of 5 |
| v56-w14-chain-1to16 | 5/5 passed | 5 | 5 | 100.0% | Hard + Long-horizon | Long | Statefulness | 5.3mavg of 5 | 39.8Kavg of 5 |
| v56-w14-chain-1to17 | 5/5 passed | 5 | 5 | 100.0% | Hard + Long-horizon | Long | Authentication | 5.7mavg of 5 | 52.1Kavg of 5 |
| v56-w14-chain-1to18 | 5/5 passed | 5 | 5 | 100.0% | Hard + Long-horizon | Long | Statefulness | 4.7mavg of 5 | 43.4Kavg of 5 |
| v56-w14-chain-1to19 | 5/5 passed | 5 | 5 | 100.0% | Hard + Long-horizon | Long | Pagination | 4.0mavg of 5 | 30.1Kavg of 5 |
| v56-w14-chain-1to20 | 5/5 passed | 5 | 5 | 100.0% | Hard + Long-horizon | Long | Pagination | 4.9mavg of 5 | 38.9Kavg of 5 |
| v56-w14-sub01 | 5/5 passed | 5 | 5 | 100.0% | Hard | Medium | Discovery | 5.7mavg of 5 | 47.7Kavg of 5 |
| v56-w14-sub02 | 5/5 passed | 5 | 5 | 100.0% | Easy | Short | Statefulness | 4.3mavg of 5 | 34.7Kavg of 5 |
| v56-w14-sub03 | 5/5 passed | 5 | 5 | 100.0% | Hard | Medium | Authentication | 9.2mavg of 5 | 51.0Kavg of 5 |
| v56-w14-sub04 | 5/5 passed | 5 | 5 | 100.0% | Easy | Medium | Schema | 4.1mavg of 5 | 28.4Kavg of 5 |
| v56-w14-sub05 | 5/5 passed | 5 | 5 | 100.0% | Easy | Short | Error Recovery | 3.2mavg of 5 | 20.3Kavg of 5 |
| v56-w14-sub06 | 5/5 passed | 5 | 5 | 100.0% | Easy | Short | Discovery | 4.7mavg of 5 | 29.4Kavg of 5 |
| v56-w14-sub07 | 5/5 passed | 5 | 5 | 100.0% | Long-horizon | Medium | Error Recovery | 5.8mavg of 5 | 31.7Kavg of 5 |
| v56-w14-sub08 | 5/5 passed | 5 | 5 | 100.0% | Easy | Short | Statefulness | 6.6mavg of 5 | 51.0Kavg of 5 |
| v56-w14-sub09 | 5/5 passed | 5 | 5 | 100.0% | Easy | Short | Authentication | 4.2mavg of 5 | 25.9Kavg of 5 |
| v56-w14-sub10 | 5/5 passed | 5 | 5 | 100.0% | Easy | Short | Discovery | 6.1mavg of 5 | 30.6Kavg of 5 |
| v56-w14-sub11 | 5/5 passed | 5 | 5 | 100.0% | Easy | Short | Statefulness | 3.8mavg of 5 | 22.3Kavg of 5 |
| v56-w14-sub12 | 5/5 passed | 5 | 5 | 100.0% | Long-horizon | Medium | Statefulness | 4.4mavg of 5 | 25.6Kavg of 5 |
| v56-w14-sub13 | 5/5 passed | 5 | 5 | 100.0% | Hard | Short | Error Recovery | 5.7mavg of 5 | 37.9Kavg of 5 |
| v56-w14-sub14 | 5/5 passed | 5 | 5 | 100.0% | Long-horizon | Short | Statefulness | 4.2mavg of 5 | 27.6Kavg of 5 |
| v56-w14-sub15 | 5/5 passed | 5 | 5 | 100.0% | Easy | Short | Schema | 3.4mavg of 5 | 21.0Kavg of 5 |
| v56-w14-sub16 | 4/5 passed | 5 | 4 | 80.0% | Long-horizon | Medium | Statefulness | 4.2mavg of 5 | 26.1Kavg of 5 |
| v56-w14-sub17 | 5/5 passed | 5 | 5 | 100.0% | Hard | Short | Authentication | 6.2mavg of 5 | 56.9Kavg of 5 |
| v56-w14-sub18 | 5/5 passed | 5 | 5 | 100.0% | Long-horizon | Short | Statefulness | 4.2mavg of 5 | 24.3Kavg of 5 |
| v56-w14-sub19 | 5/5 passed | 5 | 5 | 100.0% | Easy | Short | Pagination | 6.0mavg of 5 | 49.7Kavg of 5 |
| v56-w14-sub20 | 5/5 passed | 5 | 5 | 100.0% | Easy | Short | Pagination | 6.3mavg of 5 | 58.5Kavg of 5 |
| v56-w16-chain-1to02 | 5/5 passed | 5 | 5 | 100.0% | Long-horizon | Long | Discovery | 5.9mavg of 5 | 40.5Kavg of 5 |
| v56-w16-chain-1to03 | 5/5 passed | 5 | 5 | 100.0% | Hard + Long-horizon | Long | Error Recovery | 4.5mavg of 5 | 30.2Kavg of 5 |
| v56-w16-chain-1to04 | 4/5 passed | 5 | 4 | 80.0% | Hard + Long-horizon | Long | Discovery | 10.5mavg of 5 | 118.2Kavg of 5 |
| v56-w16-chain-1to05 | 5/5 passed | 5 | 5 | 100.0% | Hard + Long-horizon | Long | Error Recovery | 5.1mavg of 5 | 37.6Kavg of 5 |
| v56-w16-chain-1to06 | 5/5 passed | 5 | 5 | 100.0% | Hard + Long-horizon | Long | Multi-step Workflow | 7.0mavg of 5 | 61.7Kavg of 5 |
| v56-w16-chain-1to07 | 5/5 passed | 5 | 5 | 100.0% | Hard + Long-horizon | Long | Multi-step Workflow | 7.4mavg of 5 | 68.5Kavg of 5 |
| v56-w16-chain-1to08 | 5/5 passed | 5 | 5 | 100.0% | Hard + Long-horizon | Long | Authentication | 4.0mavg of 5 | 30.0Kavg of 5 |
| v56-w16-chain-1to09 | 5/5 passed | 5 | 5 | 100.0% | Hard + Long-horizon | Long | Multi-step Workflow | 5.2mavg of 5 | 38.2Kavg of 5 |
| v56-w16-chain-1to10 | 5/5 passed | 5 | 5 | 100.0% | Hard + Long-horizon | Long | Authentication | 4.5mavg of 5 | 33.1Kavg of 5 |
| v56-w16-chain-1to11 | 5/5 passed | 5 | 5 | 100.0% | Hard + Long-horizon | Long | Statefulness | 4.9mavg of 5 | 36.3Kavg of 5 |
| v56-w16-chain-1to12 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Authentication | 6.0mavg of 5 | 46.1Kavg of 5 |
| v56-w16-chain-1to13 | 5/5 passed | 5 | 5 | 100.0% | Hard + Long-horizon | Long | Schema | 13.1mavg of 5 | 56.9Kavg of 5 |
| v56-w16-chain-1to14 | 5/5 passed | 5 | 5 | 100.0% | Hard + Long-horizon | Long | Schema | 4.9mavg of 5 | 32.4Kavg of 5 |
| v56-w16-chain-1to15 | 5/5 passed | 5 | 5 | 100.0% | Hard + Long-horizon | Long | Error Recovery | 5.6mavg of 5 | 31.0Kavg of 5 |
| v56-w16-chain-1to16 | 5/5 passed | 5 | 5 | 100.0% | Hard + Long-horizon | Long | Statefulness | 5.5mavg of 5 | 42.1Kavg of 5 |
| v56-w16-chain-1to17 | 5/5 passed | 5 | 5 | 100.0% | Hard + Long-horizon | Long | Multi-step Workflow | 7.5mavg of 5 | 62.3Kavg of 5 |
| v56-w16-chain-1to18 | 5/5 passed | 5 | 5 | 100.0% | Hard + Long-horizon | Long | Pagination | 6.7mavg of 5 | 48.5Kavg of 5 |
| v56-w16-chain-1to19 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Discovery | 4.2mavg of 5 | 25.0Kavg of 5 |
| v56-w16-chain-1to20 | 5/5 passed | 5 | 5 | 100.0% | Hard + Long-horizon | Long | Multi-step Workflow | 6.8mavg of 5 | 47.6Kavg of 5 |
| v56-w16-sub01 | 5/5 passed | 5 | 5 | 100.0% | Long-horizon | Medium | Pagination | 4.7mavg of 5 | 31.5Kavg of 5 |
| v56-w16-sub02 | 5/5 passed | 5 | 5 | 100.0% | Long-horizon | Medium | Discovery | 6.8mavg of 5 | 50.0Kavg of 5 |
| v56-w16-sub03 | 5/5 passed | 5 | 5 | 100.0% | Hard | Medium | Error Recovery | 4.4mavg of 5 | 29.8Kavg of 5 |
| v56-w16-sub04 | 5/5 passed | 5 | 5 | 100.0% | Long-horizon | Medium | Discovery | 9.8mavg of 5 | 89.7Kavg of 5 |
| v56-w16-sub05 | 3/5 passed | 5 | 3 | 60.0% | Hard | Medium | Error Recovery | 5.3mavg of 5 | 38.4Kavg of 5 |
| v56-w16-sub06 | 5/5 passed | 5 | 5 | 100.0% | Long-horizon | Medium | Multi-step Workflow | 4.3mavg of 5 | 27.1Kavg of 5 |
| v56-w16-sub07 | 5/5 passed | 5 | 5 | 100.0% | Long-horizon | Medium | Multi-step Workflow | 6.0mavg of 5 | 45.1Kavg of 5 |
| v56-w16-sub08 | 5/5 passed | 5 | 5 | 100.0% | Easy | Short | Authentication | 4.8mavg of 5 | 29.7Kavg of 5 |
| v56-w16-sub09 | 5/5 passed | 5 | 5 | 100.0% | Long-horizon | Short | Multi-step Workflow | 4.0mavg of 5 | 22.1Kavg of 5 |
| v56-w16-sub10 | 5/5 passed | 5 | 5 | 100.0% | Long-horizon | Medium | Authentication | 9.4mavg of 5 | 37.3Kavg of 5 |
| v56-w16-sub11 | 5/5 passed | 5 | 5 | 100.0% | Long-horizon | Medium | Statefulness | 5.1mavg of 5 | 28.1Kavg of 5 |
| v56-w16-sub12 | 5/5 passed | 5 | 5 | 100.0% | Long-horizon | Medium | Authentication | 7.3mavg of 5 | 48.3Kavg of 5 |
| v56-w16-sub13 | 5/5 passed | 5 | 5 | 100.0% | Hard | Short | Schema | 4.5mavg of 5 | 27.9Kavg of 5 |
| v56-w16-sub14 | 5/5 passed | 5 | 5 | 100.0% | Long-horizon | Medium | Schema | 4.8mavg of 5 | 27.5Kavg of 5 |
| v56-w16-sub15 | 5/5 passed | 5 | 5 | 100.0% | Long-horizon | Medium | Error Recovery | 5.6mavg of 5 | 31.1Kavg of 5 |
| v56-w16-sub16 | 5/5 passed | 5 | 5 | 100.0% | Long-horizon | Medium | Statefulness | 6.0mavg of 5 | 35.0Kavg of 5 |
| v56-w16-sub17 | 5/5 passed | 5 | 5 | 100.0% | Long-horizon | Long | Multi-step Workflow | 7.6mavg of 5 | 47.7Kavg of 5 |
| v56-w16-sub18 | 5/5 passed | 5 | 5 | 100.0% | Long-horizon | Medium | Pagination | 5.3mavg of 5 | 27.2Kavg of 5 |
| v56-w16-sub19 | 5/5 passed | 5 | 5 | 100.0% | Easy | Short | Discovery | 4.9mavg of 5 | 27.1Kavg of 5 |
| v56-w16-sub20 | 5/5 passed | 5 | 5 | 100.0% | Long-horizon | Medium | Multi-step Workflow | 5.0mavg of 5 | 27.8Kavg of 5 |
| v56-w18-chain-1to02 | 1/5 passed | 5 | 1 | 20.0% | Hard + Long-horizon | Long | Discovery | 14.4mavg of 5 | 55.9Kavg of 5 |
| v56-w18-chain-1to03 | 5/5 passed | 5 | 5 | 100.0% | Hard + Long-horizon | Long | Authentication | 5.2mavg of 5 | 29.0Kavg of 5 |
| v56-w18-chain-1to04 | 3/5 passed | 5 | 3 | 60.0% | Hard + Long-horizon | Long | Statefulness | 31.6mavg of 5 | 1.0Mavg of 5 |
| v56-w18-chain-1to05 | 5/5 passed | 5 | 5 | 100.0% | Hard + Long-horizon | Long | Statefulness | 8.4mavg of 5 | 62.9Kavg of 5 |
| v56-w18-chain-1to06 | 5/5 passed | 5 | 5 | 100.0% | Hard + Long-horizon | Long | Schema | 6.5mavg of 5 | 43.4Kavg of 5 |
| v56-w18-chain-1to07 | 3/5 passed | 5 | 3 | 60.0% | Hard + Long-horizon | Long | Schema | 26.3mavg of 5 | 524.4Kavg of 5 |
| v56-w18-chain-1to08 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Discovery | 3.9mavg of 5 | 22.5Kavg of 5 |
| v56-w18-chain-1to09 | 5/5 passed | 5 | 5 | 100.0% | Hard + Long-horizon | Long | Multi-step Workflow | 7.2mavg of 5 | 52.0Kavg of 5 |
| v56-w18-chain-1to10 | 4/5 passed | 5 | 4 | 80.0% | Hard + Long-horizon | Long | Authentication | 4.3mavg of 5 | 26.0Kavg of 5 |
| v56-w18-chain-1to11 | 5/5 passed | 5 | 5 | 100.0% | Hard + Long-horizon | Long | Statefulness | 7.5mavg of 5 | 51.6Kavg of 5 |
| v56-w18-chain-1to12 | 1/5 passed | 5 | 1 | 20.0% | Hard + Long-horizon | Long | Error Recovery | 66.9mavg of 5 | 10.7Mavg of 5 |
| v56-w18-chain-1to13 | 5/5 passed | 5 | 5 | 100.0% | Hard + Long-horizon | Long | Pagination | 9.4mavg of 5 | 72.1Kavg of 5 |
| v56-w18-chain-1to14 | 5/5 passed | 5 | 5 | 100.0% | Hard + Long-horizon | Long | Schema | 8.3mavg of 5 | 51.3Kavg of 5 |
| v56-w18-sub01 | 5/5 passed | 5 | 5 | 100.0% | Hard | Medium | Schema | 8.4mavg of 5 | 47.0Kavg of 5 |
| v56-w18-sub02 | 5/5 passed | 5 | 5 | 100.0% | Hard | Medium | Discovery | 6.1mavg of 5 | 36.3Kavg of 5 |
| v56-w18-sub03 | 5/5 passed | 5 | 5 | 100.0% | Long-horizon | Short | Authentication | 5.0mavg of 5 | 26.1Kavg of 5 |
| v56-w18-sub04 | 2/5 passed | 5 | 2 | 40.0% | Hard | Medium | Statefulness | 30.7mavg of 5 | 1.4Mavg of 5 |
| v56-w18-sub05 | 5/5 passed | 5 | 5 | 100.0% | Hard | Medium | Statefulness | 4.9mavg of 5 | 24.6Kavg of 5 |
| v56-w18-sub06 | 5/5 passed | 5 | 5 | 100.0% | Easy | Short | Schema | 6.4mavg of 5 | 32.2Kavg of 5 |
| v56-w18-sub07 | 5/5 passed | 5 | 5 | 100.0% | Easy | Short | Schema | 5.8mavg of 5 | 31.2Kavg of 5 |
| v56-w18-sub08 | 5/5 passed | 5 | 5 | 100.0% | Easy | Short | Discovery | 5.3mavg of 5 | 29.7Kavg of 5 |
| v56-w18-sub09 | 5/5 passed | 5 | 5 | 100.0% | Hard | Medium | Multi-step Workflow | 6.8mavg of 5 | 38.1Kavg of 5 |
| v56-w18-sub10 | 5/5 passed | 5 | 5 | 100.0% | Easy | Short | Authentication | 5.4mavg of 5 | 29.8Kavg of 5 |
| v56-w18-sub11 | 5/5 passed | 5 | 5 | 100.0% | Easy | Short | Statefulness | 6.0mavg of 5 | 34.9Kavg of 5 |
| v56-w18-sub12 | 5/5 passed | 5 | 5 | 100.0% | Easy | Short | Error Recovery | 5.8mavg of 5 | 27.5Kavg of 5 |
| v56-w18-sub13 | 5/5 passed | 5 | 5 | 100.0% | Easy | Short | Pagination | 9.0mavg of 5 | 79.0Kavg of 5 |
| v56-w18-sub14 | 5/5 passed | 5 | 5 | 100.0% | Easy | Short | Schema | 5.9mavg of 5 | 25.2Kavg of 5 |
| v56-w18-sub15 | 4/5 passed | 5 | 4 | 80.0% | — | — | Multi-step Workflow | 24.5mavg of 5 | 989.4Kavg of 5 |