minimax-m3
2,335 trials on 467 tasks across all task sets — 764 passed, 1,571 failed. Click any task row for a quick view of its trials; every trial's raw transcript (JSON) is available for download. Use the task-set bar to reproduce any overview slice.
Note: this score reflects the model provider's serverless deployment as of 2026-07-18.
Showing All tasks: 467 tasks · 2335 trials · pass rate 32.7% (764/2335) — same numbers as that overview slice.
| Task | Result | Trials | Passed | Rate | Bucket | Horizon | Axes | Time | Tokens |
|---|---|---|---|---|---|---|---|---|---|
| v56-w01-chain-1to02 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Pagination | 37.9mavg of 5 | 5.3Mavg of 5 |
| v56-w01-chain-1to03 | 3/5 passed | 5 | 3 | 60.0% | Hard + Long-horizon | Long | Discovery | 34.3mavg of 5 | 5.6Mavg of 5 |
| v56-w01-chain-1to04 | 2/5 passed | 5 | 2 | 40.0% | Hard + Long-horizon | Long | Statefulness | 36.2mavg of 5 | 5.6Mavg of 5 |
| v56-w01-chain-1to05 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Schema | 29.7mavg of 5 | 3.6Mavg of 5 |
| v56-w01-chain-1to06 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Multi-step Workflow | 27.5mavg of 5 | 3.1Mavg of 5 |
| v56-w01-chain-1to07 | 3/5 passed | 5 | 3 | 60.0% | Hard + Long-horizon | Long | Authentication | 27.2mavg of 5 | 5.7Mavg of 5 |
| v56-w01-chain-1to08 | 1/5 passed | 5 | 1 | 20.0% | Hard + Long-horizon | Long | Error Recovery | 36.5mavg of 5 | 5.2Mavg of 5 |
| v56-w01-chain-1to09 | 1/5 passed | 5 | 1 | 20.0% | Hard + Long-horizon | Long | Statefulness | 31.5mavg of 5 | 3.5Mavg of 5 |
| v56-w01-chain-1to10 | 1/5 passed | 5 | 1 | 20.0% | Hard + Long-horizon | Long | Discovery | 37.3mavg of 5 | 5.8Mavg of 5 |
| v56-w01-chain-1to11 | 4/5 passed | 5 | 4 | 80.0% | Hard + Long-horizon | Long | Statefulness | 8.5mavg of 5 | 308.3Kavg of 5 |
| v56-w01-chain-1to12 | 4/5 passed | 5 | 4 | 80.0% | Hard + Long-horizon | Long | Discovery | 14.7mavg of 5 | 1.3Mavg of 5 |
| v56-w01-chain-1to13 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Schema | 31.9mavg of 5 | 4.4Mavg of 5 |
| v56-w01-chain-1to14 | 1/5 passed | 5 | 1 | 20.0% | Hard + Long-horizon | Long | Multi-step Workflow | 28.8mavg of 5 | 3.0Mavg of 5 |
| v56-w01-chain-1to15 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Error Recovery | 23.3mavg of 5 | 2.7Mavg of 5 |
| v56-w01-chain-1to16 | 2/5 passed | 5 | 2 | 40.0% | Hard + Long-horizon | Long | Pagination | 29.9mavg of 5 | 5.2Mavg of 5 |
| v56-w01-chain-1to17 | 4/5 passed | 5 | 4 | 80.0% | Hard + Long-horizon | Long | Discovery | 13.1mavg of 5 | 622.4Kavg of 5 |
| v56-w01-chain-1to18 | 1/5 passed | 5 | 1 | 20.0% | Hard + Long-horizon | Long | Schema | 56.8mavg of 5 | 11.4Mavg of 5 |
| v56-w01-chain-1to19 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Multi-step Workflow | 33.6mavg of 5 | 4.4Mavg of 5 |
| v56-w01-chain-1to20 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Authentication | 43.0mavg of 5 | 7.5Mavg of 5 |
| v56-w01-sub01 | 0/5 passed | 5 | 0 | 0.0% | Hard | Medium | Statefulness | 49.6mavg of 5 | 9.6Mavg of 5 |
| v56-w01-sub02 | 2/5 passed | 5 | 2 | 40.0% | Easy | Short | Pagination | 13.4mavg of 5 | 789.0Kavg of 5 |
| v56-w01-sub03 | 4/5 passed | 5 | 4 | 80.0% | Easy | Short | Discovery | 18.1mavg of 5 | 1.4Mavg of 5 |
| v56-w01-sub04 | 4/5 passed | 5 | 4 | 80.0% | Easy | Short | Statefulness | 13.4mavg of 5 | 955.8Kavg of 5 |
| v56-w01-sub05 | 2/5 passed | 5 | 2 | 40.0% | Hard | Short | Schema | 41.8mavg of 5 | 6.4Mavg of 5 |
| v56-w01-sub06 | 0/5 passed | 5 | 0 | 0.0% | Hard | Medium | Multi-step Workflow | 28.0mavg of 5 | 3.2Mavg of 5 |
| v56-w01-sub07 | 4/5 passed | 5 | 4 | 80.0% | Easy | Short | Authentication | 18.2mavg of 5 | 1.2Mavg of 5 |
| v56-w01-sub08 | 0/5 passed | 5 | 0 | 0.0% | Hard | Medium | Error Recovery | 39.3mavg of 5 | 9.6Mavg of 5 |
| v56-w01-sub09 | 3/5 passed | 5 | 3 | 60.0% | Easy | Short | Statefulness | 12.7mavg of 5 | 740.5Kavg of 5 |
| v56-w01-sub10 | 0/5 passed | 5 | 0 | 0.0% | Hard | Short | Discovery | 40.6mavg of 5 | 7.0Mavg of 5 |
| v56-w01-sub11 | 5/5 passed | 5 | 5 | 100.0% | Easy | Short | Statefulness | 5.7mavg of 5 | 136.9Kavg of 5 |
| v56-w01-sub12 | 3/5 passed | 5 | 3 | 60.0% | Easy | Short | Discovery | 19.4mavg of 5 | 2.0Mavg of 5 |
| v56-w01-sub13 | 4/5 passed | 5 | 4 | 80.0% | Easy | Short | Schema | 15.8mavg of 5 | 985.3Kavg of 5 |
| v56-w01-sub14 | 3/5 passed | 5 | 3 | 60.0% | Hard | Medium | Multi-step Workflow | 25.5mavg of 5 | 3.1Mavg of 5 |
| v56-w01-sub15 | 0/5 passed | 5 | 0 | 0.0% | Hard | Short | Error Recovery | 15.9mavg of 5 | 915.4Kavg of 5 |
| v56-w01-sub16 | 4/5 passed | 5 | 4 | 80.0% | Easy | Short | Pagination | 15.9mavg of 5 | 1.2Mavg of 5 |
| v56-w01-sub17 | 4/5 passed | 5 | 4 | 80.0% | Easy | Short | Discovery | 14.8mavg of 5 | 1.0Mavg of 5 |
| v56-w01-sub18 | 5/5 passed | 5 | 5 | 100.0% | Hard | Short | Schema | 9.4mavg of 5 | 382.1Kavg of 5 |
| v56-w01-sub19 | 0/5 passed | 5 | 0 | 0.0% | Hard | Medium | Multi-step Workflow | 52.7mavg of 5 | 10.6Mavg of 5 |
| v56-w01-sub20 | 0/5 passed | 5 | 0 | 0.0% | Hard | Short | Authentication | 20.4mavg of 5 | 1.7Mavg of 5 |
| v56-w02-chain-1to02 | 5/5 passed | 5 | 5 | 100.0% | Hard + Long-horizon | Long | Error Recovery | 18.1mavg of 5 | 1.3Mavg of 5 |
| v56-w02-chain-1to03 | 3/5 passed | 5 | 3 | 60.0% | Hard + Long-horizon | Long | Statefulness | 14.6mavg of 5 | 1.1Mavg of 5 |
| v56-w02-chain-1to04 | 2/5 passed | 5 | 2 | 40.0% | Hard + Long-horizon | Long | Schema | 6.9mavg of 5 | 373.0Kavg of 5 |
| v56-w02-chain-1to05 | 3/5 passed | 5 | 3 | 60.0% | Hard + Long-horizon | Long | Discovery | 20.4mavg of 5 | 2.9Mavg of 5 |
| v56-w02-chain-1to06 | 1/5 passed | 5 | 1 | 20.0% | Hard + Long-horizon | Long | Statefulness | 13.0mavg of 5 | 1.4Mavg of 5 |
| v56-w02-chain-1to07 | 2/5 passed | 5 | 2 | 40.0% | Hard + Long-horizon | Long | Error Recovery | 25.8mavg of 5 | 3.7Mavg of 5 |
| v56-w02-chain-1to08 | 2/5 passed | 5 | 2 | 40.0% | Hard + Long-horizon | Long | Error Recovery | 14.0mavg of 5 | 1.3Mavg of 5 |
| v56-w02-chain-1to09 | 2/5 passed | 5 | 2 | 40.0% | Hard + Long-horizon | Long | Statefulness | 29.1mavg of 5 | 3.6Mavg of 5 |
| v56-w02-chain-1to10 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Discovery | 19.9mavg of 5 | 2.2Mavg of 5 |
| v56-w02-chain-1to11 | 1/5 passed | 5 | 1 | 20.0% | Hard + Long-horizon | Long | Multi-step Workflow | 14.8mavg of 5 | 1.1Mavg of 5 |
| v56-w02-chain-1to12 | 5/5 passed | 5 | 5 | 100.0% | Hard + Long-horizon | Long | Schema | 18.9mavg of 5 | 1.7Mavg of 5 |
| v56-w02-chain-1to13 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Statefulness | 17.3mavg of 5 | 1.5Mavg of 5 |
| v56-w02-chain-1to14 | 3/5 passed | 5 | 3 | 60.0% | Hard + Long-horizon | Long | Multi-step Workflow | 22.2mavg of 5 | 2.5Mavg of 5 |
| v56-w02-chain-1to15 | 1/5 passed | 5 | 1 | 20.0% | Hard + Long-horizon | Long | Statefulness | 30.7mavg of 5 | 4.7Mavg of 5 |
| v56-w02-chain-1to16 | 1/5 passed | 5 | 1 | 20.0% | Hard + Long-horizon | Long | Statefulness | 35.6mavg of 5 | 8.2Mavg of 5 |
| v56-w02-chain-1to17 | 5/5 passed | 5 | 5 | 100.0% | Hard + Long-horizon | Long | Authentication | 20.0mavg of 5 | 2.3Mavg of 5 |
| v56-w02-chain-1to18 | 4/5 passed | 5 | 4 | 80.0% | Hard + Long-horizon | Long | Error Recovery | 12.5mavg of 5 | 1.0Mavg of 5 |
| v56-w02-chain-1to19 | 1/5 passed | 5 | 1 | 20.0% | Hard + Long-horizon | Long | Statefulness | 25.0mavg of 5 | 3.7Mavg of 5 |
| v56-w02-chain-1to20 | 2/5 passed | 5 | 2 | 40.0% | Hard + Long-horizon | Long | Statefulness | 44.2mavg of 5 | 9.7Mavg of 5 |
| v56-w02-sub01 | 1/5 passed | 5 | 1 | 20.0% | Hard | Medium | Discovery | 25.2mavg of 5 | 3.6Mavg of 5 |
| v56-w02-sub02 | 2/5 passed | 5 | 2 | 40.0% | Hard | Medium | Error Recovery | 13.3mavg of 5 | 2.0Mavg of 5 |
| v56-w02-sub03 | 2/5 passed | 5 | 2 | 40.0% | Easy | Short | Statefulness | 18.7mavg of 5 | 2.1Mavg of 5 |
| v56-w02-sub04 | 3/5 passed | 5 | 3 | 60.0% | Easy | Short | Schema | 23.6mavg of 5 | 5.5Mavg of 5 |
| v56-w02-sub05 | 3/5 passed | 5 | 3 | 60.0% | Easy | Short | Discovery | 25.5mavg of 5 | 4.9Mavg of 5 |
| v56-w02-sub06 | 4/5 passed | 5 | 4 | 80.0% | Easy | Short | Statefulness | 13.7mavg of 5 | 2.3Mavg of 5 |
| v56-w02-sub07 | 4/5 passed | 5 | 4 | 80.0% | Hard | Medium | Error Recovery | 9.6mavg of 5 | 815.2Kavg of 5 |
| v56-w02-sub08 | 1/5 passed | 5 | 1 | 20.0% | Long-horizon | Medium | Error Recovery | 17.7mavg of 5 | 2.5Mavg of 5 |
| v56-w02-sub09 | 3/5 passed | 5 | 3 | 60.0% | Easy | Short | Statefulness | 20.0mavg of 5 | 4.2Mavg of 5 |
| v56-w02-sub10 | 2/5 passed | 5 | 2 | 40.0% | Easy | Short | Discovery | 11.1mavg of 5 | 970.5Kavg of 5 |
| v56-w02-sub11 | 4/5 passed | 5 | 4 | 80.0% | Easy | Short | Multi-step Workflow | 5.5mavg of 5 | 295.4Kavg of 5 |
| v56-w02-sub12 | 4/5 passed | 5 | 4 | 80.0% | Easy | Short | Schema | 6.6mavg of 5 | 400.3Kavg of 5 |
| v56-w02-sub13 | 3/5 passed | 5 | 3 | 60.0% | Easy | Short | Statefulness | 9.5mavg of 5 | 772.7Kavg of 5 |
| v56-w02-sub14 | 5/5 passed | 5 | 5 | 100.0% | Easy | Short | Multi-step Workflow | 4.5mavg of 5 | 216.5Kavg of 5 |
| v56-w02-sub15 | 1/5 passed | 5 | 1 | 20.0% | Hard | Short | Statefulness | 13.0mavg of 5 | 1.6Mavg of 5 |
| v56-w02-sub16 | 3/5 passed | 5 | 3 | 60.0% | Easy | Short | Statefulness | 15.2mavg of 5 | 1.6Mavg of 5 |
| v56-w02-sub17 | 4/5 passed | 5 | 4 | 80.0% | Long-horizon | Medium | Authentication | 19.8mavg of 5 | 2.6Mavg of 5 |
| v56-w02-sub18 | 1/5 passed | 5 | 1 | 20.0% | Long-horizon | Medium | Error Recovery | 9.3mavg of 5 | 882.3Kavg of 5 |
| v56-w02-sub19 | 5/5 passed | 5 | 5 | 100.0% | Easy | Short | Statefulness | 6.1mavg of 5 | 360.3Kavg of 5 |
| v56-w02-sub20 | 2/5 passed | 5 | 2 | 40.0% | Long-horizon | Medium | Statefulness | 26.1mavg of 5 | 4.2Mavg of 5 |
| v56-w03-chain-1to02 | 1/5 passed | 5 | 1 | 20.0% | Hard + Long-horizon | Long | Multi-step Workflow | 26.4mavg of 5 | 4.1Mavg of 5 |
| v56-w03-chain-1to03 | 1/5 passed | 5 | 1 | 20.0% | Hard + Long-horizon | Long | Error Recovery | 37.3mavg of 5 | 6.2Mavg of 5 |
| v56-w03-chain-1to04 | 1/5 passed | 5 | 1 | 20.0% | Hard + Long-horizon | Long | Error Recovery | 46.6mavg of 5 | 8.8Mavg of 5 |
| v56-w03-chain-1to05 | 1/5 passed | 5 | 1 | 20.0% | Hard + Long-horizon | Long | Error Recovery | 41.1mavg of 5 | 7.0Mavg of 5 |
| v56-w03-chain-1to06 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Pagination | 30.2mavg of 5 | 3.9Mavg of 5 |
| v56-w03-chain-1to07 | 4/5 passed | 5 | 4 | 80.0% | Hard + Long-horizon | Long | Discovery | 3.1mavg of 5 | 131.8Kavg of 5 |
| v56-w03-chain-1to08 | 5/5 passed | 5 | 5 | 100.0% | Hard + Long-horizon | Long | Error Recovery | 9.3mavg of 5 | 818.1Kavg of 5 |
| v56-w03-chain-1to09 | 1/5 passed | 5 | 1 | 20.0% | Hard + Long-horizon | Long | Authentication | 42.1mavg of 5 | 8.4Mavg of 5 |
| v56-w03-chain-1to10 | 3/5 passed | 5 | 3 | 60.0% | Hard + Long-horizon | Long | Statefulness | 14.1mavg of 5 | 1.4Mavg of 5 |
| v56-w03-chain-1to11 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Error Recovery | 29.9mavg of 5 | 4.6Mavg of 5 |
| v56-w03-chain-1to12 | 2/5 passed | 5 | 2 | 40.0% | Hard + Long-horizon | Long | Authentication | 27.1mavg of 5 | 4.2Mavg of 5 |
| v56-w03-chain-1to13 | 3/5 passed | 5 | 3 | 60.0% | Hard + Long-horizon | Long | Error Recovery | 21.5mavg of 5 | 2.2Mavg of 5 |
| v56-w03-chain-1to14 | 1/5 passed | 5 | 1 | 20.0% | Hard + Long-horizon | Long | Multi-step Workflow | 50.7mavg of 5 | 8.9Mavg of 5 |
| v56-w03-chain-1to15 | 1/5 passed | 5 | 1 | 20.0% | Hard + Long-horizon | Long | Multi-step Workflow | 34.8mavg of 5 | 6.5Mavg of 5 |
| v56-w03-chain-1to16 | 3/5 passed | 5 | 3 | 60.0% | Hard + Long-horizon | Long | Schema | 15.6mavg of 5 | 1.4Mavg of 5 |
| v56-w03-chain-1to17 | 1/5 passed | 5 | 1 | 20.0% | Hard + Long-horizon | Long | Pagination | 42.2mavg of 5 | 6.2Mavg of 5 |
| v56-w03-chain-1to18 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Error Recovery | 35.0mavg of 5 | 5.2Mavg of 5 |
| v56-w03-chain-1to19 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Authentication | 38.6mavg of 5 | 6.9Mavg of 5 |
| v56-w03-chain-1to20 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Multi-step Workflow | 39.7mavg of 5 | 6.5Mavg of 5 |
| v56-w03-sub01 | 2/5 passed | 5 | 2 | 40.0% | Long-horizon | Medium | Error Recovery | 17.3mavg of 5 | 2.3Mavg of 5 |
| v56-w03-sub02 | 0/5 passed | 5 | 0 | 0.0% | Hard | Medium | Multi-step Workflow | 36.4mavg of 5 | 5.9Mavg of 5 |
| v56-w03-sub03 | 3/5 passed | 5 | 3 | 60.0% | Hard | Medium | Error Recovery | 14.5mavg of 5 | 1.4Mavg of 5 |
| v56-w03-sub04 | 2/5 passed | 5 | 2 | 40.0% | Hard | Short | Error Recovery | 32.6mavg of 5 | 6.1Mavg of 5 |
| v56-w03-sub05 | 3/5 passed | 5 | 3 | 60.0% | Hard | Short | Error Recovery | 25.0mavg of 5 | 3.7Mavg of 5 |
| v56-w03-sub06 | 2/5 passed | 5 | 2 | 40.0% | Long-horizon | Medium | Pagination | 39.9mavg of 5 | 6.0Mavg of 5 |
| v56-w03-sub07 | 4/5 passed | 5 | 4 | 80.0% | Easy | Short | Discovery | 5.4mavg of 5 | 232.3Kavg of 5 |
| v56-w03-sub08 | 5/5 passed | 5 | 5 | 100.0% | Easy | Short | Error Recovery | 5.3mavg of 5 | 261.2Kavg of 5 |
| v56-w03-sub09 | 1/5 passed | 5 | 1 | 20.0% | Hard | Medium | Authentication | 34.8mavg of 5 | 6.7Mavg of 5 |
| v56-w03-sub10 | 2/5 passed | 5 | 2 | 40.0% | Hard | Short | Statefulness | 13.2mavg of 5 | 1.3Mavg of 5 |
| v56-w03-sub11 | 2/5 passed | 5 | 2 | 40.0% | Hard | Short | Error Recovery | 37.0mavg of 5 | 8.1Mavg of 5 |
| v56-w03-sub12 | 0/5 passed | 5 | 0 | 0.0% | Hard | Medium | Authentication | 44.5mavg of 5 | 7.8Mavg of 5 |
| v56-w03-sub13 | 2/5 passed | 5 | 2 | 40.0% | Hard | Medium | Error Recovery | 16.8mavg of 5 | 1.4Mavg of 5 |
| v56-w03-sub14 | 0/5 passed | 5 | 0 | 0.0% | Long-horizon | Medium | Multi-step Workflow | 37.4mavg of 5 | 6.5Mavg of 5 |
| v56-w03-sub15 | 1/5 passed | 5 | 1 | 20.0% | Hard | Medium | Multi-step Workflow | 14.5mavg of 5 | 1.0Mavg of 5 |
| v56-w03-sub16 | 5/5 passed | 5 | 5 | 100.0% | Easy | Short | Schema | 6.9mavg of 5 | 268.4Kavg of 5 |
| v56-w03-sub17 | 0/5 passed | 5 | 0 | 0.0% | Hard | Medium | Pagination | 47.3mavg of 5 | 9.2Mavg of 5 |
| v56-w03-sub18 | 0/5 passed | 5 | 0 | 0.0% | Hard | Medium | Error Recovery | 34.8mavg of 5 | 5.5Mavg of 5 |
| v56-w03-sub19 | 3/5 passed | 5 | 3 | 60.0% | Long-horizon | Medium | Authentication | 33.8mavg of 5 | 5.3Mavg of 5 |
| v56-w03-sub20 | 0/5 passed | 5 | 0 | 0.0% | Hard | Medium | Multi-step Workflow | 31.6mavg of 5 | 4.9Mavg of 5 |
| v56-w04-chain-1to02 | 0/5 passed | 5 | 0 | 0.0% | Long-horizon | Long | Pagination | 20.6mavg of 5 | 2.9Mavg of 5 |
| v56-w04-chain-1to03 | 0/5 passed | 5 | 0 | 0.0% | Long-horizon | Long | Discovery | 54.9mavg of 5 | 14.8Mavg of 5 |
| v56-w04-chain-1to04 | 1/5 passed | 5 | 1 | 20.0% | Hard + Long-horizon | Long | Error Recovery | 51.3mavg of 5 | 11.7Mavg of 5 |
| v56-w04-chain-1to05 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Pagination | 39.5mavg of 5 | 7.6Mavg of 5 |
| v56-w04-chain-1to06 | 1/5 passed | 5 | 1 | 20.0% | Hard + Long-horizon | Long | Discovery | 29.9mavg of 5 | 4.1Mavg of 5 |
| v56-w04-chain-1to07 | 2/5 passed | 5 | 2 | 40.0% | Hard + Long-horizon | Long | Multi-step Workflow | 39.3mavg of 5 | 8.7Mavg of 5 |
| v56-w04-chain-1to08 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Schema | 32.9mavg of 5 | 6.0Mavg of 5 |
| v56-w04-chain-1to09 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Authentication | 13.3mavg of 5 | 1.0Mavg of 5 |
| v56-w04-chain-1to10 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Error Recovery | 22.2mavg of 5 | 2.1Mavg of 5 |
| v56-w04-chain-1to11 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Discovery | 39.4mavg of 5 | 7.5Mavg of 5 |
| v56-w04-chain-1to12 | 2/5 passed | 5 | 2 | 40.0% | Hard + Long-horizon | Long | Pagination | 19.2mavg of 5 | 2.2Mavg of 5 |
| v56-w04-chain-1to13 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Pagination | 25.7mavg of 5 | 3.5Mavg of 5 |
| v56-w04-chain-1to14 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Authentication | 17.7mavg of 5 | 1.6Mavg of 5 |
| v56-w04-chain-1to15 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Discovery | 51.0mavg of 5 | 12.3Mavg of 5 |
| v56-w04-chain-1to16 | 1/5 passed | 5 | 1 | 20.0% | Hard + Long-horizon | Long | Authentication | 21.7mavg of 5 | 2.4Mavg of 5 |
| v56-w04-chain-1to17 | 1/5 passed | 5 | 1 | 20.0% | Hard + Long-horizon | Long | Discovery | 22.7mavg of 5 | 2.8Mavg of 5 |
| v56-w04-chain-1to18 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Authentication | 22.1mavg of 5 | 2.8Mavg of 5 |
| v56-w04-chain-1to19 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Authentication | 25.3mavg of 5 | 3.4Mavg of 5 |
| v56-w04-chain-1to20 | 1/5 passed | 5 | 1 | 20.0% | Hard + Long-horizon | Long | Error Recovery | 45.6mavg of 5 | 9.3Mavg of 5 |
| v56-w04-sub01 | 3/5 passed | 5 | 3 | 60.0% | Easy | Short | Authentication | 19.0mavg of 5 | 2.4Mavg of 5 |
| v56-w04-sub02 | 4/5 passed | 5 | 4 | 80.0% | Easy | Short | Pagination | 15.0mavg of 5 | 1.9Mavg of 5 |
| v56-w04-sub03 | 3/5 passed | 5 | 3 | 60.0% | Easy | Short | Discovery | 8.5mavg of 5 | 563.9Kavg of 5 |
| v56-w04-sub04 | 1/5 passed | 5 | 1 | 20.0% | Easy | Short | Error Recovery | 24.0mavg of 5 | 4.2Mavg of 5 |
| v56-w04-sub05 | 5/5 passed | 5 | 5 | 100.0% | Easy | Short | Pagination | 11.9mavg of 5 | 971.1Kavg of 5 |
| v56-w04-sub06 | 1/5 passed | 5 | 1 | 20.0% | Long-horizon | Medium | Discovery | 32.8mavg of 5 | 6.0Mavg of 5 |
| v56-w04-sub07 | 1/5 passed | 5 | 1 | 20.0% | Long-horizon | Medium | Multi-step Workflow | 24.3mavg of 5 | 3.3Mavg of 5 |
| v56-w04-sub08 | 2/5 passed | 5 | 2 | 40.0% | Easy | Short | Schema | 13.0mavg of 5 | 1.3Mavg of 5 |
| v56-w04-sub09 | 4/5 passed | 5 | 4 | 80.0% | Easy | Short | Authentication | 8.7mavg of 5 | 814.7Kavg of 5 |
| v56-w04-sub10 | 1/5 passed | 5 | 1 | 20.0% | Hard | Medium | Error Recovery | 29.9mavg of 5 | 4.6Mavg of 5 |
| v56-w04-sub11 | 2/5 passed | 5 | 2 | 40.0% | Easy | Short | Discovery | 20.7mavg of 5 | 3.2Mavg of 5 |
| v56-w04-sub12 | 4/5 passed | 5 | 4 | 80.0% | Easy | Short | Pagination | 5.6mavg of 5 | 297.8Kavg of 5 |
| v56-w04-sub13 | 4/5 passed | 5 | 4 | 80.0% | Easy | Short | Pagination | 14.4mavg of 5 | 1.7Mavg of 5 |
| v56-w04-sub14 | 0/5 passed | 5 | 0 | 0.0% | Hard | Medium | Authentication | 26.9mavg of 5 | 3.7Mavg of 5 |
| v56-w04-sub15 | 3/5 passed | 5 | 3 | 60.0% | Easy | Short | Discovery | 9.4mavg of 5 | 822.0Kavg of 5 |
| v56-w04-sub16 | 2/5 passed | 5 | 2 | 40.0% | Hard | Short | Authentication | 38.3mavg of 5 | 7.9Mavg of 5 |
| v56-w04-sub17 | 1/5 passed | 5 | 1 | 20.0% | Easy | Short | Discovery | 29.8mavg of 5 | 4.9Mavg of 5 |
| v56-w04-sub18 | 1/5 passed | 5 | 1 | 20.0% | Hard | Short | Authentication | 45.0mavg of 5 | 8.6Mavg of 5 |
| v56-w04-sub19 | 1/5 passed | 5 | 1 | 20.0% | Long-horizon | Medium | Authentication | 22.6mavg of 5 | 2.4Mavg of 5 |
| v56-w04-sub20 | 0/5 passed | 5 | 0 | 0.0% | Hard | Medium | Error Recovery | 46.1mavg of 5 | 10.0Mavg of 5 |
| v56-w05-chain-1to02 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Schema | 37.2mavg of 5 | 6.5Mavg of 5 |
| v56-w05-chain-1to03 | 2/5 passed | 5 | 2 | 40.0% | Hard + Long-horizon | Long | Statefulness | 40.8mavg of 5 | 8.7Mavg of 5 |
| v56-w05-chain-1to04 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Pagination | 29.0mavg of 5 | 4.2Mavg of 5 |
| v56-w05-chain-1to05 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Authentication | 25.1mavg of 5 | 3.4Mavg of 5 |
| v56-w05-chain-1to06 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Authentication | 34.1mavg of 5 | 5.8Mavg of 5 |
| v56-w05-chain-1to07 | 1/5 passed | 5 | 1 | 20.0% | Hard + Long-horizon | Long | Schema | 36.7mavg of 5 | 7.3Mavg of 5 |
| v56-w05-chain-1to08 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Statefulness | 30.1mavg of 5 | 3.8Mavg of 5 |
| v56-w05-chain-1to09 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Pagination | 41.8mavg of 5 | 7.1Mavg of 5 |
| v56-w05-chain-1to10 | 4/5 passed | 5 | 4 | 80.0% | Hard + Long-horizon | Long | Statefulness | 13.8mavg of 5 | 1.1Mavg of 5 |
| v56-w05-chain-1to11 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Schema | 29.2mavg of 5 | 3.0Mavg of 5 |
| v56-w05-chain-1to12 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Schema | 32.2mavg of 5 | 5.2Mavg of 5 |
| v56-w05-chain-1to13 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Discovery | 37.4mavg of 5 | 5.9Mavg of 5 |
| v56-w05-chain-1to14 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Pagination | 31.2mavg of 5 | 5.7Mavg of 5 |
| v56-w05-chain-1to15 | 3/5 passed | 5 | 3 | 60.0% | Hard + Long-horizon | Long | Schema | 23.3mavg of 5 | 3.7Mavg of 5 |
| v56-w05-chain-1to16 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Discovery | 38.7mavg of 5 | 7.5Mavg of 5 |
| v56-w05-chain-1to17 | 2/5 passed | 5 | 2 | 40.0% | Hard + Long-horizon | Long | Pagination | 27.3mavg of 5 | 4.1Mavg of 5 |
| v56-w05-chain-1to18 | 1/5 passed | 5 | 1 | 20.0% | Hard + Long-horizon | Long | Discovery | 26.6mavg of 5 | 3.2Mavg of 5 |
| v56-w05-chain-1to19 | 3/5 passed | 5 | 3 | 60.0% | Hard + Long-horizon | Long | Authentication | 12.0mavg of 5 | 823.4Kavg of 5 |
| v56-w05-chain-1to20 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Error Recovery | 45.2mavg of 5 | 9.8Mavg of 5 |
| v56-w05-sub01 | 0/5 passed | 5 | 0 | 0.0% | Hard | Medium | Statefulness | 39.7mavg of 5 | 9.1Mavg of 5 |
| v56-w05-sub02 | 3/5 passed | 5 | 3 | 60.0% | Hard | Short | Schema | 22.3mavg of 5 | 3.4Mavg of 5 |
| v56-w05-sub03 | 4/5 passed | 5 | 4 | 80.0% | Easy | Short | Statefulness | 18.2mavg of 5 | 3.3Mavg of 5 |
| v56-w05-sub04 | 0/5 passed | 5 | 0 | 0.0% | Easy | Short | Pagination | 35.1mavg of 5 | 6.1Mavg of 5 |
| v56-w05-sub05 | 3/5 passed | 5 | 3 | 60.0% | Hard | Short | Authentication | 24.7mavg of 5 | 4.4Mavg of 5 |
| v56-w05-sub06 | 0/5 passed | 5 | 0 | 0.0% | Hard | Medium | Authentication | 22.1mavg of 5 | 3.0Mavg of 5 |
| v56-w05-sub07 | 5/5 passed | 5 | 5 | 100.0% | Easy | Short | Schema | 3.9mavg of 5 | 122.4Kavg of 5 |
| v56-w05-sub08 | 0/5 passed | 5 | 0 | 0.0% | Hard | Medium | Statefulness | 24.8mavg of 5 | 6.1Mavg of 5 |
| v56-w05-sub09 | 5/5 passed | 5 | 5 | 100.0% | Easy | Short | Pagination | 5.2mavg of 5 | 199.5Kavg of 5 |
| v56-w05-sub10 | 3/5 passed | 5 | 3 | 60.0% | Easy | Short | Statefulness | 18.0mavg of 5 | 3.7Mavg of 5 |
| v56-w05-sub11 | 3/5 passed | 5 | 3 | 60.0% | Hard | Short | Schema | 13.5mavg of 5 | 1.5Mavg of 5 |
| v56-w05-sub12 | 1/5 passed | 5 | 1 | 20.0% | Hard | Short | Schema | 16.9mavg of 5 | 2.0Mavg of 5 |
| v56-w05-sub13 | 0/5 passed | 5 | 0 | 0.0% | Easy | Short | Discovery | 11.0mavg of 5 | 1.1Mavg of 5 |
| v56-w05-sub14 | 1/5 passed | 5 | 1 | 20.0% | Long-horizon | Medium | Pagination | 19.9mavg of 5 | 2.8Mavg of 5 |
| v56-w05-sub15 | 3/5 passed | 5 | 3 | 60.0% | Easy | Short | Schema | 15.3mavg of 5 | 2.2Mavg of 5 |
| v56-w05-sub16 | 2/5 passed | 5 | 2 | 40.0% | Easy | Short | Discovery | 9.6mavg of 5 | 1.1Mavg of 5 |
| v56-w05-sub17 | 5/5 passed | 5 | 5 | 100.0% | Easy | Short | Pagination | 6.0mavg of 5 | 400.3Kavg of 5 |
| v56-w05-sub18 | 4/5 passed | 5 | 4 | 80.0% | Easy | Short | Discovery | 10.9mavg of 5 | 1.8Mavg of 5 |
| v56-w05-sub19 | 2/5 passed | 5 | 2 | 40.0% | Easy | Short | Authentication | 26.6mavg of 5 | 5.3Mavg of 5 |
| v56-w05-sub20 | 1/5 passed | 5 | 1 | 20.0% | Hard | Short | Error Recovery | 31.0mavg of 5 | 5.6Mavg of 5 |
| v56-w06-chain-1to02 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Multi-step Workflow | 36.3mavg of 5 | 9.0Mavg of 5 |
| v56-w06-chain-1to03 | 1/5 passed | 5 | 1 | 20.0% | Hard + Long-horizon | Long | Authentication | 23.2mavg of 5 | 4.8Mavg of 5 |
| v56-w06-chain-1to04 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Statefulness | 23.3mavg of 5 | 3.9Mavg of 5 |
| v56-w06-chain-1to05 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Statefulness | 31.3mavg of 5 | 6.1Mavg of 5 |
| v56-w06-sub01 | 1/5 passed | 5 | 1 | 20.0% | Hard | Medium | Error Recovery | 22.8mavg of 5 | 4.4Mavg of 5 |
| v56-w06-sub02 | 4/5 passed | 5 | 4 | 80.0% | Hard | Short | Multi-step Workflow | 21.0mavg of 5 | 3.0Mavg of 5 |
| v56-w06-sub03 | 1/5 passed | 5 | 1 | 20.0% | Long-horizon | Medium | Authentication | 8.5mavg of 5 | 729.9Kavg of 5 |
| v56-w06-sub04 | 2/5 passed | 5 | 2 | 40.0% | Hard | Short | Statefulness | 28.4mavg of 5 | 4.3Mavg of 5 |
| v56-w06-sub05 | 5/5 passed | 5 | 5 | 100.0% | Hard | Short | Statefulness | 5.4mavg of 5 | 440.0Kavg of 5 |
| v56-w06-sub06 | 0/5 passed | 5 | 0 | 0.0% | — | — | Pagination | 39.6mavg of 5 | 9.6Mavg of 5 |
| v56-w08-chain-1to02 | 2/5 passed | 5 | 2 | 40.0% | Long-horizon | Long | Error Recovery | 16.6mavg of 5 | 2.0Mavg of 5 |
| v56-w08-chain-1to03 | 0/5 passed | 5 | 0 | 0.0% | Long-horizon | Long | Pagination | 12.2mavg of 5 | 1.4Mavg of 5 |
| v56-w08-chain-1to04 | 3/5 passed | 5 | 3 | 60.0% | Long-horizon | Long | Authentication | 9.8mavg of 5 | 836.8Kavg of 5 |
| v56-w08-chain-1to05 | 3/5 passed | 5 | 3 | 60.0% | Long-horizon | Long | Error Recovery | 14.6mavg of 5 | 2.2Mavg of 5 |
| v56-w08-chain-1to06 | 3/5 passed | 5 | 3 | 60.0% | Long-horizon | Long | Multi-step Workflow | 20.6mavg of 5 | 2.9Mavg of 5 |
| v56-w08-chain-1to07 | 1/5 passed | 5 | 1 | 20.0% | Hard + Long-horizon | Long | Error Recovery | 24.4mavg of 5 | 3.2Mavg of 5 |
| v56-w08-chain-1to08 | 1/5 passed | 5 | 1 | 20.0% | Hard + Long-horizon | Long | Schema | 18.3mavg of 5 | 1.9Mavg of 5 |
| v56-w08-chain-1to09 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Multi-step Workflow | 36.6mavg of 5 | 5.5Mavg of 5 |
| v56-w08-chain-1to10 | 1/5 passed | 5 | 1 | 20.0% | Hard + Long-horizon | Long | Discovery | 21.4mavg of 5 | 2.3Mavg of 5 |
| v56-w08-chain-1to11 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Multi-step Workflow | 32.2mavg of 5 | 6.2Mavg of 5 |
| v56-w08-chain-1to12 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Schema | 36.3mavg of 5 | 5.4Mavg of 5 |
| v56-w08-chain-1to13 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Discovery | 10.5mavg of 5 | 955.4Kavg of 5 |
| v56-w08-chain-1to14 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Discovery | 25.3mavg of 5 | 3.8Mavg of 5 |
| v56-w08-chain-1to15 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Discovery | 20.1mavg of 5 | 2.7Mavg of 5 |
| v56-w08-chain-1to16 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Error Recovery | 27.7mavg of 5 | 4.9Mavg of 5 |
| v56-w08-chain-1to17 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Pagination | 18.2mavg of 5 | 2.3Mavg of 5 |
| v56-w08-chain-1to18 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Schema | 20.0mavg of 5 | 2.5Mavg of 5 |
| v56-w08-chain-1to19 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Discovery | 27.5mavg of 5 | 4.0Mavg of 5 |
| v56-w08-chain-1to20 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Authentication | 19.4mavg of 5 | 2.3Mavg of 5 |
| v56-w08-sub01 | 1/5 passed | 5 | 1 | 20.0% | Easy | Short | Discovery | 23.9mavg of 5 | 3.4Mavg of 5 |
| v56-w08-sub02 | 5/5 passed | 5 | 5 | 100.0% | Easy | Medium | Error Recovery | 10.6mavg of 5 | 846.9Kavg of 5 |
| v56-w08-sub03 | 2/5 passed | 5 | 2 | 40.0% | Easy | Short | Pagination | 15.5mavg of 5 | 1.7Mavg of 5 |
| v56-w08-sub04 | 2/5 passed | 5 | 2 | 40.0% | Easy | Short | Authentication | 14.2mavg of 5 | 1.4Mavg of 5 |
| v56-w08-sub05 | 4/5 passed | 5 | 4 | 80.0% | Easy | Short | Error Recovery | 12.0mavg of 5 | 1.6Mavg of 5 |
| v56-w08-sub06 | 5/5 passed | 5 | 5 | 100.0% | Easy | Short | Multi-step Workflow | 8.4mavg of 5 | 768.6Kavg of 5 |
| v56-w08-sub07 | 3/5 passed | 5 | 3 | 60.0% | Hard | Short | Error Recovery | 12.5mavg of 5 | 1.2Mavg of 5 |
| v56-w08-sub08 | 4/5 passed | 5 | 4 | 80.0% | Hard | Short | Schema | 12.7mavg of 5 | 1.4Mavg of 5 |
| v56-w08-sub09 | 4/5 passed | 5 | 4 | 80.0% | Long-horizon | Medium | Multi-step Workflow | 19.6mavg of 5 | 2.7Mavg of 5 |
| v56-w08-sub10 | 3/5 passed | 5 | 3 | 60.0% | Hard | Short | Discovery | 10.3mavg of 5 | 818.5Kavg of 5 |
| v56-w08-sub11 | 5/5 passed | 5 | 5 | 100.0% | Hard | Short | Multi-step Workflow | 9.4mavg of 5 | 841.4Kavg of 5 |
| v56-w08-sub12 | 5/5 passed | 5 | 5 | 100.0% | Hard | Short | Schema | 6.3mavg of 5 | 431.3Kavg of 5 |
| v56-w08-sub13 | 4/5 passed | 5 | 4 | 80.0% | Easy | Short | Discovery | 13.0mavg of 5 | 1.5Mavg of 5 |
| v56-w08-sub14 | 3/5 passed | 5 | 3 | 60.0% | Hard | Short | Discovery | 24.6mavg of 5 | 3.7Mavg of 5 |
| v56-w08-sub15 | 4/5 passed | 5 | 4 | 80.0% | Easy | Short | Discovery | 15.8mavg of 5 | 2.5Mavg of 5 |
| v56-w08-sub16 | 5/5 passed | 5 | 5 | 100.0% | Hard | Medium | Error Recovery | 6.7mavg of 5 | 394.4Kavg of 5 |
| v56-w08-sub17 | 3/5 passed | 5 | 3 | 60.0% | Hard | Short | Pagination | 9.8mavg of 5 | 1.0Mavg of 5 |
| v56-w08-sub18 | 4/5 passed | 5 | 4 | 80.0% | Hard | Short | Schema | 10.4mavg of 5 | 1.2Mavg of 5 |
| v56-w08-sub19 | 3/5 passed | 5 | 3 | 60.0% | Easy | Short | Discovery | 9.8mavg of 5 | 953.2Kavg of 5 |
| v56-w08-sub20 | 3/5 passed | 5 | 3 | 60.0% | Easy | Short | Authentication | 21.8mavg of 5 | 5.4Mavg of 5 |
| v56-w10-chain-1to02 | 2/5 passed | 5 | 2 | 40.0% | Hard + Long-horizon | Long | Pagination | 26.1mavg of 5 | 3.7Mavg of 5 |
| v56-w10-chain-1to03 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Pagination | 72.3mavg of 5 | 16.7Mavg of 5 |
| v56-w10-chain-1to04 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Statefulness | 48.3mavg of 5 | 8.5Mavg of 5 |
| v56-w10-chain-1to05 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Multi-step Workflow | 25.8mavg of 5 | 3.8Mavg of 5 |
| v56-w10-chain-1to06 | 2/5 passed | 5 | 2 | 40.0% | Hard + Long-horizon | Long | Multi-step Workflow | 22.5mavg of 5 | 2.4Mavg of 5 |
| v56-w10-chain-1to07 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Multi-step Workflow | 63.5mavg of 5 | 13.1Mavg of 5 |
| v56-w10-chain-1to08 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Error Recovery | 47.2mavg of 5 | 7.3Mavg of 5 |
| v56-w10-chain-1to09 | 1/5 passed | 5 | 1 | 20.0% | Hard + Long-horizon | Long | Schema | 40.7mavg of 5 | 5.8Mavg of 5 |
| v56-w10-chain-1to10 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Error Recovery | 16.4mavg of 5 | 1.4Mavg of 5 |
| v56-w10-chain-1to11 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Statefulness | 34.7mavg of 5 | 4.4Mavg of 5 |
| v56-w10-chain-1to12 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Error Recovery | 24.8mavg of 5 | 2.2Mavg of 5 |
| v56-w10-chain-1to13 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Authentication | 40.2mavg of 5 | 6.6Mavg of 5 |
| v56-w10-chain-1to14 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Statefulness | 32.8mavg of 5 | 4.4Mavg of 5 |
| v56-w10-chain-1to15 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Multi-step Workflow | 33.2mavg of 5 | 4.0Mavg of 5 |
| v56-w10-chain-1to16 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Statefulness | 32.6mavg of 5 | 4.3Mavg of 5 |
| v56-w10-chain-1to17 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Schema | 39.3mavg of 5 | 6.1Mavg of 5 |
| v56-w10-chain-1to18 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Error Recovery | 10.2mavg of 5 | 832.3Kavg of 5 |
| v56-w10-chain-1to19 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Authentication | 39.8mavg of 5 | 5.2Mavg of 5 |
| v56-w10-chain-1to20 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Authentication | 30.0mavg of 5 | 3.7Mavg of 5 |
| v56-w10-sub01 | 0/5 passed | 5 | 0 | 0.0% | Long-horizon | Long | Multi-step Workflow | 61.8mavg of 5 | 11.6Mavg of 5 |
| v56-w10-sub02 | 2/5 passed | 5 | 2 | 40.0% | Long-horizon | Medium | Pagination | 32.7mavg of 5 | 4.7Mavg of 5 |
| v56-w10-sub03 | 1/5 passed | 5 | 1 | 20.0% | Easy | Short | Pagination | 42.0mavg of 5 | 7.9Mavg of 5 |
| v56-w10-sub04 | 2/5 passed | 5 | 2 | 40.0% | Long-horizon | Medium | Statefulness | 45.4mavg of 5 | 6.4Mavg of 5 |
| v56-w10-sub05 | 1/5 passed | 5 | 1 | 20.0% | Hard | Medium | Multi-step Workflow | 39.3mavg of 5 | 5.4Mavg of 5 |
| v56-w10-sub06 | 1/5 passed | 5 | 1 | 20.0% | Easy | Short | Multi-step Workflow | 32.2mavg of 5 | 3.7Mavg of 5 |
| v56-w10-sub07 | 0/5 passed | 5 | 0 | 0.0% | Hard | Medium | Multi-step Workflow | 47.1mavg of 5 | 7.7Mavg of 5 |
| v56-w10-sub08 | 2/5 passed | 5 | 2 | 40.0% | Hard | Medium | Error Recovery | 26.3mavg of 5 | 2.7Mavg of 5 |
| v56-w10-sub09 | 0/5 passed | 5 | 0 | 0.0% | Hard | Medium | Schema | 44.8mavg of 5 | 8.2Mavg of 5 |
| v56-w10-sub10 | 5/5 passed | 5 | 5 | 100.0% | Easy | Short | Error Recovery | 6.9mavg of 5 | 302.1Kavg of 5 |
| v56-w10-sub11 | 3/5 passed | 5 | 3 | 60.0% | Easy | Short | Statefulness | 16.9mavg of 5 | 2.1Mavg of 5 |
| v56-w10-sub12 | 4/5 passed | 5 | 4 | 80.0% | Easy | Short | Error Recovery | 20.6mavg of 5 | 1.8Mavg of 5 |
| v56-w10-sub13 | 4/5 passed | 5 | 4 | 80.0% | Easy | Short | Authentication | 12.0mavg of 5 | 904.6Kavg of 5 |
| v56-w10-sub14 | 2/5 passed | 5 | 2 | 40.0% | Long-horizon | Medium | Statefulness | 42.5mavg of 5 | 5.9Mavg of 5 |
| v56-w10-sub15 | 0/5 passed | 5 | 0 | 0.0% | Long-horizon | Medium | Multi-step Workflow | 60.3mavg of 5 | 12.4Mavg of 5 |
| v56-w10-sub16 | 3/5 passed | 5 | 3 | 60.0% | Easy | Short | Statefulness | 19.4mavg of 5 | 2.7Mavg of 5 |
| v56-w10-sub17 | 4/5 passed | 5 | 4 | 80.0% | Easy | Short | Schema | 7.0mavg of 5 | 350.2Kavg of 5 |
| v56-w10-sub18 | 3/5 passed | 5 | 3 | 60.0% | Easy | Short | Error Recovery | 9.1mavg of 5 | 481.1Kavg of 5 |
| v56-w10-sub19 | 2/5 passed | 5 | 2 | 40.0% | Long-horizon | Medium | Authentication | 20.2mavg of 5 | 1.9Mavg of 5 |
| v56-w10-sub20 | 5/5 passed | 5 | 5 | 100.0% | Easy | Short | Authentication | 13.8mavg of 5 | 994.1Kavg of 5 |
| v56-w11-chain-1to02 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Discovery | 34.2mavg of 5 | 4.9Mavg of 5 |
| v56-w11-chain-1to03 | 2/5 passed | 5 | 2 | 40.0% | Hard + Long-horizon | Long | Schema | 34.0mavg of 5 | 4.2Mavg of 5 |
| v56-w11-chain-1to04 | 1/5 passed | 5 | 1 | 20.0% | Hard + Long-horizon | Long | Multi-step Workflow | 38.8mavg of 5 | 6.5Mavg of 5 |
| v56-w11-chain-1to05 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Discovery | 50.0mavg of 5 | 8.9Mavg of 5 |
| v56-w11-chain-1to06 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Multi-step Workflow | 51.0mavg of 5 | 9.5Mavg of 5 |
| v56-w11-chain-1to07 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Multi-step Workflow | 35.5mavg of 5 | 5.1Mavg of 5 |
| v56-w11-chain-1to08 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Statefulness | 40.6mavg of 5 | 5.2Mavg of 5 |
| v56-w11-chain-1to09 | 1/5 passed | 5 | 1 | 20.0% | Hard + Long-horizon | Long | Pagination | 57.2mavg of 5 | 11.3Mavg of 5 |
| v56-w11-chain-1to10 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Discovery | 31.9mavg of 5 | 5.3Mavg of 5 |
| v56-w11-chain-1to11 | 1/5 passed | 5 | 1 | 20.0% | Hard + Long-horizon | Long | Error Recovery | 36.5mavg of 5 | 5.7Mavg of 5 |
| v56-w11-chain-1to12 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Discovery | 35.7mavg of 5 | 4.2Mavg of 5 |
| v56-w11-chain-1to13 | 2/5 passed | 5 | 2 | 40.0% | Hard + Long-horizon | Long | Error Recovery | 24.5mavg of 5 | 2.3Mavg of 5 |
| v56-w11-chain-1to14 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Multi-step Workflow | 47.8mavg of 5 | 7.4Mavg of 5 |
| v56-w11-chain-1to15 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Statefulness | 42.5mavg of 5 | 6.6Mavg of 5 |
| v56-w11-chain-1to16 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Discovery | 26.4mavg of 5 | 2.0Mavg of 5 |
| v56-w11-chain-1to17 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Discovery | 35.9mavg of 5 | 4.6Mavg of 5 |
| v56-w11-chain-1to18 | 1/5 passed | 5 | 1 | 20.0% | Hard + Long-horizon | Long | Error Recovery | 30.0mavg of 5 | 4.0Mavg of 5 |
| v56-w11-chain-1to19 | 2/5 passed | 5 | 2 | 40.0% | Hard + Long-horizon | Long | Multi-step Workflow | 33.4mavg of 5 | 4.0Mavg of 5 |
| v56-w11-chain-1to20 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Multi-step Workflow | 31.6mavg of 5 | 4.3Mavg of 5 |
| v56-w11-sub01 | 1/5 passed | 5 | 1 | 20.0% | Hard | Medium | Pagination | 43.6mavg of 5 | 7.1Mavg of 5 |
| v56-w11-sub02 | 1/5 passed | 5 | 1 | 20.0% | Long-horizon | Medium | Discovery | 28.0mavg of 5 | 3.4Mavg of 5 |
| v56-w11-sub03 | 2/5 passed | 5 | 2 | 40.0% | Hard | Medium | Schema | 28.0mavg of 5 | 3.6Mavg of 5 |
| v56-w11-sub04 | 0/5 passed | 5 | 0 | 0.0% | Long-horizon | Medium | Multi-step Workflow | 21.9mavg of 5 | 2.1Mavg of 5 |
| v56-w11-sub05 | 2/5 passed | 5 | 2 | 40.0% | Long-horizon | Medium | Discovery | 30.7mavg of 5 | 3.6Mavg of 5 |
| v56-w11-sub06 | 2/5 passed | 5 | 2 | 40.0% | Long-horizon | Medium | Multi-step Workflow | 25.6mavg of 5 | 3.3Mavg of 5 |
| v56-w11-sub07 | 0/5 passed | 5 | 0 | 0.0% | Long-horizon | Medium | Multi-step Workflow | 30.0mavg of 5 | 4.4Mavg of 5 |
| v56-w11-sub08 | 0/5 passed | 5 | 0 | 0.0% | Long-horizon | Long | Statefulness | 48.0mavg of 5 | 9.0Mavg of 5 |
| v56-w11-sub09 | 1/5 passed | 5 | 1 | 20.0% | Long-horizon | Medium | Pagination | 43.1mavg of 5 | 6.9Mavg of 5 |
| v56-w11-sub10 | 0/5 passed | 5 | 0 | 0.0% | Long-horizon | Medium | Discovery | 52.1mavg of 5 | 13.3Mavg of 5 |
| v56-w11-sub11 | 5/5 passed | 5 | 5 | 100.0% | Long-horizon | Medium | Error Recovery | 10.9mavg of 5 | 780.6Kavg of 5 |
| v56-w11-sub12 | 3/5 passed | 5 | 3 | 60.0% | Easy | Short | Discovery | 26.1mavg of 5 | 3.8Mavg of 5 |
| v56-w11-sub13 | 3/5 passed | 5 | 3 | 60.0% | Easy | Short | Error Recovery | 15.2mavg of 5 | 1.9Mavg of 5 |
| v56-w11-sub14 | 3/5 passed | 5 | 3 | 60.0% | Long-horizon | Medium | Multi-step Workflow | 32.3mavg of 5 | 5.0Mavg of 5 |
| v56-w11-sub15 | 1/5 passed | 5 | 1 | 20.0% | Long-horizon | Medium | Statefulness | 36.7mavg of 5 | 7.0Mavg of 5 |
| v56-w11-sub16 | 2/5 passed | 5 | 2 | 40.0% | Long-horizon | Medium | Discovery | 30.6mavg of 5 | 5.5Mavg of 5 |
| v56-w11-sub17 | 0/5 passed | 5 | 0 | 0.0% | Long-horizon | Medium | Discovery | 39.9mavg of 5 | 7.1Mavg of 5 |
| v56-w11-sub18 | 3/5 passed | 5 | 3 | 60.0% | Long-horizon | Medium | Error Recovery | 18.7mavg of 5 | 1.9Mavg of 5 |
| v56-w11-sub19 | 3/5 passed | 5 | 3 | 60.0% | Hard | Short | Multi-step Workflow | 21.7mavg of 5 | 3.5Mavg of 5 |
| v56-w11-sub20 | 0/5 passed | 5 | 0 | 0.0% | Hard | Medium | Multi-step Workflow | 46.2mavg of 5 | 11.5Mavg of 5 |
| v56-w13-chain-1to02 | 1/5 passed | 5 | 1 | 20.0% | Hard + Long-horizon | Long | Error Recovery | 23.7mavg of 5 | 2.9Mavg of 5 |
| v56-w13-chain-1to03 | 4/5 passed | 5 | 4 | 80.0% | Hard + Long-horizon | Long | Pagination | 13.9mavg of 5 | 898.3Kavg of 5 |
| v56-w13-chain-1to04 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Pagination | 40.6mavg of 5 | 8.4Mavg of 5 |
| v56-w13-chain-1to05 | 2/5 passed | 5 | 2 | 40.0% | Hard + Long-horizon | Long | Error Recovery | 24.1mavg of 5 | 4.2Mavg of 5 |
| v56-w13-chain-1to06 | 5/5 passed | 5 | 5 | 100.0% | Hard + Long-horizon | Long | Schema | 11.2mavg of 5 | 963.4Kavg of 5 |
| v56-w13-chain-1to07 | 3/5 passed | 5 | 3 | 60.0% | Hard + Long-horizon | Long | Authentication | 20.0mavg of 5 | 2.6Mavg of 5 |
| v56-w13-chain-1to08 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Multi-step Workflow | 22.8mavg of 5 | 3.3Mavg of 5 |
| v56-w13-chain-1to09 | 1/5 passed | 5 | 1 | 20.0% | Hard + Long-horizon | Long | Statefulness | 21.3mavg of 5 | 2.9Mavg of 5 |
| v56-w13-chain-1to10 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Schema | 25.4mavg of 5 | 4.7Mavg of 5 |
| v56-w13-chain-1to11 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Discovery | 44.9mavg of 5 | 9.8Mavg of 5 |
| v56-w13-chain-1to12 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Multi-step Workflow | 31.1mavg of 5 | 5.9Mavg of 5 |
| v56-w13-chain-1to13 | 2/5 passed | 5 | 2 | 40.0% | Hard + Long-horizon | Long | Authentication | 17.9mavg of 5 | 2.1Mavg of 5 |
| v56-w13-chain-1to14 | 3/5 passed | 5 | 3 | 60.0% | Hard + Long-horizon | Long | Pagination | 23.1mavg of 5 | 3.8Mavg of 5 |
| v56-w13-chain-1to15 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Authentication | 35.6mavg of 5 | 7.1Mavg of 5 |
| v56-w13-chain-1to16 | 2/5 passed | 5 | 2 | 40.0% | Hard + Long-horizon | Long | Schema | 20.6mavg of 5 | 3.5Mavg of 5 |
| v56-w13-chain-1to17 | 1/5 passed | 5 | 1 | 20.0% | Hard + Long-horizon | Long | Discovery | 16.9mavg of 5 | 2.3Mavg of 5 |
| v56-w13-chain-1to18 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Statefulness | 24.7mavg of 5 | 3.2Mavg of 5 |
| v56-w13-chain-1to19 | 1/5 passed | 5 | 1 | 20.0% | Hard + Long-horizon | Long | Schema | 24.1mavg of 5 | 4.4Mavg of 5 |
| v56-w13-chain-1to20 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Multi-step Workflow | 29.7mavg of 5 | 5.5Mavg of 5 |
| v56-w13-sub01 | 1/5 passed | 5 | 1 | 20.0% | Hard | Medium | Authentication | 38.8mavg of 5 | 7.8Mavg of 5 |
| v56-w13-sub02 | 3/5 passed | 5 | 3 | 60.0% | Hard | Short | Error Recovery | 17.8mavg of 5 | 2.9Mavg of 5 |
| v56-w13-sub03 | 2/5 passed | 5 | 2 | 40.0% | Easy | Short | Pagination | 12.2mavg of 5 | 2.4Mavg of 5 |
| v56-w13-sub04 | 4/5 passed | 5 | 4 | 80.0% | Easy | Short | Pagination | 22.7mavg of 5 | 3.2Mavg of 5 |
| v56-w13-sub05 | 2/5 passed | 5 | 2 | 40.0% | Long-horizon | Medium | Error Recovery | 21.6mavg of 5 | 3.0Mavg of 5 |
| v56-w13-sub06 | 5/5 passed | 5 | 5 | 100.0% | Hard | Short | Schema | 13.3mavg of 5 | 1.3Mavg of 5 |
| v56-w13-sub07 | 1/5 passed | 5 | 1 | 20.0% | Easy | Short | Authentication | 18.9mavg of 5 | 2.4Mavg of 5 |
| v56-w13-sub08 | 2/5 passed | 5 | 2 | 40.0% | Long-horizon | Medium | Multi-step Workflow | 16.5mavg of 5 | 1.9Mavg of 5 |
| v56-w13-sub09 | 3/5 passed | 5 | 3 | 60.0% | Hard | Short | Statefulness | 14.7mavg of 5 | 1.4Mavg of 5 |
| v56-w13-sub10 | 5/5 passed | 5 | 5 | 100.0% | Easy | Short | Schema | 3.7mavg of 5 | 150.3Kavg of 5 |
| v56-w13-sub11 | 1/5 passed | 5 | 1 | 20.0% | Easy | Short | Discovery | 9.1mavg of 5 | 589.7Kavg of 5 |
| v56-w13-sub12 | 1/5 passed | 5 | 1 | 20.0% | Long-horizon | Medium | Multi-step Workflow | 19.5mavg of 5 | 2.5Mavg of 5 |
| v56-w13-sub13 | 2/5 passed | 5 | 2 | 40.0% | Easy | Short | Authentication | 18.5mavg of 5 | 2.9Mavg of 5 |
| v56-w13-sub14 | 3/5 passed | 5 | 3 | 60.0% | Easy | Short | Pagination | 15.3mavg of 5 | 2.5Mavg of 5 |
| v56-w13-sub15 | 4/5 passed | 5 | 4 | 80.0% | Easy | Short | Authentication | 8.9mavg of 5 | 805.3Kavg of 5 |
| v56-w13-sub16 | 4/5 passed | 5 | 4 | 80.0% | Easy | Short | Schema | 10.2mavg of 5 | 817.2Kavg of 5 |
| v56-w13-sub17 | 3/5 passed | 5 | 3 | 60.0% | Easy | Short | Discovery | 16.4mavg of 5 | 2.4Mavg of 5 |
| v56-w13-sub18 | 2/5 passed | 5 | 2 | 40.0% | Long-horizon | Medium | Statefulness | 23.8mavg of 5 | 3.8Mavg of 5 |
| v56-w13-sub19 | 4/5 passed | 5 | 4 | 80.0% | Hard | Short | Schema | 10.7mavg of 5 | 1.0Mavg of 5 |
| v56-w13-sub20 | 1/5 passed | 5 | 1 | 20.0% | Hard | Medium | Multi-step Workflow | 31.7mavg of 5 | 6.3Mavg of 5 |
| v56-w14-chain-1to02 | 1/5 passed | 5 | 1 | 20.0% | Hard | Long | Statefulness | 40.1mavg of 5 | 7.9Mavg of 5 |
| v56-w14-chain-1to03 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Authentication | 24.3mavg of 5 | 3.4Mavg of 5 |
| v56-w14-chain-1to04 | 2/5 passed | 5 | 2 | 40.0% | Hard + Long-horizon | Long | Schema | 18.0mavg of 5 | 2.7Mavg of 5 |
| v56-w14-chain-1to05 | 3/5 passed | 5 | 3 | 60.0% | Hard + Long-horizon | Long | Error Recovery | 37.4mavg of 5 | 7.7Mavg of 5 |
| v56-w14-chain-1to06 | 3/5 passed | 5 | 3 | 60.0% | Hard + Long-horizon | Long | Discovery | 18.6mavg of 5 | 2.0Mavg of 5 |
| v56-w14-chain-1to07 | 1/5 passed | 5 | 1 | 20.0% | Hard + Long-horizon | Long | Error Recovery | 21.0mavg of 5 | 2.9Mavg of 5 |
| v56-w14-chain-1to08 | 1/5 passed | 5 | 1 | 20.0% | Hard + Long-horizon | Long | Statefulness | 21.5mavg of 5 | 2.6Mavg of 5 |
| v56-w14-chain-1to09 | 2/5 passed | 5 | 2 | 40.0% | Hard + Long-horizon | Long | Authentication | 15.5mavg of 5 | 1.7Mavg of 5 |
| v56-w14-chain-1to10 | 4/5 passed | 5 | 4 | 80.0% | Hard + Long-horizon | Long | Discovery | 12.7mavg of 5 | 1.5Mavg of 5 |
| v56-w14-chain-1to11 | 1/5 passed | 5 | 1 | 20.0% | Hard + Long-horizon | Long | Statefulness | 33.9mavg of 5 | 5.5Mavg of 5 |
| v56-w14-chain-1to12 | 2/5 passed | 5 | 2 | 40.0% | Hard + Long-horizon | Long | Statefulness | 32.0mavg of 5 | 7.5Mavg of 5 |
| v56-w14-chain-1to13 | 1/5 passed | 5 | 1 | 20.0% | Hard + Long-horizon | Long | Error Recovery | 22.0mavg of 5 | 2.3Mavg of 5 |
| v56-w14-chain-1to14 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Statefulness | 32.2mavg of 5 | 5.6Mavg of 5 |
| v56-w14-chain-1to15 | 3/5 passed | 5 | 3 | 60.0% | Hard + Long-horizon | Long | Schema | 21.6mavg of 5 | 2.6Mavg of 5 |
| v56-w14-chain-1to16 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Statefulness | 37.4mavg of 5 | 5.9Mavg of 5 |
| v56-w14-chain-1to17 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Authentication | 41.0mavg of 5 | 7.6Mavg of 5 |
| v56-w14-chain-1to18 | 2/5 passed | 5 | 2 | 40.0% | Hard + Long-horizon | Long | Statefulness | 33.3mavg of 5 | 6.3Mavg of 5 |
| v56-w14-chain-1to19 | 2/5 passed | 5 | 2 | 40.0% | Hard + Long-horizon | Long | Pagination | 25.1mavg of 5 | 4.2Mavg of 5 |
| v56-w14-chain-1to20 | 1/5 passed | 5 | 1 | 20.0% | Hard + Long-horizon | Long | Pagination | 33.0mavg of 5 | 5.0Mavg of 5 |
| v56-w14-sub01 | 0/5 passed | 5 | 0 | 0.0% | Hard | Medium | Discovery | 27.0mavg of 5 | 4.0Mavg of 5 |
| v56-w14-sub02 | 0/5 passed | 5 | 0 | 0.0% | Easy | Short | Statefulness | 18.2mavg of 5 | 2.0Mavg of 5 |
| v56-w14-sub03 | 0/5 passed | 5 | 0 | 0.0% | Hard | Medium | Authentication | 35.6mavg of 5 | 8.3Mavg of 5 |
| v56-w14-sub04 | 2/5 passed | 5 | 2 | 40.0% | Easy | Medium | Schema | 19.9mavg of 5 | 2.2Mavg of 5 |
| v56-w14-sub05 | 4/5 passed | 5 | 4 | 80.0% | Easy | Short | Error Recovery | 10.1mavg of 5 | 819.9Kavg of 5 |
| v56-w14-sub06 | 3/5 passed | 5 | 3 | 60.0% | Easy | Short | Discovery | 15.3mavg of 5 | 2.4Mavg of 5 |
| v56-w14-sub07 | 4/5 passed | 5 | 4 | 80.0% | Long-horizon | Medium | Error Recovery | 7.3mavg of 5 | 411.9Kavg of 5 |
| v56-w14-sub08 | 2/5 passed | 5 | 2 | 40.0% | Easy | Short | Statefulness | 16.3mavg of 5 | 1.6Mavg of 5 |
| v56-w14-sub09 | 0/5 passed | 5 | 0 | 0.0% | Easy | Short | Authentication | 23.7mavg of 5 | 2.9Mavg of 5 |
| v56-w14-sub10 | 4/5 passed | 5 | 4 | 80.0% | Easy | Short | Discovery | 16.4mavg of 5 | 1.5Mavg of 5 |
| v56-w14-sub11 | 4/5 passed | 5 | 4 | 80.0% | Easy | Short | Statefulness | 6.5mavg of 5 | 302.3Kavg of 5 |
| v56-w14-sub12 | 2/5 passed | 5 | 2 | 40.0% | Long-horizon | Medium | Statefulness | 14.5mavg of 5 | 1.4Mavg of 5 |
| v56-w14-sub13 | 3/5 passed | 5 | 3 | 60.0% | Hard | Short | Error Recovery | 20.0mavg of 5 | 2.5Mavg of 5 |
| v56-w14-sub14 | 3/5 passed | 5 | 3 | 60.0% | Long-horizon | Short | Statefulness | 22.0mavg of 5 | 3.2Mavg of 5 |
| v56-w14-sub15 | 2/5 passed | 5 | 2 | 40.0% | Easy | Short | Schema | 23.2mavg of 5 | 3.0Mavg of 5 |
| v56-w14-sub16 | 2/5 passed | 5 | 2 | 40.0% | Long-horizon | Medium | Statefulness | 20.9mavg of 5 | 2.8Mavg of 5 |
| v56-w14-sub17 | 0/5 passed | 5 | 0 | 0.0% | Hard | Short | Authentication | 28.4mavg of 5 | 4.0Mavg of 5 |
| v56-w14-sub18 | 5/5 passed | 5 | 5 | 100.0% | Long-horizon | Short | Statefulness | 9.0mavg of 5 | 718.8Kavg of 5 |
| v56-w14-sub19 | 2/5 passed | 5 | 2 | 40.0% | Easy | Short | Pagination | 23.6mavg of 5 | 3.4Mavg of 5 |
| v56-w14-sub20 | 3/5 passed | 5 | 3 | 60.0% | Easy | Short | Pagination | 25.8mavg of 5 | 3.4Mavg of 5 |
| v56-w16-chain-1to02 | 1/5 passed | 5 | 1 | 20.0% | Long-horizon | Long | Discovery | 30.1mavg of 5 | 4.2Mavg of 5 |
| v56-w16-chain-1to03 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Error Recovery | 42.6mavg of 5 | 7.8Mavg of 5 |
| v56-w16-chain-1to04 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Discovery | 26.1mavg of 5 | 3.9Mavg of 5 |
| v56-w16-chain-1to05 | 1/5 passed | 5 | 1 | 20.0% | Hard + Long-horizon | Long | Error Recovery | 38.5mavg of 5 | 6.1Mavg of 5 |
| v56-w16-chain-1to06 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Multi-step Workflow | 36.6mavg of 5 | 6.6Mavg of 5 |
| v56-w16-chain-1to07 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Multi-step Workflow | 27.4mavg of 5 | 3.9Mavg of 5 |
| v56-w16-chain-1to08 | 2/5 passed | 5 | 2 | 40.0% | Hard + Long-horizon | Long | Authentication | 18.8mavg of 5 | 1.9Mavg of 5 |
| v56-w16-chain-1to09 | 4/5 passed | 5 | 4 | 80.0% | Hard + Long-horizon | Long | Multi-step Workflow | 26.5mavg of 5 | 3.2Mavg of 5 |
| v56-w16-chain-1to10 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Authentication | 16.2mavg of 5 | 2.0Mavg of 5 |
| v56-w16-chain-1to11 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Statefulness | 51.8mavg of 5 | 10.0Mavg of 5 |
| v56-w16-chain-1to12 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Authentication | 24.3mavg of 5 | 3.3Mavg of 5 |
| v56-w16-chain-1to13 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Schema | 28.3mavg of 5 | 4.1Mavg of 5 |
| v56-w16-chain-1to14 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Schema | 41.7mavg of 5 | 8.2Mavg of 5 |
| v56-w16-chain-1to15 | 1/5 passed | 5 | 1 | 20.0% | Hard + Long-horizon | Long | Error Recovery | 43.3mavg of 5 | 8.0Mavg of 5 |
| v56-w16-chain-1to16 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Statefulness | 35.4mavg of 5 | 5.8Mavg of 5 |
| v56-w16-chain-1to17 | 1/5 passed | 5 | 1 | 20.0% | Hard + Long-horizon | Long | Multi-step Workflow | 59.1mavg of 5 | 11.9Mavg of 5 |
| v56-w16-chain-1to18 | 1/5 passed | 5 | 1 | 20.0% | Hard + Long-horizon | Long | Pagination | 36.9mavg of 5 | 5.6Mavg of 5 |
| v56-w16-chain-1to19 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Discovery | 30.5mavg of 5 | 4.4Mavg of 5 |
| v56-w16-chain-1to20 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Multi-step Workflow | 36.8mavg of 5 | 5.5Mavg of 5 |
| v56-w16-sub01 | 0/5 passed | 5 | 0 | 0.0% | Long-horizon | Medium | Pagination | 22.4mavg of 5 | 3.2Mavg of 5 |
| v56-w16-sub02 | 1/5 passed | 5 | 1 | 20.0% | Long-horizon | Medium | Discovery | 25.0mavg of 5 | 3.2Mavg of 5 |
| v56-w16-sub03 | 1/5 passed | 5 | 1 | 20.0% | Hard | Medium | Error Recovery | 27.2mavg of 5 | 3.2Mavg of 5 |
| v56-w16-sub04 | 0/5 passed | 5 | 0 | 0.0% | Long-horizon | Medium | Discovery | 28.2mavg of 5 | 3.8Mavg of 5 |
| v56-w16-sub05 | 1/5 passed | 5 | 1 | 20.0% | Hard | Medium | Error Recovery | 37.9mavg of 5 | 7.2Mavg of 5 |
| v56-w16-sub06 | 0/5 passed | 5 | 0 | 0.0% | Long-horizon | Medium | Multi-step Workflow | 19.0mavg of 5 | 1.7Mavg of 5 |
| v56-w16-sub07 | 0/5 passed | 5 | 0 | 0.0% | Long-horizon | Medium | Multi-step Workflow | 51.5mavg of 5 | 11.6Mavg of 5 |
| v56-w16-sub08 | 1/5 passed | 5 | 1 | 20.0% | Easy | Short | Authentication | 22.8mavg of 5 | 2.8Mavg of 5 |
| v56-w16-sub09 | 1/5 passed | 5 | 1 | 20.0% | Long-horizon | Short | Multi-step Workflow | 18.8mavg of 5 | 2.0Mavg of 5 |
| v56-w16-sub10 | 1/5 passed | 5 | 1 | 20.0% | Long-horizon | Medium | Authentication | 31.9mavg of 5 | 5.7Mavg of 5 |
| v56-w16-sub11 | 1/5 passed | 5 | 1 | 20.0% | Long-horizon | Medium | Statefulness | 44.7mavg of 5 | 9.5Mavg of 5 |
| v56-w16-sub12 | 1/5 passed | 5 | 1 | 20.0% | Long-horizon | Medium | Authentication | 37.8mavg of 5 | 5.4Mavg of 5 |
| v56-w16-sub13 | 2/5 passed | 5 | 2 | 40.0% | Hard | Short | Schema | 16.8mavg of 5 | 1.4Mavg of 5 |
| v56-w16-sub14 | 4/5 passed | 5 | 4 | 80.0% | Long-horizon | Medium | Schema | 11.1mavg of 5 | 686.5Kavg of 5 |
| v56-w16-sub15 | 1/5 passed | 5 | 1 | 20.0% | Long-horizon | Medium | Error Recovery | 49.8mavg of 5 | 14.5Mavg of 5 |
| v56-w16-sub16 | 0/5 passed | 5 | 0 | 0.0% | Long-horizon | Medium | Statefulness | 32.9mavg of 5 | 4.4Mavg of 5 |
| v56-w16-sub17 | 1/5 passed | 5 | 1 | 20.0% | Long-horizon | Long | Multi-step Workflow | 33.6mavg of 5 | 6.7Mavg of 5 |
| v56-w16-sub18 | 1/5 passed | 5 | 1 | 20.0% | Long-horizon | Medium | Pagination | 39.5mavg of 5 | 8.3Mavg of 5 |
| v56-w16-sub19 | 2/5 passed | 5 | 2 | 40.0% | Easy | Short | Discovery | 7.5mavg of 5 | 424.3Kavg of 5 |
| v56-w16-sub20 | 0/5 passed | 5 | 0 | 0.0% | Long-horizon | Medium | Multi-step Workflow | 32.3mavg of 5 | 5.5Mavg of 5 |
| v56-w18-chain-1to02 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Discovery | 38.3mavg of 5 | 8.0Mavg of 5 |
| v56-w18-chain-1to03 | 1/5 passed | 5 | 1 | 20.0% | Hard + Long-horizon | Long | Authentication | 21.3mavg of 5 | 1.9Mavg of 5 |
| v56-w18-chain-1to04 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Statefulness | 26.9mavg of 5 | 3.6Mavg of 5 |
| v56-w18-chain-1to05 | 1/5 passed | 5 | 1 | 20.0% | Hard + Long-horizon | Long | Statefulness | 30.3mavg of 5 | 5.3Mavg of 5 |
| v56-w18-chain-1to06 | 1/5 passed | 5 | 1 | 20.0% | Hard + Long-horizon | Long | Schema | 39.4mavg of 5 | 5.9Mavg of 5 |
| v56-w18-chain-1to07 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Schema | 38.9mavg of 5 | 7.1Mavg of 5 |
| v56-w18-chain-1to08 | 1/5 passed | 5 | 1 | 20.0% | Hard + Long-horizon | Long | Discovery | 4.6mavg of 5 | 178.8Kavg of 5 |
| v56-w18-chain-1to09 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Multi-step Workflow | 31.8mavg of 5 | 5.2Mavg of 5 |
| v56-w18-chain-1to10 | 2/5 passed | 5 | 2 | 40.0% | Hard + Long-horizon | Long | Authentication | 14.7mavg of 5 | 1.4Mavg of 5 |
| v56-w18-chain-1to11 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Statefulness | 47.3mavg of 5 | 10.6Mavg of 5 |
| v56-w18-chain-1to12 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Error Recovery | 40.1mavg of 5 | 6.8Mavg of 5 |
| v56-w18-chain-1to13 | 2/5 passed | 5 | 2 | 40.0% | Hard + Long-horizon | Long | Pagination | 29.6mavg of 5 | 4.7Mavg of 5 |
| v56-w18-chain-1to14 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Schema | 35.2mavg of 5 | 7.0Mavg of 5 |
| v56-w18-sub01 | 0/5 passed | 5 | 0 | 0.0% | Hard | Medium | Schema | 26.8mavg of 5 | 2.7Mavg of 5 |
| v56-w18-sub02 | 0/5 passed | 5 | 0 | 0.0% | Hard | Medium | Discovery | 25.1mavg of 5 | 6.3Mavg of 5 |
| v56-w18-sub03 | 4/5 passed | 5 | 4 | 80.0% | Long-horizon | Short | Authentication | 15.9mavg of 5 | 1.2Mavg of 5 |
| v56-w18-sub04 | 0/5 passed | 5 | 0 | 0.0% | Hard | Medium | Statefulness | 31.6mavg of 5 | 3.9Mavg of 5 |
| v56-w18-sub05 | 1/5 passed | 5 | 1 | 20.0% | Hard | Medium | Statefulness | 21.1mavg of 5 | 4.0Mavg of 5 |
| v56-w18-sub06 | 3/5 passed | 5 | 3 | 60.0% | Easy | Short | Schema | 16.6mavg of 5 | 1.9Mavg of 5 |
| v56-w18-sub07 | 5/5 passed | 5 | 5 | 100.0% | Easy | Short | Schema | 3.4mavg of 5 | 108.1Kavg of 5 |
| v56-w18-sub08 | 2/5 passed | 5 | 2 | 40.0% | Easy | Short | Discovery | 11.2mavg of 5 | 660.2Kavg of 5 |
| v56-w18-sub09 | 0/5 passed | 5 | 0 | 0.0% | Hard | Medium | Multi-step Workflow | 27.9mavg of 5 | 6.9Mavg of 5 |
| v56-w18-sub10 | 3/5 passed | 5 | 3 | 60.0% | Easy | Short | Authentication | 14.6mavg of 5 | 1.1Mavg of 5 |
| v56-w18-sub11 | 2/5 passed | 5 | 2 | 40.0% | Easy | Short | Statefulness | 24.0mavg of 5 | 4.6Mavg of 5 |
| v56-w18-sub12 | 4/5 passed | 5 | 4 | 80.0% | Easy | Short | Error Recovery | 8.7mavg of 5 | 515.1Kavg of 5 |
| v56-w18-sub13 | 3/5 passed | 5 | 3 | 60.0% | Easy | Short | Pagination | 22.8mavg of 5 | 2.8Mavg of 5 |
| v56-w18-sub14 | 4/5 passed | 5 | 4 | 80.0% | Easy | Short | Schema | 10.9mavg of 5 | 721.7Kavg of 5 |
| v56-w18-sub15 | 0/5 passed | 5 | 0 | 0.0% | — | — | Multi-step Workflow | 25.7mavg of 5 | 6.2Mavg of 5 |