claude-fable-5
2,335 trials on 467 tasks across all task sets — 339 passed, 1,996 failed. Click any task row for a quick view of its trials; every trial's raw transcript (JSON) is available for download. Use the task-set bar to reproduce any overview slice.
Showing All tasks: 467 tasks · 2335 trials · pass rate 14.5% (339/2335) — same numbers as that overview slice.
| Task | Result | Trials | Passed | Rate | Bucket | Horizon | Axes | Time | Tokens |
|---|---|---|---|---|---|---|---|---|---|
| v56-w01-chain-1to02 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Pagination | 1.4mavg of 5 | 22.5Kavg of 5 |
| v56-w01-chain-1to03 | 3/5 passed | 5 | 3 | 60.0% | Hard + Long-horizon | Long | Discovery | 1.5mavg of 5 | 24.3Kavg of 5 |
| v56-w01-chain-1to04 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Statefulness | 58.0savg of 5 | 14.9Kavg of 5 |
| v56-w01-chain-1to05 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Schema | 2.4mavg of 5 | 43.3Kavg of 5 |
| v56-w01-chain-1to06 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Multi-step Workflow | 2.6mavg of 5 | 44.7Kavg of 5 |
| v56-w01-chain-1to07 | 5/5 passed | 5 | 5 | 100.0% | Hard + Long-horizon | Long | Authentication | 1.9mavg of 5 | 30.0Kavg of 5 |
| v56-w01-chain-1to08 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Error Recovery | 2.6mavg of 5 | 47.0Kavg of 5 |
| v56-w01-chain-1to09 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Statefulness | 1.2mavg of 5 | 16.2Kavg of 5 |
| v56-w01-chain-1to10 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Discovery | 21.4savg of 5 | 4.4Kavg of 5 |
| v56-w01-chain-1to11 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Statefulness | 22.4savg of 5 | 4.3Kavg of 5 |
| v56-w01-chain-1to12 | 4/5 passed | 5 | 4 | 80.0% | Hard + Long-horizon | Long | Discovery | 1.6mavg of 5 | 21.7Kavg of 5 |
| v56-w01-chain-1to13 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Schema | 55.9savg of 5 | 11.4Kavg of 5 |
| v56-w01-chain-1to14 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Multi-step Workflow | 1.1mavg of 5 | 13.7Kavg of 5 |
| v56-w01-chain-1to15 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Error Recovery | 29.5savg of 5 | 4.4Kavg of 5 |
| v56-w01-chain-1to16 | 5/5 passed | 5 | 5 | 100.0% | Hard + Long-horizon | Long | Pagination | 3.5mavg of 5 | 58.2Kavg of 5 |
| v56-w01-chain-1to17 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Discovery | 29.5savg of 5 | 4.3Kavg of 5 |
| v56-w01-chain-1to18 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Schema | 57.8savg of 5 | 12.6Kavg of 5 |
| v56-w01-chain-1to19 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Multi-step Workflow | 3.0mavg of 5 | 49.1Kavg of 5 |
| v56-w01-chain-1to20 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Authentication | 59.4savg of 5 | 4.4Kavg of 5 |
| v56-w01-sub01 | 0/5 passed | 5 | 0 | 0.0% | Hard | Medium | Statefulness | 24.9savg of 5 | 4.3Kavg of 5 |
| v56-w01-sub02 | 1/5 passed | 5 | 1 | 20.0% | Easy | Short | Pagination | 1.4mavg of 5 | 20.9Kavg of 5 |
| v56-w01-sub03 | 0/5 passed | 5 | 0 | 0.0% | Easy | Short | Discovery | 25.8savg of 5 | 5.3Kavg of 5 |
| v56-w01-sub04 | 0/5 passed | 5 | 0 | 0.0% | Easy | Short | Statefulness | 1.1mavg of 5 | 15.3Kavg of 5 |
| v56-w01-sub05 | 0/5 passed | 5 | 0 | 0.0% | Hard | Short | Schema | 42.5savg of 5 | 8.3Kavg of 5 |
| v56-w01-sub06 | 0/5 passed | 5 | 0 | 0.0% | Hard | Medium | Multi-step Workflow | 2.7mavg of 5 | 43.1Kavg of 5 |
| v56-w01-sub07 | 5/5 passed | 5 | 5 | 100.0% | Easy | Short | Authentication | 1.8mavg of 5 | 29.4Kavg of 5 |
| v56-w01-sub08 | 0/5 passed | 5 | 0 | 0.0% | Hard | Medium | Error Recovery | 20.7savg of 5 | 4.4Kavg of 5 |
| v56-w01-sub09 | 0/5 passed | 5 | 0 | 0.0% | Easy | Short | Statefulness | 22.1savg of 5 | 4.4Kavg of 5 |
| v56-w01-sub10 | 0/5 passed | 5 | 0 | 0.0% | Hard | Short | Discovery | 21.3savg of 5 | 4.4Kavg of 5 |
| v56-w01-sub11 | 0/5 passed | 5 | 0 | 0.0% | Easy | Short | Statefulness | 22.2savg of 5 | 4.4Kavg of 5 |
| v56-w01-sub12 | 4/5 passed | 5 | 4 | 80.0% | Easy | Short | Discovery | 2.6mavg of 5 | 42.4Kavg of 5 |
| v56-w01-sub13 | 0/5 passed | 5 | 0 | 0.0% | Easy | Short | Schema | 36.5savg of 5 | 8.5Kavg of 5 |
| v56-w01-sub14 | 0/5 passed | 5 | 0 | 0.0% | Hard | Medium | Multi-step Workflow | 20.7savg of 5 | 4.4Kavg of 5 |
| v56-w01-sub15 | 0/5 passed | 5 | 0 | 0.0% | Hard | Short | Error Recovery | 22.1savg of 5 | 4.4Kavg of 5 |
| v56-w01-sub16 | 5/5 passed | 5 | 5 | 100.0% | Easy | Short | Pagination | 2.8mavg of 5 | 42.0Kavg of 5 |
| v56-w01-sub17 | 0/5 passed | 5 | 0 | 0.0% | Easy | Short | Discovery | 22.9savg of 5 | 4.4Kavg of 5 |
| v56-w01-sub18 | 0/5 passed | 5 | 0 | 0.0% | Hard | Short | Schema | 46.3savg of 5 | 10.6Kavg of 5 |
| v56-w01-sub19 | 0/5 passed | 5 | 0 | 0.0% | Hard | Medium | Multi-step Workflow | 1.0mavg of 5 | 12.7Kavg of 5 |
| v56-w01-sub20 | 0/5 passed | 5 | 0 | 0.0% | Hard | Short | Authentication | 20.5savg of 5 | 4.3Kavg of 5 |
| v56-w02-chain-1to02 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Error Recovery | 21.3savg of 5 | 4.3Kavg of 5 |
| v56-w02-chain-1to03 | 5/5 passed | 5 | 5 | 100.0% | Hard + Long-horizon | Long | Statefulness | 2.0mavg of 5 | 29.4Kavg of 5 |
| v56-w02-chain-1to04 | 3/5 passed | 5 | 3 | 60.0% | Hard + Long-horizon | Long | Schema | 1.7mavg of 5 | 24.3Kavg of 5 |
| v56-w02-chain-1to05 | 2/5 passed | 5 | 2 | 40.0% | Hard + Long-horizon | Long | Discovery | 2.1mavg of 5 | 29.0Kavg of 5 |
| v56-w02-chain-1to06 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Statefulness | 45.8savg of 5 | 7.1Kavg of 5 |
| v56-w02-chain-1to07 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Error Recovery | 31.2savg of 5 | 4.3Kavg of 5 |
| v56-w02-chain-1to08 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Error Recovery | 35.6savg of 5 | 4.3Kavg of 5 |
| v56-w02-chain-1to09 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Statefulness | 35.7savg of 5 | 4.4Kavg of 5 |
| v56-w02-chain-1to10 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Discovery | 1.5mavg of 5 | 17.3Kavg of 5 |
| v56-w02-chain-1to11 | 4/5 passed | 5 | 4 | 80.0% | Hard + Long-horizon | Long | Multi-step Workflow | 2.3mavg of 5 | 38.3Kavg of 5 |
| v56-w02-chain-1to12 | 3/5 passed | 5 | 3 | 60.0% | Hard + Long-horizon | Long | Schema | 2.2mavg of 5 | 36.5Kavg of 5 |
| v56-w02-chain-1to13 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Statefulness | 18.9savg of 5 | 4.3Kavg of 5 |
| v56-w02-chain-1to14 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Multi-step Workflow | 2.3mavg of 5 | 36.7Kavg of 5 |
| v56-w02-chain-1to15 | 5/5 passed | 5 | 5 | 100.0% | Hard + Long-horizon | Long | Statefulness | 2.3mavg of 5 | 37.0Kavg of 5 |
| v56-w02-chain-1to16 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Statefulness | 29.2savg of 5 | 5.2Kavg of 5 |
| v56-w02-chain-1to17 | 5/5 passed | 5 | 5 | 100.0% | Hard + Long-horizon | Long | Authentication | 2.0mavg of 5 | 31.6Kavg of 5 |
| v56-w02-chain-1to18 | 1/5 passed | 5 | 1 | 20.0% | Hard + Long-horizon | Long | Error Recovery | 1.2mavg of 5 | 14.6Kavg of 5 |
| v56-w02-chain-1to19 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Statefulness | 23.7savg of 5 | 4.3Kavg of 5 |
| v56-w02-chain-1to20 | 4/5 passed | 5 | 4 | 80.0% | Hard + Long-horizon | Long | Statefulness | 2.0mavg of 5 | 34.1Kavg of 5 |
| v56-w02-sub01 | 5/5 passed | 5 | 5 | 100.0% | Hard | Medium | Discovery | 3.5mavg of 5 | 64.7Kavg of 5 |
| v56-w02-sub02 | 0/5 passed | 5 | 0 | 0.0% | Hard | Medium | Error Recovery | 27.9savg of 5 | 4.4Kavg of 5 |
| v56-w02-sub03 | 1/5 passed | 5 | 1 | 20.0% | Easy | Short | Statefulness | 59.5savg of 5 | 11.7Kavg of 5 |
| v56-w02-sub04 | 4/5 passed | 5 | 4 | 80.0% | Easy | Short | Schema | 2.8mavg of 5 | 52.7Kavg of 5 |
| v56-w02-sub05 | 4/5 passed | 5 | 4 | 80.0% | Easy | Short | Discovery | 2.3mavg of 5 | 39.8Kavg of 5 |
| v56-w02-sub06 | 0/5 passed | 5 | 0 | 0.0% | Easy | Short | Statefulness | 22.3savg of 5 | 4.4Kavg of 5 |
| v56-w02-sub07 | 0/5 passed | 5 | 0 | 0.0% | Hard | Medium | Error Recovery | 22.6savg of 5 | 4.4Kavg of 5 |
| v56-w02-sub08 | 0/5 passed | 5 | 0 | 0.0% | Long-horizon | Medium | Error Recovery | 21.6savg of 5 | 4.4Kavg of 5 |
| v56-w02-sub09 | 1/5 passed | 5 | 1 | 20.0% | Easy | Short | Statefulness | 1.3mavg of 5 | 18.4Kavg of 5 |
| v56-w02-sub10 | 3/5 passed | 5 | 3 | 60.0% | Easy | Short | Discovery | 1.8mavg of 5 | 28.7Kavg of 5 |
| v56-w02-sub11 | 0/5 passed | 5 | 0 | 0.0% | Easy | Short | Multi-step Workflow | 21.0savg of 5 | 4.3Kavg of 5 |
| v56-w02-sub12 | 2/5 passed | 5 | 2 | 40.0% | Easy | Short | Schema | 1.1mavg of 5 | 15.0Kavg of 5 |
| v56-w02-sub13 | 4/5 passed | 5 | 4 | 80.0% | Easy | Short | Statefulness | 1.7mavg of 5 | 25.1Kavg of 5 |
| v56-w02-sub14 | 4/5 passed | 5 | 4 | 80.0% | Easy | Short | Multi-step Workflow | 1.6mavg of 5 | 23.9Kavg of 5 |
| v56-w02-sub15 | 3/5 passed | 5 | 3 | 60.0% | Hard | Short | Statefulness | 1.6mavg of 5 | 24.4Kavg of 5 |
| v56-w02-sub16 | 2/5 passed | 5 | 2 | 40.0% | Easy | Short | Statefulness | 1.7mavg of 5 | 24.3Kavg of 5 |
| v56-w02-sub17 | 2/5 passed | 5 | 2 | 40.0% | Long-horizon | Medium | Authentication | 2.0mavg of 5 | 35.4Kavg of 5 |
| v56-w02-sub18 | 1/5 passed | 5 | 1 | 20.0% | Long-horizon | Medium | Error Recovery | 1.6mavg of 5 | 25.3Kavg of 5 |
| v56-w02-sub19 | 2/5 passed | 5 | 2 | 40.0% | Easy | Short | Statefulness | 1.1mavg of 5 | 17.1Kavg of 5 |
| v56-w02-sub20 | 0/5 passed | 5 | 0 | 0.0% | Long-horizon | Medium | Statefulness | 24.9savg of 5 | 4.4Kavg of 5 |
| v56-w03-chain-1to02 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Multi-step Workflow | 1.2mavg of 5 | 17.5Kavg of 5 |
| v56-w03-chain-1to03 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Error Recovery | 24.3savg of 5 | 4.3Kavg of 5 |
| v56-w03-chain-1to04 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Error Recovery | 1.1mavg of 5 | 14.9Kavg of 5 |
| v56-w03-chain-1to05 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Error Recovery | 58.7savg of 5 | 12.2Kavg of 5 |
| v56-w03-chain-1to06 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Pagination | 24.8savg of 5 | 4.4Kavg of 5 |
| v56-w03-chain-1to07 | 3/5 passed | 5 | 3 | 60.0% | Hard + Long-horizon | Long | Discovery | 1.4mavg of 5 | 24.3Kavg of 5 |
| v56-w03-chain-1to08 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Error Recovery | 21.4savg of 5 | 4.3Kavg of 5 |
| v56-w03-chain-1to09 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Authentication | 25.3savg of 5 | 6.5Kavg of 5 |
| v56-w03-chain-1to10 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Statefulness | 38.4savg of 5 | 10.5Kavg of 5 |
| v56-w03-chain-1to11 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Error Recovery | 49.0savg of 5 | 14.8Kavg of 5 |
| v56-w03-chain-1to12 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Authentication | 17.0savg of 5 | 4.3Kavg of 5 |
| v56-w03-chain-1to13 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Error Recovery | 17.4savg of 5 | 4.3Kavg of 5 |
| v56-w03-chain-1to14 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Multi-step Workflow | 15.5savg of 5 | 4.4Kavg of 5 |
| v56-w03-chain-1to15 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Multi-step Workflow | 1.4mavg of 5 | 27.4Kavg of 5 |
| v56-w03-chain-1to16 | 2/5 passed | 5 | 2 | 40.0% | Hard + Long-horizon | Long | Schema | 1.2mavg of 5 | 23.0Kavg of 5 |
| v56-w03-chain-1to17 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Pagination | 1.1mavg of 5 | 20.0Kavg of 5 |
| v56-w03-chain-1to18 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Error Recovery | 18.7savg of 5 | 4.3Kavg of 5 |
| v56-w03-chain-1to19 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Authentication | 1.0mavg of 5 | 16.5Kavg of 5 |
| v56-w03-chain-1to20 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Multi-step Workflow | 19.4savg of 5 | 4.4Kavg of 5 |
| v56-w03-sub01 | 0/5 passed | 5 | 0 | 0.0% | Long-horizon | Medium | Error Recovery | 18.3savg of 5 | 4.4Kavg of 5 |
| v56-w03-sub02 | 0/5 passed | 5 | 0 | 0.0% | Hard | Medium | Multi-step Workflow | 1.2mavg of 5 | 22.2Kavg of 5 |
| v56-w03-sub03 | 0/5 passed | 5 | 0 | 0.0% | Hard | Medium | Error Recovery | 20.2savg of 5 | 4.4Kavg of 5 |
| v56-w03-sub04 | 0/5 passed | 5 | 0 | 0.0% | Hard | Short | Error Recovery | 22.3savg of 5 | 4.3Kavg of 5 |
| v56-w03-sub05 | 0/5 passed | 5 | 0 | 0.0% | Hard | Short | Error Recovery | 19.6savg of 5 | 4.4Kavg of 5 |
| v56-w03-sub06 | 0/5 passed | 5 | 0 | 0.0% | Long-horizon | Medium | Pagination | 20.8savg of 5 | 4.4Kavg of 5 |
| v56-w03-sub07 | 1/5 passed | 5 | 1 | 20.0% | Easy | Short | Discovery | 1.0mavg of 5 | 16.9Kavg of 5 |
| v56-w03-sub08 | 0/5 passed | 5 | 0 | 0.0% | Easy | Short | Error Recovery | 20.8savg of 5 | 4.4Kavg of 5 |
| v56-w03-sub09 | 0/5 passed | 5 | 0 | 0.0% | Hard | Medium | Authentication | 21.0savg of 5 | 4.3Kavg of 5 |
| v56-w03-sub10 | 0/5 passed | 5 | 0 | 0.0% | Hard | Short | Statefulness | 19.7savg of 5 | 4.4Kavg of 5 |
| v56-w03-sub11 | 0/5 passed | 5 | 0 | 0.0% | Hard | Short | Error Recovery | 41.9savg of 5 | 11.5Kavg of 5 |
| v56-w03-sub12 | 0/5 passed | 5 | 0 | 0.0% | Hard | Medium | Authentication | 20.0savg of 5 | 4.3Kavg of 5 |
| v56-w03-sub13 | 0/5 passed | 5 | 0 | 0.0% | Hard | Medium | Error Recovery | 23.2savg of 5 | 4.3Kavg of 5 |
| v56-w03-sub14 | 0/5 passed | 5 | 0 | 0.0% | Long-horizon | Medium | Multi-step Workflow | 21.0savg of 5 | 4.4Kavg of 5 |
| v56-w03-sub15 | 0/5 passed | 5 | 0 | 0.0% | Hard | Medium | Multi-step Workflow | 21.0savg of 5 | 4.5Kavg of 5 |
| v56-w03-sub16 | 0/5 passed | 5 | 0 | 0.0% | Easy | Short | Schema | 24.3savg of 5 | 5.5Kavg of 5 |
| v56-w03-sub17 | 0/5 passed | 5 | 0 | 0.0% | Hard | Medium | Pagination | 19.2savg of 5 | 4.4Kavg of 5 |
| v56-w03-sub18 | 0/5 passed | 5 | 0 | 0.0% | Hard | Medium | Error Recovery | 17.3savg of 5 | 4.4Kavg of 5 |
| v56-w03-sub19 | 0/5 passed | 5 | 0 | 0.0% | Long-horizon | Medium | Authentication | 29.8savg of 5 | 8.4Kavg of 5 |
| v56-w03-sub20 | 0/5 passed | 5 | 0 | 0.0% | Hard | Medium | Multi-step Workflow | 16.6savg of 5 | 4.5Kavg of 5 |
| v56-w04-chain-1to02 | 0/5 passed | 5 | 0 | 0.0% | Long-horizon | Long | Pagination | 52.1savg of 5 | 14.7Kavg of 5 |
| v56-w04-chain-1to03 | 0/5 passed | 5 | 0 | 0.0% | Long-horizon | Long | Discovery | 18.3savg of 5 | 4.3Kavg of 5 |
| v56-w04-chain-1to04 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Error Recovery | 59.1savg of 5 | 16.8Kavg of 5 |
| v56-w04-chain-1to05 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Pagination | 54.1savg of 5 | 15.5Kavg of 5 |
| v56-w04-chain-1to06 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Discovery | 18.2savg of 5 | 4.3Kavg of 5 |
| v56-w04-chain-1to07 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Multi-step Workflow | 20.5savg of 5 | 5.3Kavg of 5 |
| v56-w04-chain-1to08 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Schema | 18.0savg of 5 | 4.3Kavg of 5 |
| v56-w04-chain-1to09 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Authentication | 18.1savg of 5 | 4.4Kavg of 5 |
| v56-w04-chain-1to10 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Error Recovery | 52.9savg of 5 | 14.8Kavg of 5 |
| v56-w04-chain-1to11 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Discovery | 1.0mavg of 5 | 15.9Kavg of 5 |
| v56-w04-chain-1to12 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Pagination | 55.1savg of 5 | 14.8Kavg of 5 |
| v56-w04-chain-1to13 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Pagination | 52.9savg of 5 | 14.7Kavg of 5 |
| v56-w04-chain-1to14 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Authentication | 36.7savg of 5 | 8.1Kavg of 5 |
| v56-w04-chain-1to15 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Discovery | 57.4savg of 5 | 16.1Kavg of 5 |
| v56-w04-chain-1to16 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Authentication | 21.4savg of 5 | 4.3Kavg of 5 |
| v56-w04-chain-1to17 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Discovery | 20.5savg of 5 | 4.3Kavg of 5 |
| v56-w04-chain-1to18 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Authentication | 20.8savg of 5 | 4.3Kavg of 5 |
| v56-w04-chain-1to19 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Authentication | 22.0savg of 5 | 4.4Kavg of 5 |
| v56-w04-chain-1to20 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Error Recovery | 42.9savg of 5 | 11.3Kavg of 5 |
| v56-w04-sub01 | 0/5 passed | 5 | 0 | 0.0% | Easy | Short | Authentication | 21.4savg of 5 | 4.5Kavg of 5 |
| v56-w04-sub02 | 0/5 passed | 5 | 0 | 0.0% | Easy | Short | Pagination | 24.0savg of 5 | 5.3Kavg of 5 |
| v56-w04-sub03 | 0/5 passed | 5 | 0 | 0.0% | Easy | Short | Discovery | 18.9savg of 5 | 4.4Kavg of 5 |
| v56-w04-sub04 | 0/5 passed | 5 | 0 | 0.0% | Easy | Short | Error Recovery | 39.6savg of 5 | 10.7Kavg of 5 |
| v56-w04-sub05 | 0/5 passed | 5 | 0 | 0.0% | Easy | Short | Pagination | 17.7savg of 5 | 4.4Kavg of 5 |
| v56-w04-sub06 | 0/5 passed | 5 | 0 | 0.0% | Long-horizon | Medium | Discovery | 24.5savg of 5 | 6.4Kavg of 5 |
| v56-w04-sub07 | 0/5 passed | 5 | 0 | 0.0% | Long-horizon | Medium | Multi-step Workflow | 17.6savg of 5 | 4.4Kavg of 5 |
| v56-w04-sub08 | 0/5 passed | 5 | 0 | 0.0% | Easy | Short | Schema | 19.0savg of 5 | 4.5Kavg of 5 |
| v56-w04-sub09 | 0/5 passed | 5 | 0 | 0.0% | Easy | Short | Authentication | 21.1savg of 5 | 4.4Kavg of 5 |
| v56-w04-sub10 | 0/5 passed | 5 | 0 | 0.0% | Hard | Medium | Error Recovery | 45.2savg of 5 | 12.6Kavg of 5 |
| v56-w04-sub11 | 0/5 passed | 5 | 0 | 0.0% | Easy | Short | Discovery | 19.0savg of 5 | 4.4Kavg of 5 |
| v56-w04-sub12 | 0/5 passed | 5 | 0 | 0.0% | Easy | Short | Pagination | 45.4savg of 5 | 13.0Kavg of 5 |
| v56-w04-sub13 | 0/5 passed | 5 | 0 | 0.0% | Easy | Short | Pagination | 1.0mavg of 5 | 15.9Kavg of 5 |
| v56-w04-sub14 | 0/5 passed | 5 | 0 | 0.0% | Hard | Medium | Authentication | 19.1savg of 5 | 4.5Kavg of 5 |
| v56-w04-sub15 | 0/5 passed | 5 | 0 | 0.0% | Easy | Short | Discovery | 28.0savg of 5 | 6.6Kavg of 5 |
| v56-w04-sub16 | 0/5 passed | 5 | 0 | 0.0% | Hard | Short | Authentication | 16.2savg of 5 | 4.4Kavg of 5 |
| v56-w04-sub17 | 0/5 passed | 5 | 0 | 0.0% | Easy | Short | Discovery | 16.5savg of 5 | 4.4Kavg of 5 |
| v56-w04-sub18 | 0/5 passed | 5 | 0 | 0.0% | Hard | Short | Authentication | 16.6savg of 5 | 4.5Kavg of 5 |
| v56-w04-sub19 | 0/5 passed | 5 | 0 | 0.0% | Long-horizon | Medium | Authentication | 15.1savg of 5 | 4.4Kavg of 5 |
| v56-w04-sub20 | 0/5 passed | 5 | 0 | 0.0% | Hard | Medium | Error Recovery | 1.0mavg of 5 | 14.9Kavg of 5 |
| v56-w05-chain-1to02 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Schema | 1.3mavg of 5 | 17.4Kavg of 5 |
| v56-w05-chain-1to03 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Statefulness | 1.4mavg of 5 | 18.9Kavg of 5 |
| v56-w05-chain-1to04 | 5/5 passed | 5 | 5 | 100.0% | Hard + Long-horizon | Long | Pagination | 3.5mavg of 5 | 55.4Kavg of 5 |
| v56-w05-chain-1to05 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Authentication | 1.6mavg of 5 | 23.0Kavg of 5 |
| v56-w05-chain-1to06 | 1/5 passed | 5 | 1 | 20.0% | Hard + Long-horizon | Long | Authentication | 9.2mavg of 5 | 307.0Kavg of 5 |
| v56-w05-chain-1to07 | 5/5 passed | 5 | 5 | 100.0% | Hard + Long-horizon | Long | Schema | 3.4mavg of 5 | 51.5Kavg of 5 |
| v56-w05-chain-1to08 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Statefulness | 3.3mavg of 5 | 49.9Kavg of 5 |
| v56-w05-chain-1to09 | 1/5 passed | 5 | 1 | 20.0% | Hard + Long-horizon | Long | Pagination | 17.7mavg of 5 | 1.4Mavg of 5 |
| v56-w05-chain-1to10 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Statefulness | 1.9mavg of 5 | 27.5Kavg of 5 |
| v56-w05-chain-1to11 | 2/5 passed | 5 | 2 | 40.0% | Hard + Long-horizon | Long | Schema | 2.1mavg of 5 | 31.1Kavg of 5 |
| v56-w05-chain-1to12 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Schema | 1.5mavg of 5 | 18.9Kavg of 5 |
| v56-w05-chain-1to13 | 1/5 passed | 5 | 1 | 20.0% | Hard + Long-horizon | Long | Discovery | 1.8mavg of 5 | 24.9Kavg of 5 |
| v56-w05-chain-1to14 | 2/5 passed | 5 | 2 | 40.0% | Hard + Long-horizon | Long | Pagination | 10.4mavg of 5 | 514.7Kavg of 5 |
| v56-w05-chain-1to15 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Schema | 26.7savg of 5 | 4.4Kavg of 5 |
| v56-w05-chain-1to16 | 4/5 passed | 5 | 4 | 80.0% | Hard + Long-horizon | Long | Discovery | 4.1mavg of 5 | 72.4Kavg of 5 |
| v56-w05-chain-1to17 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Pagination | 1.7mavg of 5 | 20.3Kavg of 5 |
| v56-w05-chain-1to18 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Discovery | 1.2mavg of 5 | 12.9Kavg of 5 |
| v56-w05-chain-1to19 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Authentication | 50.0savg of 5 | 8.2Kavg of 5 |
| v56-w05-chain-1to20 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Error Recovery | 1.6mavg of 5 | 20.0Kavg of 5 |
| v56-w05-sub01 | 0/5 passed | 5 | 0 | 0.0% | Hard | Medium | Statefulness | 1.5mavg of 5 | 17.4Kavg of 5 |
| v56-w05-sub02 | 0/5 passed | 5 | 0 | 0.0% | Hard | Short | Schema | 1.2mavg of 5 | 16.5Kavg of 5 |
| v56-w05-sub03 | 0/5 passed | 5 | 0 | 0.0% | Easy | Short | Statefulness | 27.2savg of 5 | 4.3Kavg of 5 |
| v56-w05-sub04 | 5/5 passed | 5 | 5 | 100.0% | Easy | Short | Pagination | 6.3mavg of 5 | 122.8Kavg of 5 |
| v56-w05-sub05 | 0/5 passed | 5 | 0 | 0.0% | Hard | Short | Authentication | 54.3savg of 5 | 11.9Kavg of 5 |
| v56-w05-sub06 | 1/5 passed | 5 | 1 | 20.0% | Hard | Medium | Authentication | 8.6mavg of 5 | 393.5Kavg of 5 |
| v56-w05-sub07 | 2/5 passed | 5 | 2 | 40.0% | Easy | Short | Schema | 1.4mavg of 5 | 19.1Kavg of 5 |
| v56-w05-sub08 | 0/5 passed | 5 | 0 | 0.0% | Hard | Medium | Statefulness | 2.0mavg of 5 | 27.6Kavg of 5 |
| v56-w05-sub09 | 0/5 passed | 5 | 0 | 0.0% | Easy | Short | Pagination | 1.0mavg of 5 | 13.2Kavg of 5 |
| v56-w05-sub10 | 0/5 passed | 5 | 0 | 0.0% | Easy | Short | Statefulness | 1.2mavg of 5 | 16.7Kavg of 5 |
| v56-w05-sub11 | 0/5 passed | 5 | 0 | 0.0% | Hard | Short | Schema | 1.0mavg of 5 | 12.7Kavg of 5 |
| v56-w05-sub12 | 0/5 passed | 5 | 0 | 0.0% | Hard | Short | Schema | 24.8savg of 5 | 4.4Kavg of 5 |
| v56-w05-sub13 | 2/5 passed | 5 | 2 | 40.0% | Easy | Short | Discovery | 2.5mavg of 5 | 38.4Kavg of 5 |
| v56-w05-sub14 | 2/5 passed | 5 | 2 | 40.0% | Long-horizon | Medium | Pagination | 3.1mavg of 5 | 49.0Kavg of 5 |
| v56-w05-sub15 | 1/5 passed | 5 | 1 | 20.0% | Easy | Short | Schema | 1.5mavg of 5 | 19.8Kavg of 5 |
| v56-w05-sub16 | 3/5 passed | 5 | 3 | 60.0% | Easy | Short | Discovery | 2.5mavg of 5 | 40.7Kavg of 5 |
| v56-w05-sub17 | 0/5 passed | 5 | 0 | 0.0% | Easy | Short | Pagination | 1.3mavg of 5 | 15.7Kavg of 5 |
| v56-w05-sub18 | 0/5 passed | 5 | 0 | 0.0% | Easy | Short | Discovery | 50.6savg of 5 | 9.7Kavg of 5 |
| v56-w05-sub19 | 0/5 passed | 5 | 0 | 0.0% | Easy | Short | Authentication | 51.3savg of 5 | 10.0Kavg of 5 |
| v56-w05-sub20 | 0/5 passed | 5 | 0 | 0.0% | Hard | Short | Error Recovery | 41.3savg of 5 | 6.3Kavg of 5 |
| v56-w06-chain-1to02 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Multi-step Workflow | 1.1mavg of 5 | 13.3Kavg of 5 |
| v56-w06-chain-1to03 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Authentication | 1.2mavg of 5 | 15.0Kavg of 5 |
| v56-w06-chain-1to04 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Statefulness | 1.2mavg of 5 | 16.5Kavg of 5 |
| v56-w06-chain-1to05 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Statefulness | 22.6savg of 5 | 4.4Kavg of 5 |
| v56-w06-sub01 | 0/5 passed | 5 | 0 | 0.0% | Hard | Medium | Error Recovery | 43.5savg of 5 | 9.0Kavg of 5 |
| v56-w06-sub02 | 0/5 passed | 5 | 0 | 0.0% | Hard | Short | Multi-step Workflow | 24.1savg of 5 | 4.4Kavg of 5 |
| v56-w06-sub03 | 0/5 passed | 5 | 0 | 0.0% | Long-horizon | Medium | Authentication | 1.1mavg of 5 | 15.6Kavg of 5 |
| v56-w06-sub04 | 0/5 passed | 5 | 0 | 0.0% | Hard | Short | Statefulness | 39.2savg of 5 | 7.2Kavg of 5 |
| v56-w06-sub05 | 0/5 passed | 5 | 0 | 0.0% | Hard | Short | Statefulness | 34.4savg of 5 | 6.3Kavg of 5 |
| v56-w06-sub06 | 0/5 passed | 5 | 0 | 0.0% | — | — | Pagination | 1.4mavg of 5 | 16.8Kavg of 5 |
| v56-w08-chain-1to02 | 0/5 passed | 5 | 0 | 0.0% | Long-horizon | Long | Error Recovery | 24.0savg of 5 | 4.3Kavg of 5 |
| v56-w08-chain-1to03 | 4/5 passed | 5 | 4 | 80.0% | Long-horizon | Long | Pagination | 2.5mavg of 5 | 39.0Kavg of 5 |
| v56-w08-chain-1to04 | 0/5 passed | 5 | 0 | 0.0% | Long-horizon | Long | Authentication | 35.0savg of 5 | 7.1Kavg of 5 |
| v56-w08-chain-1to05 | 5/5 passed | 5 | 5 | 100.0% | Long-horizon | Long | Error Recovery | 2.4mavg of 5 | 36.4Kavg of 5 |
| v56-w08-chain-1to06 | 3/5 passed | 5 | 3 | 60.0% | Long-horizon | Long | Multi-step Workflow | 2.4mavg of 5 | 39.1Kavg of 5 |
| v56-w08-chain-1to07 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Error Recovery | 23.3savg of 5 | 4.4Kavg of 5 |
| v56-w08-chain-1to08 | 4/5 passed | 5 | 4 | 80.0% | Hard + Long-horizon | Long | Schema | 2.7mavg of 5 | 40.7Kavg of 5 |
| v56-w08-chain-1to09 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Multi-step Workflow | 43.8savg of 5 | 4.4Kavg of 5 |
| v56-w08-chain-1to10 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Discovery | 44.9savg of 5 | 4.3Kavg of 5 |
| v56-w08-chain-1to11 | 2/5 passed | 5 | 2 | 40.0% | Hard + Long-horizon | Long | Multi-step Workflow | 1.6mavg of 5 | 21.9Kavg of 5 |
| v56-w08-chain-1to12 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Schema | 1.1mavg of 5 | 11.0Kavg of 5 |
| v56-w08-chain-1to13 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Discovery | 3.1mavg of 5 | 46.7Kavg of 5 |
| v56-w08-chain-1to14 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Discovery | 26.4savg of 5 | 4.3Kavg of 5 |
| v56-w08-chain-1to15 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Discovery | 25.0savg of 5 | 4.3Kavg of 5 |
| v56-w08-chain-1to16 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Error Recovery | 2.1mavg of 5 | 31.7Kavg of 5 |
| v56-w08-chain-1to17 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Pagination | 3.1mavg of 5 | 55.2Kavg of 5 |
| v56-w08-chain-1to18 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Schema | 21.6savg of 5 | 4.4Kavg of 5 |
| v56-w08-chain-1to19 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Discovery | 3.2mavg of 5 | 52.8Kavg of 5 |
| v56-w08-chain-1to20 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Authentication | 2.2mavg of 5 | 35.0Kavg of 5 |
| v56-w08-sub01 | 5/5 passed | 5 | 5 | 100.0% | Easy | Short | Discovery | 3.6mavg of 5 | 59.1Kavg of 5 |
| v56-w08-sub02 | 0/5 passed | 5 | 0 | 0.0% | Easy | Medium | Error Recovery | 37.6savg of 5 | 6.4Kavg of 5 |
| v56-w08-sub03 | 0/5 passed | 5 | 0 | 0.0% | Easy | Short | Pagination | 45.5savg of 5 | 9.2Kavg of 5 |
| v56-w08-sub04 | 5/5 passed | 5 | 5 | 100.0% | Easy | Short | Authentication | 2.7mavg of 5 | 46.2Kavg of 5 |
| v56-w08-sub05 | 5/5 passed | 5 | 5 | 100.0% | Easy | Short | Error Recovery | 1.8mavg of 5 | 26.2Kavg of 5 |
| v56-w08-sub06 | 2/5 passed | 5 | 2 | 40.0% | Easy | Short | Multi-step Workflow | 1.6mavg of 5 | 24.1Kavg of 5 |
| v56-w08-sub07 | 0/5 passed | 5 | 0 | 0.0% | Hard | Short | Error Recovery | 30.3savg of 5 | 4.4Kavg of 5 |
| v56-w08-sub08 | 5/5 passed | 5 | 5 | 100.0% | Hard | Short | Schema | 2.0mavg of 5 | 30.0Kavg of 5 |
| v56-w08-sub09 | 0/5 passed | 5 | 0 | 0.0% | Long-horizon | Medium | Multi-step Workflow | 56.4savg of 5 | 10.3Kavg of 5 |
| v56-w08-sub10 | 5/5 passed | 5 | 5 | 100.0% | Hard | Short | Discovery | 2.1mavg of 5 | 34.0Kavg of 5 |
| v56-w08-sub11 | 3/5 passed | 5 | 3 | 60.0% | Hard | Short | Multi-step Workflow | 1.5mavg of 5 | 25.2Kavg of 5 |
| v56-w08-sub12 | 0/5 passed | 5 | 0 | 0.0% | Hard | Short | Schema | 43.5savg of 5 | 8.4Kavg of 5 |
| v56-w08-sub13 | 2/5 passed | 5 | 2 | 40.0% | Easy | Short | Discovery | 1.4mavg of 5 | 22.1Kavg of 5 |
| v56-w08-sub14 | 3/5 passed | 5 | 3 | 60.0% | Hard | Short | Discovery | 1.3mavg of 5 | 21.7Kavg of 5 |
| v56-w08-sub15 | 5/5 passed | 5 | 5 | 100.0% | Easy | Short | Discovery | 3.8mavg of 5 | 84.2Kavg of 5 |
| v56-w08-sub16 | 0/5 passed | 5 | 0 | 0.0% | Hard | Medium | Error Recovery | 21.9savg of 5 | 4.5Kavg of 5 |
| v56-w08-sub17 | 5/5 passed | 5 | 5 | 100.0% | Hard | Short | Pagination | 2.6mavg of 5 | 56.6Kavg of 5 |
| v56-w08-sub18 | 0/5 passed | 5 | 0 | 0.0% | Hard | Short | Schema | 27.6savg of 5 | 6.4Kavg of 5 |
| v56-w08-sub19 | 2/5 passed | 5 | 2 | 40.0% | Easy | Short | Discovery | 1.3mavg of 5 | 22.0Kavg of 5 |
| v56-w08-sub20 | 3/5 passed | 5 | 3 | 60.0% | Easy | Short | Authentication | 1.7mavg of 5 | 32.0Kavg of 5 |
| v56-w10-chain-1to02 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Pagination | 23.0savg of 5 | 4.3Kavg of 5 |
| v56-w10-chain-1to03 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Pagination | 59.0savg of 5 | 14.3Kavg of 5 |
| v56-w10-chain-1to04 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Statefulness | 59.6savg of 5 | 14.9Kavg of 5 |
| v56-w10-chain-1to05 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Multi-step Workflow | 51.5savg of 5 | 12.1Kavg of 5 |
| v56-w10-chain-1to06 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Multi-step Workflow | 23.5savg of 5 | 5.3Kavg of 5 |
| v56-w10-chain-1to07 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Multi-step Workflow | 52.9savg of 5 | 13.6Kavg of 5 |
| v56-w10-chain-1to08 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Error Recovery | 56.0savg of 5 | 13.5Kavg of 5 |
| v56-w10-chain-1to09 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Schema | 43.8savg of 5 | 10.2Kavg of 5 |
| v56-w10-chain-1to10 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Error Recovery | 18.4savg of 5 | 4.4Kavg of 5 |
| v56-w10-chain-1to11 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Statefulness | 1.1mavg of 5 | 15.6Kavg of 5 |
| v56-w10-chain-1to12 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Error Recovery | 19.2savg of 5 | 4.4Kavg of 5 |
| v56-w10-chain-1to13 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Authentication | 20.6savg of 5 | 4.4Kavg of 5 |
| v56-w10-chain-1to14 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Statefulness | 1.1mavg of 5 | 15.1Kavg of 5 |
| v56-w10-chain-1to15 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Multi-step Workflow | 1.3mavg of 5 | 18.8Kavg of 5 |
| v56-w10-chain-1to16 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Statefulness | 1.3mavg of 5 | 18.6Kavg of 5 |
| v56-w10-chain-1to17 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Schema | 52.8savg of 5 | 10.1Kavg of 5 |
| v56-w10-chain-1to18 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Error Recovery | 26.3savg of 5 | 4.4Kavg of 5 |
| v56-w10-chain-1to19 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Authentication | 47.2savg of 5 | 11.4Kavg of 5 |
| v56-w10-chain-1to20 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Authentication | 1.1mavg of 5 | 17.2Kavg of 5 |
| v56-w10-sub01 | 0/5 passed | 5 | 0 | 0.0% | Long-horizon | Long | Multi-step Workflow | 33.4savg of 5 | 6.2Kavg of 5 |
| v56-w10-sub02 | 0/5 passed | 5 | 0 | 0.0% | Long-horizon | Medium | Pagination | 40.4savg of 5 | 9.2Kavg of 5 |
| v56-w10-sub03 | 0/5 passed | 5 | 0 | 0.0% | Easy | Short | Pagination | 23.2savg of 5 | 4.3Kavg of 5 |
| v56-w10-sub04 | 0/5 passed | 5 | 0 | 0.0% | Long-horizon | Medium | Statefulness | 42.7savg of 5 | 11.4Kavg of 5 |
| v56-w10-sub05 | 0/5 passed | 5 | 0 | 0.0% | Hard | Medium | Multi-step Workflow | 18.1savg of 5 | 4.4Kavg of 5 |
| v56-w10-sub06 | 0/5 passed | 5 | 0 | 0.0% | Easy | Short | Multi-step Workflow | 19.9savg of 5 | 4.4Kavg of 5 |
| v56-w10-sub07 | 0/5 passed | 5 | 0 | 0.0% | Hard | Medium | Multi-step Workflow | 17.1savg of 5 | 4.4Kavg of 5 |
| v56-w10-sub08 | 0/5 passed | 5 | 0 | 0.0% | Hard | Medium | Error Recovery | 14.3savg of 5 | 4.4Kavg of 5 |
| v56-w10-sub09 | 0/5 passed | 5 | 0 | 0.0% | Hard | Medium | Schema | 17.6savg of 5 | 4.5Kavg of 5 |
| v56-w10-sub10 | 0/5 passed | 5 | 0 | 0.0% | Easy | Short | Error Recovery | 16.7savg of 5 | 4.5Kavg of 5 |
| v56-w10-sub11 | 0/5 passed | 5 | 0 | 0.0% | Easy | Short | Statefulness | 42.3savg of 5 | 12.6Kavg of 5 |
| v56-w10-sub12 | 0/5 passed | 5 | 0 | 0.0% | Easy | Short | Error Recovery | 27.1savg of 5 | 7.5Kavg of 5 |
| v56-w10-sub13 | 0/5 passed | 5 | 0 | 0.0% | Easy | Short | Authentication | 14.9savg of 5 | 4.4Kavg of 5 |
| v56-w10-sub14 | 0/5 passed | 5 | 0 | 0.0% | Long-horizon | Medium | Statefulness | 37.5savg of 5 | 9.2Kavg of 5 |
| v56-w10-sub15 | 0/5 passed | 5 | 0 | 0.0% | Long-horizon | Medium | Multi-step Workflow | 59.4savg of 5 | 15.3Kavg of 5 |
| v56-w10-sub16 | 0/5 passed | 5 | 0 | 0.0% | Easy | Short | Statefulness | 51.7savg of 5 | 12.2Kavg of 5 |
| v56-w10-sub17 | 0/5 passed | 5 | 0 | 0.0% | Easy | Short | Schema | 50.9savg of 5 | 13.1Kavg of 5 |
| v56-w10-sub18 | 0/5 passed | 5 | 0 | 0.0% | Easy | Short | Error Recovery | 19.7savg of 5 | 4.5Kavg of 5 |
| v56-w10-sub19 | 0/5 passed | 5 | 0 | 0.0% | Long-horizon | Medium | Authentication | 1.4mavg of 5 | 25.5Kavg of 5 |
| v56-w10-sub20 | 0/5 passed | 5 | 0 | 0.0% | Easy | Short | Authentication | 1.3mavg of 5 | 23.3Kavg of 5 |
| v56-w11-chain-1to02 | 2/5 passed | 5 | 2 | 40.0% | Hard + Long-horizon | Long | Discovery | 2.1mavg of 5 | 41.1Kavg of 5 |
| v56-w11-chain-1to03 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Schema | 19.7savg of 5 | 4.4Kavg of 5 |
| v56-w11-chain-1to04 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Multi-step Workflow | 40.0savg of 5 | 9.1Kavg of 5 |
| v56-w11-chain-1to05 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Discovery | 19.1savg of 5 | 4.3Kavg of 5 |
| v56-w11-chain-1to06 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Multi-step Workflow | 41.9savg of 5 | 10.3Kavg of 5 |
| v56-w11-chain-1to07 | 1/5 passed | 5 | 1 | 20.0% | Hard + Long-horizon | Long | Multi-step Workflow | 1.4mavg of 5 | 26.7Kavg of 5 |
| v56-w11-chain-1to08 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Statefulness | 18.7savg of 5 | 4.3Kavg of 5 |
| v56-w11-chain-1to09 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Pagination | 20.9savg of 5 | 4.4Kavg of 5 |
| v56-w11-chain-1to10 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Discovery | 20.4savg of 5 | 4.3Kavg of 5 |
| v56-w11-chain-1to11 | 5/5 passed | 5 | 5 | 100.0% | Hard + Long-horizon | Long | Error Recovery | 2.1mavg of 5 | 45.9Kavg of 5 |
| v56-w11-chain-1to12 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Discovery | 33.7savg of 5 | 9.0Kavg of 5 |
| v56-w11-chain-1to13 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Error Recovery | 19.3savg of 5 | 4.4Kavg of 5 |
| v56-w11-chain-1to14 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Multi-step Workflow | 22.4savg of 5 | 4.4Kavg of 5 |
| v56-w11-chain-1to15 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Statefulness | 18.2savg of 5 | 4.3Kavg of 5 |
| v56-w11-chain-1to16 | 1/5 passed | 5 | 1 | 20.0% | Hard + Long-horizon | Long | Discovery | 1.2mavg of 5 | 23.3Kavg of 5 |
| v56-w11-chain-1to17 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Discovery | 3.3mavg of 5 | 83.2Kavg of 5 |
| v56-w11-chain-1to18 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Error Recovery | 16.4savg of 5 | 4.4Kavg of 5 |
| v56-w11-chain-1to19 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Multi-step Workflow | 15.4savg of 5 | 4.4Kavg of 5 |
| v56-w11-chain-1to20 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Multi-step Workflow | 15.5savg of 5 | 4.4Kavg of 5 |
| v56-w11-sub01 | 0/5 passed | 5 | 0 | 0.0% | Hard | Medium | Pagination | 54.3savg of 5 | 19.0Kavg of 5 |
| v56-w11-sub02 | 3/5 passed | 5 | 3 | 60.0% | Long-horizon | Medium | Discovery | 1.7mavg of 5 | 42.5Kavg of 5 |
| v56-w11-sub03 | 0/5 passed | 5 | 0 | 0.0% | Hard | Medium | Schema | 16.5savg of 5 | 4.4Kavg of 5 |
| v56-w11-sub04 | 0/5 passed | 5 | 0 | 0.0% | Long-horizon | Medium | Multi-step Workflow | 18.7savg of 5 | 4.4Kavg of 5 |
| v56-w11-sub05 | 0/5 passed | 5 | 0 | 0.0% | Long-horizon | Medium | Discovery | 15.3savg of 5 | 4.4Kavg of 5 |
| v56-w11-sub06 | 0/5 passed | 5 | 0 | 0.0% | Long-horizon | Medium | Multi-step Workflow | 1.3mavg of 5 | 28.7Kavg of 5 |
| v56-w11-sub07 | 2/5 passed | 5 | 2 | 40.0% | Long-horizon | Medium | Multi-step Workflow | 1.2mavg of 5 | 25.7Kavg of 5 |
| v56-w11-sub08 | 2/5 passed | 5 | 2 | 40.0% | Long-horizon | Long | Statefulness | 2.1mavg of 5 | 61.4Kavg of 5 |
| v56-w11-sub09 | 1/5 passed | 5 | 1 | 20.0% | Long-horizon | Medium | Pagination | 37.6savg of 5 | 13.0Kavg of 5 |
| v56-w11-sub10 | 2/5 passed | 5 | 2 | 40.0% | Long-horizon | Medium | Discovery | 1.1mavg of 5 | 24.3Kavg of 5 |
| v56-w11-sub11 | 5/5 passed | 5 | 5 | 100.0% | Long-horizon | Medium | Error Recovery | 2.3mavg of 5 | 59.3Kavg of 5 |
| v56-w11-sub12 | 0/5 passed | 5 | 0 | 0.0% | Easy | Short | Discovery | 14.1savg of 5 | 4.4Kavg of 5 |
| v56-w11-sub13 | 1/5 passed | 5 | 1 | 20.0% | Easy | Short | Error Recovery | 38.8savg of 5 | 11.4Kavg of 5 |
| v56-w11-sub14 | 2/5 passed | 5 | 2 | 40.0% | Long-horizon | Medium | Multi-step Workflow | 1.2mavg of 5 | 25.2Kavg of 5 |
| v56-w11-sub15 | 3/5 passed | 5 | 3 | 60.0% | Long-horizon | Medium | Statefulness | 1.8mavg of 5 | 35.4Kavg of 5 |
| v56-w11-sub16 | 0/5 passed | 5 | 0 | 0.0% | Long-horizon | Medium | Discovery | 18.5savg of 5 | 4.4Kavg of 5 |
| v56-w11-sub17 | 2/5 passed | 5 | 2 | 40.0% | Long-horizon | Medium | Discovery | 1.8mavg of 5 | 50.0Kavg of 5 |
| v56-w11-sub18 | 0/5 passed | 5 | 0 | 0.0% | Long-horizon | Medium | Error Recovery | 32.2savg of 5 | 8.6Kavg of 5 |
| v56-w11-sub19 | 0/5 passed | 5 | 0 | 0.0% | Hard | Short | Multi-step Workflow | 16.5savg of 5 | 4.4Kavg of 5 |
| v56-w11-sub20 | 5/5 passed | 5 | 5 | 100.0% | Hard | Medium | Multi-step Workflow | 2.9mavg of 5 | 79.3Kavg of 5 |
| v56-w13-chain-1to02 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Error Recovery | 33.2savg of 5 | 8.1Kavg of 5 |
| v56-w13-chain-1to03 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Pagination | 23.3savg of 5 | 6.4Kavg of 5 |
| v56-w13-chain-1to04 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Pagination | 48.6savg of 5 | 13.7Kavg of 5 |
| v56-w13-chain-1to05 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Error Recovery | 18.3savg of 5 | 4.4Kavg of 5 |
| v56-w13-chain-1to06 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Schema | 14.1savg of 5 | 4.3Kavg of 5 |
| v56-w13-chain-1to07 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Authentication | 22.7savg of 5 | 6.2Kavg of 5 |
| v56-w13-chain-1to08 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Multi-step Workflow | 47.5savg of 5 | 15.7Kavg of 5 |
| v56-w13-chain-1to09 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Statefulness | 19.7savg of 5 | 4.3Kavg of 5 |
| v56-w13-chain-1to10 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Schema | 48.7savg of 5 | 17.3Kavg of 5 |
| v56-w13-chain-1to11 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Discovery | 17.3savg of 5 | 4.4Kavg of 5 |
| v56-w13-chain-1to12 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Multi-step Workflow | 18.6savg of 5 | 4.4Kavg of 5 |
| v56-w13-chain-1to13 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Authentication | 13.6savg of 5 | 4.4Kavg of 5 |
| v56-w13-chain-1to14 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Pagination | 22.1savg of 5 | 6.4Kavg of 5 |
| v56-w13-chain-1to15 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Authentication | 16.5savg of 5 | 4.3Kavg of 5 |
| v56-w13-chain-1to16 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Schema | 15.7savg of 5 | 4.3Kavg of 5 |
| v56-w13-chain-1to17 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Discovery | 36.8savg of 5 | 12.4Kavg of 5 |
| v56-w13-chain-1to18 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Statefulness | 19.7savg of 5 | 4.4Kavg of 5 |
| v56-w13-chain-1to19 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Schema | 14.0savg of 5 | 4.3Kavg of 5 |
| v56-w13-chain-1to20 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Multi-step Workflow | 13.4savg of 5 | 4.4Kavg of 5 |
| v56-w13-sub01 | 0/5 passed | 5 | 0 | 0.0% | Hard | Medium | Authentication | 16.5savg of 5 | 4.4Kavg of 5 |
| v56-w13-sub02 | 0/5 passed | 5 | 0 | 0.0% | Hard | Short | Error Recovery | 18.9savg of 5 | 4.4Kavg of 5 |
| v56-w13-sub03 | 0/5 passed | 5 | 0 | 0.0% | Easy | Short | Pagination | 13.5savg of 5 | 4.3Kavg of 5 |
| v56-w13-sub04 | 0/5 passed | 5 | 0 | 0.0% | Easy | Short | Pagination | 13.4savg of 5 | 4.3Kavg of 5 |
| v56-w13-sub05 | 0/5 passed | 5 | 0 | 0.0% | Long-horizon | Medium | Error Recovery | 15.9savg of 5 | 4.4Kavg of 5 |
| v56-w13-sub06 | 0/5 passed | 5 | 0 | 0.0% | Hard | Short | Schema | 17.2savg of 5 | 4.4Kavg of 5 |
| v56-w13-sub07 | 0/5 passed | 5 | 0 | 0.0% | Easy | Short | Authentication | 18.1savg of 5 | 4.4Kavg of 5 |
| v56-w13-sub08 | 0/5 passed | 5 | 0 | 0.0% | Long-horizon | Medium | Multi-step Workflow | 15.6savg of 5 | 4.4Kavg of 5 |
| v56-w13-sub09 | 0/5 passed | 5 | 0 | 0.0% | Hard | Short | Statefulness | 16.4savg of 5 | 4.4Kavg of 5 |
| v56-w13-sub10 | 0/5 passed | 5 | 0 | 0.0% | Easy | Short | Schema | 15.6savg of 5 | 4.5Kavg of 5 |
| v56-w13-sub11 | 0/5 passed | 5 | 0 | 0.0% | Easy | Short | Discovery | 14.8savg of 5 | 4.4Kavg of 5 |
| v56-w13-sub12 | 0/5 passed | 5 | 0 | 0.0% | Long-horizon | Medium | Multi-step Workflow | 16.3savg of 5 | 4.4Kavg of 5 |
| v56-w13-sub13 | 0/5 passed | 5 | 0 | 0.0% | Easy | Short | Authentication | 15.9savg of 5 | 4.4Kavg of 5 |
| v56-w13-sub14 | 0/5 passed | 5 | 0 | 0.0% | Easy | Short | Pagination | 15.6savg of 5 | 4.4Kavg of 5 |
| v56-w13-sub15 | 0/5 passed | 5 | 0 | 0.0% | Easy | Short | Authentication | 16.1savg of 5 | 4.4Kavg of 5 |
| v56-w13-sub16 | 0/5 passed | 5 | 0 | 0.0% | Easy | Short | Schema | 18.1savg of 5 | 4.5Kavg of 5 |
| v56-w13-sub17 | 0/5 passed | 5 | 0 | 0.0% | Easy | Short | Discovery | 16.6savg of 5 | 4.4Kavg of 5 |
| v56-w13-sub18 | 0/5 passed | 5 | 0 | 0.0% | Long-horizon | Medium | Statefulness | 19.3savg of 5 | 4.5Kavg of 5 |
| v56-w13-sub19 | 0/5 passed | 5 | 0 | 0.0% | Hard | Short | Schema | 17.0savg of 5 | 4.4Kavg of 5 |
| v56-w13-sub20 | 0/5 passed | 5 | 0 | 0.0% | Hard | Medium | Multi-step Workflow | 15.7savg of 5 | 4.4Kavg of 5 |
| v56-w14-chain-1to02 | 0/5 passed | 5 | 0 | 0.0% | Hard | Long | Statefulness | 19.3savg of 5 | 4.4Kavg of 5 |
| v56-w14-chain-1to03 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Authentication | 15.8savg of 5 | 4.4Kavg of 5 |
| v56-w14-chain-1to04 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Schema | 53.1savg of 5 | 15.4Kavg of 5 |
| v56-w14-chain-1to05 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Error Recovery | 20.4savg of 5 | 5.3Kavg of 5 |
| v56-w14-chain-1to06 | 1/5 passed | 5 | 1 | 20.0% | Hard + Long-horizon | Long | Discovery | 1.4mavg of 5 | 27.5Kavg of 5 |
| v56-w14-chain-1to07 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Error Recovery | 16.1savg of 5 | 4.4Kavg of 5 |
| v56-w14-chain-1to08 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Statefulness | 48.0savg of 5 | 15.4Kavg of 5 |
| v56-w14-chain-1to09 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Authentication | 36.9savg of 5 | 10.6Kavg of 5 |
| v56-w14-chain-1to10 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Discovery | 35.7savg of 5 | 11.0Kavg of 5 |
| v56-w14-chain-1to11 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Statefulness | 42.4savg of 5 | 10.0Kavg of 5 |
| v56-w14-chain-1to12 | 5/5 passed | 5 | 5 | 100.0% | Hard + Long-horizon | Long | Statefulness | 2.6mavg of 5 | 58.3Kavg of 5 |
| v56-w14-chain-1to13 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Error Recovery | 45.6savg of 5 | 12.3Kavg of 5 |
| v56-w14-chain-1to14 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Statefulness | 19.1savg of 5 | 4.4Kavg of 5 |
| v56-w14-chain-1to15 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Schema | 20.2savg of 5 | 4.3Kavg of 5 |
| v56-w14-chain-1to16 | 2/5 passed | 5 | 2 | 40.0% | Hard + Long-horizon | Long | Statefulness | 1.2mavg of 5 | 24.0Kavg of 5 |
| v56-w14-chain-1to17 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Authentication | 41.6savg of 5 | 12.8Kavg of 5 |
| v56-w14-chain-1to18 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Statefulness | 35.2savg of 5 | 10.6Kavg of 5 |
| v56-w14-chain-1to19 | 2/5 passed | 5 | 2 | 40.0% | Hard + Long-horizon | Long | Pagination | 1.1mavg of 5 | 23.9Kavg of 5 |
| v56-w14-chain-1to20 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Pagination | 51.5savg of 5 | 17.1Kavg of 5 |
| v56-w14-sub01 | 0/5 passed | 5 | 0 | 0.0% | Hard | Medium | Discovery | 18.8savg of 5 | 4.3Kavg of 5 |
| v56-w14-sub02 | 0/5 passed | 5 | 0 | 0.0% | Easy | Short | Statefulness | 22.9savg of 5 | 5.3Kavg of 5 |
| v56-w14-sub03 | 0/5 passed | 5 | 0 | 0.0% | Hard | Medium | Authentication | 18.8savg of 5 | 4.4Kavg of 5 |
| v56-w14-sub04 | 1/5 passed | 5 | 1 | 20.0% | Easy | Medium | Schema | 1.2mavg of 5 | 24.6Kavg of 5 |
| v56-w14-sub05 | 0/5 passed | 5 | 0 | 0.0% | Easy | Short | Error Recovery | 14.7savg of 5 | 4.5Kavg of 5 |
| v56-w14-sub06 | 0/5 passed | 5 | 0 | 0.0% | Easy | Short | Discovery | 14.3savg of 5 | 4.4Kavg of 5 |
| v56-w14-sub07 | 0/5 passed | 5 | 0 | 0.0% | Long-horizon | Medium | Error Recovery | 48.0savg of 5 | 14.5Kavg of 5 |
| v56-w14-sub08 | 0/5 passed | 5 | 0 | 0.0% | Easy | Short | Statefulness | 16.3savg of 5 | 4.4Kavg of 5 |
| v56-w14-sub09 | 3/5 passed | 5 | 3 | 60.0% | Easy | Short | Authentication | 1.5mavg of 5 | 28.5Kavg of 5 |
| v56-w14-sub10 | 0/5 passed | 5 | 0 | 0.0% | Easy | Short | Discovery | 17.6savg of 5 | 5.4Kavg of 5 |
| v56-w14-sub11 | 0/5 passed | 5 | 0 | 0.0% | Easy | Short | Statefulness | 44.6savg of 5 | 11.4Kavg of 5 |
| v56-w14-sub12 | 3/5 passed | 5 | 3 | 60.0% | Long-horizon | Medium | Statefulness | 1.9mavg of 5 | 39.1Kavg of 5 |
| v56-w14-sub13 | 0/5 passed | 5 | 0 | 0.0% | Hard | Short | Error Recovery | 19.5savg of 5 | 4.5Kavg of 5 |
| v56-w14-sub14 | 1/5 passed | 5 | 1 | 20.0% | Long-horizon | Short | Statefulness | 1.0mavg of 5 | 17.6Kavg of 5 |
| v56-w14-sub15 | 0/5 passed | 5 | 0 | 0.0% | Easy | Short | Schema | 34.3savg of 5 | 8.4Kavg of 5 |
| v56-w14-sub16 | 2/5 passed | 5 | 2 | 40.0% | Long-horizon | Medium | Statefulness | 1.2mavg of 5 | 21.0Kavg of 5 |
| v56-w14-sub17 | 0/5 passed | 5 | 0 | 0.0% | Hard | Short | Authentication | 38.2savg of 5 | 9.4Kavg of 5 |
| v56-w14-sub18 | 1/5 passed | 5 | 1 | 20.0% | Long-horizon | Short | Statefulness | 52.4savg of 5 | 15.1Kavg of 5 |
| v56-w14-sub19 | 0/5 passed | 5 | 0 | 0.0% | Easy | Short | Pagination | 1.3mavg of 5 | 25.0Kavg of 5 |
| v56-w14-sub20 | 0/5 passed | 5 | 0 | 0.0% | Easy | Short | Pagination | 54.4savg of 5 | 16.2Kavg of 5 |
| v56-w16-chain-1to02 | 0/5 passed | 5 | 0 | 0.0% | Long-horizon | Long | Discovery | 1.3mavg of 5 | 24.2Kavg of 5 |
| v56-w16-chain-1to03 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Error Recovery | 22.6savg of 5 | 4.3Kavg of 5 |
| v56-w16-chain-1to04 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Discovery | 1.4mavg of 5 | 27.2Kavg of 5 |
| v56-w16-chain-1to05 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Error Recovery | 16.7savg of 5 | 4.3Kavg of 5 |
| v56-w16-chain-1to06 | 2/5 passed | 5 | 2 | 40.0% | Hard + Long-horizon | Long | Multi-step Workflow | 2.4mavg of 5 | 50.3Kavg of 5 |
| v56-w16-chain-1to07 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Multi-step Workflow | 17.3savg of 5 | 4.3Kavg of 5 |
| v56-w16-chain-1to08 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Authentication | 21.3savg of 5 | 4.4Kavg of 5 |
| v56-w16-chain-1to09 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Multi-step Workflow | 56.5savg of 5 | 16.0Kavg of 5 |
| v56-w16-chain-1to10 | 5/5 passed | 5 | 5 | 100.0% | Hard + Long-horizon | Long | Authentication | 2.2mavg of 5 | 41.6Kavg of 5 |
| v56-w16-chain-1to11 | 4/5 passed | 5 | 4 | 80.0% | Hard + Long-horizon | Long | Statefulness | 2.1mavg of 5 | 38.8Kavg of 5 |
| v56-w16-chain-1to12 | 4/5 passed | 5 | 4 | 80.0% | Hard + Long-horizon | Long | Authentication | 3.2mavg of 5 | 62.1Kavg of 5 |
| v56-w16-chain-1to13 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Schema | 18.9savg of 5 | 4.4Kavg of 5 |
| v56-w16-chain-1to14 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Schema | 19.0savg of 5 | 4.3Kavg of 5 |
| v56-w16-chain-1to15 | 2/5 passed | 5 | 2 | 40.0% | Hard + Long-horizon | Long | Error Recovery | 1.3mavg of 5 | 21.1Kavg of 5 |
| v56-w16-chain-1to16 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Statefulness | 21.4savg of 5 | 5.2Kavg of 5 |
| v56-w16-chain-1to17 | 5/5 passed | 5 | 5 | 100.0% | Hard + Long-horizon | Long | Multi-step Workflow | 3.6mavg of 5 | 71.4Kavg of 5 |
| v56-w16-chain-1to18 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Pagination | 19.5savg of 5 | 4.3Kavg of 5 |
| v56-w16-chain-1to19 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Discovery | 2.1mavg of 5 | 34.6Kavg of 5 |
| v56-w16-chain-1to20 | 5/5 passed | 5 | 5 | 100.0% | Hard + Long-horizon | Long | Multi-step Workflow | 2.9mavg of 5 | 54.9Kavg of 5 |
| v56-w16-sub01 | 5/5 passed | 5 | 5 | 100.0% | Long-horizon | Medium | Pagination | 3.0mavg of 5 | 49.6Kavg of 5 |
| v56-w16-sub02 | 5/5 passed | 5 | 5 | 100.0% | Long-horizon | Medium | Discovery | 3.3mavg of 5 | 55.9Kavg of 5 |
| v56-w16-sub03 | 5/5 passed | 5 | 5 | 100.0% | Hard | Medium | Error Recovery | 2.4mavg of 5 | 38.9Kavg of 5 |
| v56-w16-sub04 | 0/5 passed | 5 | 0 | 0.0% | Long-horizon | Medium | Discovery | 1.2mavg of 5 | 15.2Kavg of 5 |
| v56-w16-sub05 | 0/5 passed | 5 | 0 | 0.0% | Hard | Medium | Error Recovery | 24.9savg of 5 | 4.5Kavg of 5 |
| v56-w16-sub06 | 0/5 passed | 5 | 0 | 0.0% | Long-horizon | Medium | Multi-step Workflow | 22.4savg of 5 | 4.4Kavg of 5 |
| v56-w16-sub07 | 0/5 passed | 5 | 0 | 0.0% | Long-horizon | Medium | Multi-step Workflow | 24.4savg of 5 | 4.4Kavg of 5 |
| v56-w16-sub08 | 0/5 passed | 5 | 0 | 0.0% | Easy | Short | Authentication | 20.6savg of 5 | 4.4Kavg of 5 |
| v56-w16-sub09 | 0/5 passed | 5 | 0 | 0.0% | Long-horizon | Short | Multi-step Workflow | 21.3savg of 5 | 4.4Kavg of 5 |
| v56-w16-sub10 | 2/5 passed | 5 | 2 | 40.0% | Long-horizon | Medium | Authentication | 2.9mavg of 5 | 53.0Kavg of 5 |
| v56-w16-sub11 | 5/5 passed | 5 | 5 | 100.0% | Long-horizon | Medium | Statefulness | 2.1mavg of 5 | 35.8Kavg of 5 |
| v56-w16-sub12 | 5/5 passed | 5 | 5 | 100.0% | Long-horizon | Medium | Authentication | 2.9mavg of 5 | 51.7Kavg of 5 |
| v56-w16-sub13 | 0/5 passed | 5 | 0 | 0.0% | Hard | Short | Schema | 23.2savg of 5 | 4.4Kavg of 5 |
| v56-w16-sub14 | 0/5 passed | 5 | 0 | 0.0% | Long-horizon | Medium | Schema | 24.6savg of 5 | 4.4Kavg of 5 |
| v56-w16-sub15 | 3/5 passed | 5 | 3 | 60.0% | Long-horizon | Medium | Error Recovery | 2.0mavg of 5 | 32.9Kavg of 5 |
| v56-w16-sub16 | 0/5 passed | 5 | 0 | 0.0% | Long-horizon | Medium | Statefulness | 20.4savg of 5 | 4.4Kavg of 5 |
| v56-w16-sub17 | 0/5 passed | 5 | 0 | 0.0% | Long-horizon | Long | Multi-step Workflow | 22.0savg of 5 | 4.4Kavg of 5 |
| v56-w16-sub18 | 0/5 passed | 5 | 0 | 0.0% | Long-horizon | Medium | Pagination | 25.3savg of 5 | 5.4Kavg of 5 |
| v56-w16-sub19 | 5/5 passed | 5 | 5 | 100.0% | Easy | Short | Discovery | 2.5mavg of 5 | 47.9Kavg of 5 |
| v56-w16-sub20 | 2/5 passed | 5 | 2 | 40.0% | Long-horizon | Medium | Multi-step Workflow | 1.3mavg of 5 | 25.2Kavg of 5 |
| v56-w18-chain-1to02 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Discovery | 1.1mavg of 5 | 15.0Kavg of 5 |
| v56-w18-chain-1to03 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Authentication | 1.0mavg of 5 | 13.7Kavg of 5 |
| v56-w18-chain-1to04 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Statefulness | 1.1mavg of 5 | 15.9Kavg of 5 |
| v56-w18-chain-1to05 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Statefulness | 1.0mavg of 5 | 14.0Kavg of 5 |
| v56-w18-chain-1to06 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Schema | 26.1savg of 5 | 4.4Kavg of 5 |
| v56-w18-chain-1to07 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Schema | 60.0savg of 5 | 13.8Kavg of 5 |
| v56-w18-chain-1to08 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Discovery | 1.2mavg of 5 | 18.7Kavg of 5 |
| v56-w18-chain-1to09 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Multi-step Workflow | 21.5savg of 5 | 4.4Kavg of 5 |
| v56-w18-chain-1to10 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Authentication | 31.7savg of 5 | 6.4Kavg of 5 |
| v56-w18-chain-1to11 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Statefulness | 48.6savg of 5 | 11.2Kavg of 5 |
| v56-w18-chain-1to12 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Error Recovery | 32.5savg of 5 | 7.3Kavg of 5 |
| v56-w18-chain-1to13 | 0/5 passed | 5 | 0 | 0.0% | Hard + Long-horizon | Long | Pagination | 44.0savg of 5 | 11.6Kavg of 5 |
| v56-w18-chain-1to14 | 1/5 passed | 5 | 1 | 20.0% | Hard + Long-horizon | Long | Schema | 1.4mavg of 5 | 28.7Kavg of 5 |
| v56-w18-sub01 | 0/5 passed | 5 | 0 | 0.0% | Hard | Medium | Schema | 27.9savg of 5 | 6.5Kavg of 5 |
| v56-w18-sub02 | 0/5 passed | 5 | 0 | 0.0% | Hard | Medium | Discovery | 48.2savg of 5 | 15.2Kavg of 5 |
| v56-w18-sub03 | 0/5 passed | 5 | 0 | 0.0% | Long-horizon | Short | Authentication | 28.7savg of 5 | 8.8Kavg of 5 |
| v56-w18-sub04 | 0/5 passed | 5 | 0 | 0.0% | Hard | Medium | Statefulness | 56.1savg of 5 | 18.0Kavg of 5 |
| v56-w18-sub05 | 0/5 passed | 5 | 0 | 0.0% | Hard | Medium | Statefulness | 21.5savg of 5 | 4.4Kavg of 5 |
| v56-w18-sub06 | 0/5 passed | 5 | 0 | 0.0% | Easy | Short | Schema | 19.3savg of 5 | 4.5Kavg of 5 |
| v56-w18-sub07 | 0/5 passed | 5 | 0 | 0.0% | Easy | Short | Schema | 49.0savg of 5 | 16.9Kavg of 5 |
| v56-w18-sub08 | 3/5 passed | 5 | 3 | 60.0% | Easy | Short | Discovery | 1.0mavg of 5 | 32.8Kavg of 5 |
| v56-w18-sub09 | 0/5 passed | 5 | 0 | 0.0% | Hard | Medium | Multi-step Workflow | 50.2savg of 5 | 20.4Kavg of 5 |
| v56-w18-sub10 | 0/5 passed | 5 | 0 | 0.0% | Easy | Short | Authentication | 16.5savg of 5 | 4.4Kavg of 5 |
| v56-w18-sub11 | 0/5 passed | 5 | 0 | 0.0% | Easy | Short | Statefulness | 22.5savg of 5 | 6.8Kavg of 5 |
| v56-w18-sub12 | 0/5 passed | 5 | 0 | 0.0% | Easy | Short | Error Recovery | 35.2savg of 5 | 10.7Kavg of 5 |
| v56-w18-sub13 | 0/5 passed | 5 | 0 | 0.0% | Easy | Short | Pagination | 42.8savg of 5 | 15.2Kavg of 5 |
| v56-w18-sub14 | 0/5 passed | 5 | 0 | 0.0% | Easy | Short | Schema | 22.8savg of 5 | 4.5Kavg of 5 |
| v56-w18-sub15 | 0/5 passed | 5 | 0 | 0.0% | — | — | Multi-step Workflow | 38.5savg of 5 | 17.1Kavg of 5 |