Postman APIFlow-Bench 1.0 Leaderboard
Overviewgpt-5-mini

gpt-5-mini

2,335 trials on 467 tasks across all task sets — 1,881 passed, 454 failed. Click any task row for a quick view of its trials; every trial's raw transcript (JSON) is available for download. Use the task-set bar to reproduce any overview slice.

⌖ Pass rate (all task sets): 80.6%✓ 1881 passed✗ 454 failed
Task set ?
Difficulty (as created):
467 tasks · click a row for its trials · click column header to sort
Task?Result?Trials?Passed?Rate? Bucket?Horizon? Axes?Time?Tokens?
v56-w01-chain-1to024/5 passed5480.0%Hard + Long-horizonLongPagination53.5savg of 584.3Kavg of 5
v56-w01-chain-1to035/5 passed55100.0%Hard + Long-horizonLongDiscovery25.2savg of 527.5Kavg of 5
v56-w01-chain-1to045/5 passed55100.0%Hard + Long-horizonLongStatefulness31.1savg of 542.2Kavg of 5
v56-w01-chain-1to054/5 passed5480.0%Hard + Long-horizonLongSchema57.3savg of 5106.6Kavg of 5
v56-w01-chain-1to065/5 passed55100.0%Hard + Long-horizonLongMulti-step Workflow46.7savg of 570.8Kavg of 5
v56-w01-chain-1to075/5 passed55100.0%Hard + Long-horizonLongAuthentication37.1savg of 526.1Kavg of 5
v56-w01-chain-1to085/5 passed55100.0%Hard + Long-horizonLongError Recovery1.5mavg of 5111.9Kavg of 5
v56-w01-chain-1to095/5 passed55100.0%Hard + Long-horizonLongStatefulness57.3savg of 550.4Kavg of 5
v56-w01-chain-1to104/5 passed5480.0%Hard + Long-horizonLongDiscovery1.9mavg of 5124.5Kavg of 5
v56-w01-chain-1to115/5 passed55100.0%Hard + Long-horizonLongStatefulness35.3savg of 521.4Kavg of 5
v56-w01-chain-1to125/5 passed55100.0%Hard + Long-horizonLongDiscovery27.0savg of 519.9Kavg of 5
v56-w01-chain-1to134/5 passed5480.0%Hard + Long-horizonLongSchema34.5savg of 523.4Kavg of 5
v56-w01-chain-1to144/5 passed5480.0%Hard + Long-horizonLongMulti-step Workflow47.3savg of 538.4Kavg of 5
v56-w01-chain-1to150/5 passed500.0%Hard + Long-horizonLongError Recovery56.4savg of 548.6Kavg of 5
v56-w01-chain-1to165/5 passed55100.0%Hard + Long-horizonLongPagination36.1savg of 532.1Kavg of 5
v56-w01-chain-1to175/5 passed55100.0%Hard + Long-horizonLongDiscovery30.4savg of 518.9Kavg of 5
v56-w01-chain-1to185/5 passed55100.0%Hard + Long-horizonLongSchema41.2savg of 531.0Kavg of 5
v56-w01-chain-1to195/5 passed55100.0%Hard + Long-horizonLongMulti-step Workflow1.5mavg of 5100.4Kavg of 5
v56-w01-chain-1to200/5 passed500.0%Hard + Long-horizonLongAuthentication45.9savg of 536.1Kavg of 5
v56-w01-sub015/5 passed55100.0%HardMediumStatefulness1.5mavg of 589.6Kavg of 5
v56-w01-sub024/5 passed5480.0%EasyShortPagination41.5savg of 518.0Kavg of 5
v56-w01-sub035/5 passed55100.0%EasyShortDiscovery40.7savg of 528.3Kavg of 5
v56-w01-sub045/5 passed55100.0%EasyShortStatefulness17.4savg of 522.5Kavg of 5
v56-w01-sub055/5 passed55100.0%HardShortSchema58.7savg of 542.4Kavg of 5
v56-w01-sub065/5 passed55100.0%HardMediumMulti-step Workflow53.7savg of 580.5Kavg of 5
v56-w01-sub075/5 passed55100.0%EasyShortAuthentication26.9savg of 535.6Kavg of 5
v56-w01-sub085/5 passed55100.0%HardMediumError Recovery3.5mavg of 5115.6Kavg of 5
v56-w01-sub095/5 passed55100.0%EasyShortStatefulness1.5mavg of 518.2Kavg of 5
v56-w01-sub101/5 passed5120.0%HardShortDiscovery2.1mavg of 561.4Kavg of 5
v56-w01-sub115/5 passed55100.0%EasyShortStatefulness27.6savg of 526.5Kavg of 5
v56-w01-sub125/5 passed55100.0%EasyShortDiscovery40.2savg of 531.9Kavg of 5
v56-w01-sub135/5 passed55100.0%EasyShortSchema26.1savg of 528.3Kavg of 5
v56-w01-sub145/5 passed55100.0%HardMediumMulti-step Workflow26.4savg of 528.2Kavg of 5
v56-w01-sub150/5 passed500.0%HardShortError Recovery44.8savg of 519.5Kavg of 5
v56-w01-sub165/5 passed55100.0%EasyShortPagination23.9savg of 522.3Kavg of 5
v56-w01-sub173/5 passed5360.0%EasyShortDiscovery31.5savg of 520.2Kavg of 5
v56-w01-sub185/5 passed55100.0%HardShortSchema33.0savg of 539.0Kavg of 5
v56-w01-sub190/5 passed500.0%HardMediumMulti-step Workflow1.8mavg of 574.3Kavg of 5
v56-w01-sub200/5 passed500.0%HardShortAuthentication1.7mavg of 540.4Kavg of 5
v56-w02-chain-1to024/5 passed5480.0%Hard + Long-horizonLongError Recovery25.8savg of 521.5Kavg of 5
v56-w02-chain-1to035/5 passed55100.0%Hard + Long-horizonLongStatefulness1.3mavg of 527.5Kavg of 5
v56-w02-chain-1to045/5 passed55100.0%Hard + Long-horizonLongSchema23.3savg of 528.3Kavg of 5
v56-w02-chain-1to055/5 passed55100.0%Hard + Long-horizonLongDiscovery29.2savg of 542.5Kavg of 5
v56-w02-chain-1to065/5 passed55100.0%Hard + Long-horizonLongStatefulness23.2savg of 530.3Kavg of 5
v56-w02-chain-1to075/5 passed55100.0%Hard + Long-horizonLongError Recovery24.4savg of 524.9Kavg of 5
v56-w02-chain-1to085/5 passed55100.0%Hard + Long-horizonLongError Recovery51.3savg of 533.1Kavg of 5
v56-w02-chain-1to095/5 passed55100.0%Hard + Long-horizonLongStatefulness3.9mavg of 550.5Kavg of 5
v56-w02-chain-1to100/5 passed500.0%Hard + Long-horizonLongDiscovery22.1savg of 517.9Kavg of 5
v56-w02-chain-1to114/5 passed5480.0%Hard + Long-horizonLongMulti-step Workflow35.3savg of 537.4Kavg of 5
v56-w02-chain-1to125/5 passed55100.0%Hard + Long-horizonLongSchema5.0mavg of 544.5Kavg of 5
v56-w02-chain-1to130/5 passed500.0%Hard + Long-horizonLongStatefulness34.8savg of 538.0Kavg of 5
v56-w02-chain-1to140/5 passed500.0%Hard + Long-horizonLongMulti-step Workflow52.5savg of 523.2Kavg of 5
v56-w02-chain-1to154/5 passed5480.0%Hard + Long-horizonLongStatefulness37.1savg of 551.0Kavg of 5
v56-w02-chain-1to165/5 passed55100.0%Hard + Long-horizonLongStatefulness39.1savg of 550.9Kavg of 5
v56-w02-chain-1to175/5 passed55100.0%Hard + Long-horizonLongAuthentication26.4savg of 534.6Kavg of 5
v56-w02-chain-1to180/5 passed500.0%Hard + Long-horizonLongError Recovery28.5savg of 530.4Kavg of 5
v56-w02-chain-1to195/5 passed55100.0%Hard + Long-horizonLongStatefulness39.4savg of 548.9Kavg of 5
v56-w02-chain-1to205/5 passed55100.0%Hard + Long-horizonLongStatefulness28.1savg of 552.3Kavg of 5
v56-w02-sub015/5 passed55100.0%HardMediumDiscovery23.7savg of 539.1Kavg of 5
v56-w02-sub025/5 passed55100.0%HardMediumError Recovery31.2savg of 533.8Kavg of 5
v56-w02-sub035/5 passed55100.0%EasyShortStatefulness21.0savg of 533.8Kavg of 5
v56-w02-sub045/5 passed55100.0%EasyShortSchema16.9savg of 521.7Kavg of 5
v56-w02-sub055/5 passed55100.0%EasyShortDiscovery19.4savg of 534.1Kavg of 5
v56-w02-sub065/5 passed55100.0%EasyShortStatefulness14.4savg of 521.3Kavg of 5
v56-w02-sub075/5 passed55100.0%HardMediumError Recovery18.3savg of 529.2Kavg of 5
v56-w02-sub084/5 passed5480.0%Long-horizonMediumError Recovery21.7savg of 536.8Kavg of 5
v56-w02-sub095/5 passed55100.0%EasyShortStatefulness20.6savg of 534.1Kavg of 5
v56-w02-sub105/5 passed55100.0%EasyShortDiscovery21.5savg of 537.3Kavg of 5
v56-w02-sub115/5 passed55100.0%EasyShortMulti-step Workflow18.6savg of 531.1Kavg of 5
v56-w02-sub125/5 passed55100.0%EasyShortSchema17.8savg of 529.7Kavg of 5
v56-w02-sub131/5 passed5120.0%EasyShortStatefulness21.9savg of 536.5Kavg of 5
v56-w02-sub145/5 passed55100.0%EasyShortMulti-step Workflow19.1savg of 530.3Kavg of 5
v56-w02-sub155/5 passed55100.0%HardShortStatefulness24.3savg of 537.9Kavg of 5
v56-w02-sub165/5 passed55100.0%EasyShortStatefulness21.9savg of 539.6Kavg of 5
v56-w02-sub175/5 passed55100.0%Long-horizonMediumAuthentication18.3savg of 528.9Kavg of 5
v56-w02-sub183/5 passed5360.0%Long-horizonMediumError Recovery21.1savg of 532.7Kavg of 5
v56-w02-sub195/5 passed55100.0%EasyShortStatefulness22.4savg of 543.3Kavg of 5
v56-w02-sub205/5 passed55100.0%Long-horizonMediumStatefulness23.5savg of 546.6Kavg of 5
v56-w03-chain-1to025/5 passed55100.0%Hard + Long-horizonLongMulti-step Workflow36.4savg of 583.9Kavg of 5
v56-w03-chain-1to035/5 passed55100.0%Hard + Long-horizonLongError Recovery26.6savg of 539.7Kavg of 5
v56-w03-chain-1to045/5 passed55100.0%Hard + Long-horizonLongError Recovery39.6savg of 573.6Kavg of 5
v56-w03-chain-1to055/5 passed55100.0%Hard + Long-horizonLongError Recovery27.2savg of 545.3Kavg of 5
v56-w03-chain-1to064/5 passed5480.0%Hard + Long-horizonLongPagination23.8savg of 533.7Kavg of 5
v56-w03-chain-1to075/5 passed55100.0%Hard + Long-horizonLongDiscovery12.7savg of 511.8Kavg of 5
v56-w03-chain-1to085/5 passed55100.0%Hard + Long-horizonLongError Recovery20.4savg of 525.7Kavg of 5
v56-w03-chain-1to094/5 passed5480.0%Hard + Long-horizonLongAuthentication31.1savg of 537.9Kavg of 5
v56-w03-chain-1to105/5 passed55100.0%Hard + Long-horizonLongStatefulness34.2savg of 561.4Kavg of 5
v56-w03-chain-1to115/5 passed55100.0%Hard + Long-horizonLongError Recovery23.7savg of 534.1Kavg of 5
v56-w03-chain-1to125/5 passed55100.0%Hard + Long-horizonLongAuthentication23.2savg of 531.8Kavg of 5
v56-w03-chain-1to134/5 passed5480.0%Hard + Long-horizonLongError Recovery26.1savg of 536.6Kavg of 5
v56-w03-chain-1to145/5 passed55100.0%Hard + Long-horizonLongMulti-step Workflow26.5savg of 545.9Kavg of 5
v56-w03-chain-1to155/5 passed55100.0%Hard + Long-horizonLongMulti-step Workflow24.1savg of 537.9Kavg of 5
v56-w03-chain-1to165/5 passed55100.0%Hard + Long-horizonLongSchema18.0savg of 525.7Kavg of 5
v56-w03-chain-1to175/5 passed55100.0%Hard + Long-horizonLongPagination43.0savg of 588.4Kavg of 5
v56-w03-chain-1to185/5 passed55100.0%Hard + Long-horizonLongError Recovery25.7savg of 537.7Kavg of 5
v56-w03-chain-1to195/5 passed55100.0%Hard + Long-horizonLongAuthentication24.1savg of 545.3Kavg of 5
v56-w03-chain-1to205/5 passed55100.0%Hard + Long-horizonLongMulti-step Workflow27.4savg of 545.4Kavg of 5
v56-w03-sub015/5 passed55100.0%Long-horizonMediumError Recovery19.6savg of 526.9Kavg of 5
v56-w03-sub025/5 passed55100.0%HardMediumMulti-step Workflow39.7savg of 552.2Kavg of 5
v56-w03-sub034/5 passed5480.0%HardMediumError Recovery35.9savg of 574.9Kavg of 5
v56-w03-sub045/5 passed55100.0%HardShortError Recovery29.4savg of 547.4Kavg of 5
v56-w03-sub055/5 passed55100.0%HardShortError Recovery25.1savg of 546.7Kavg of 5
v56-w03-sub065/5 passed55100.0%Long-horizonMediumPagination22.4savg of 530.7Kavg of 5
v56-w03-sub075/5 passed55100.0%EasyShortDiscovery11.2savg of 511.2Kavg of 5
v56-w03-sub085/5 passed55100.0%EasyShortError Recovery18.7savg of 528.6Kavg of 5
v56-w03-sub095/5 passed55100.0%HardMediumAuthentication21.0savg of 536.6Kavg of 5
v56-w03-sub105/5 passed55100.0%HardShortStatefulness33.6savg of 550.1Kavg of 5
v56-w03-sub115/5 passed55100.0%HardShortError Recovery16.8savg of 523.3Kavg of 5
v56-w03-sub125/5 passed55100.0%HardMediumAuthentication27.2savg of 545.8Kavg of 5
v56-w03-sub131/5 passed5120.0%HardMediumError Recovery28.5savg of 535.8Kavg of 5
v56-w03-sub145/5 passed55100.0%Long-horizonMediumMulti-step Workflow21.4savg of 529.1Kavg of 5
v56-w03-sub155/5 passed55100.0%HardMediumMulti-step Workflow36.7savg of 566.1Kavg of 5
v56-w03-sub165/5 passed55100.0%EasyShortSchema18.9savg of 527.6Kavg of 5
v56-w03-sub175/5 passed55100.0%HardMediumPagination53.0savg of 5103.9Kavg of 5
v56-w03-sub184/5 passed5480.0%HardMediumError Recovery31.9savg of 548.3Kavg of 5
v56-w03-sub195/5 passed55100.0%Long-horizonMediumAuthentication32.8savg of 549.3Kavg of 5
v56-w03-sub205/5 passed55100.0%HardMediumMulti-step Workflow47.4savg of 567.4Kavg of 5
v56-w04-chain-1to025/5 passed55100.0%Long-horizonLongPagination53.6savg of 586.4Kavg of 5
v56-w04-chain-1to034/5 passed5480.0%Long-horizonLongDiscovery1.5mavg of 5199.3Kavg of 5
v56-w04-chain-1to044/5 passed5480.0%Hard + Long-horizonLongError Recovery50.3savg of 586.5Kavg of 5
v56-w04-chain-1to053/5 passed5360.0%Hard + Long-horizonLongPagination44.9savg of 591.6Kavg of 5
v56-w04-chain-1to065/5 passed55100.0%Hard + Long-horizonLongDiscovery26.5savg of 546.0Kavg of 5
v56-w04-chain-1to074/5 passed5480.0%Hard + Long-horizonLongMulti-step Workflow37.4savg of 572.9Kavg of 5
v56-w04-chain-1to085/5 passed55100.0%Hard + Long-horizonLongSchema41.5savg of 582.8Kavg of 5
v56-w04-chain-1to090/5 passed500.0%Hard + Long-horizonLongAuthentication31.0savg of 542.2Kavg of 5
v56-w04-chain-1to104/5 passed5480.0%Hard + Long-horizonLongError Recovery20.3savg of 532.6Kavg of 5
v56-w04-chain-1to110/5 passed500.0%Hard + Long-horizonLongDiscovery24.0savg of 542.4Kavg of 5
v56-w04-chain-1to125/5 passed55100.0%Hard + Long-horizonLongPagination25.3savg of 546.2Kavg of 5
v56-w04-chain-1to135/5 passed55100.0%Hard + Long-horizonLongPagination26.2savg of 548.9Kavg of 5
v56-w04-chain-1to140/5 passed500.0%Hard + Long-horizonLongAuthentication32.5savg of 546.5Kavg of 5
v56-w04-chain-1to150/5 passed500.0%Hard + Long-horizonLongDiscovery23.2savg of 536.6Kavg of 5
v56-w04-chain-1to165/5 passed55100.0%Hard + Long-horizonLongAuthentication25.3savg of 543.3Kavg of 5
v56-w04-chain-1to175/5 passed55100.0%Hard + Long-horizonLongDiscovery25.9savg of 550.0Kavg of 5
v56-w04-chain-1to182/5 passed5240.0%Hard + Long-horizonLongAuthentication1.3mavg of 5164.8Kavg of 5
v56-w04-chain-1to193/5 passed5360.0%Hard + Long-horizonLongAuthentication29.8savg of 547.5Kavg of 5
v56-w04-chain-1to204/5 passed5480.0%Hard + Long-horizonLongError Recovery21.9savg of 533.5Kavg of 5
v56-w04-sub015/5 passed55100.0%EasyShortAuthentication23.7savg of 534.5Kavg of 5
v56-w04-sub024/5 passed5480.0%EasyShortPagination23.1savg of 530.9Kavg of 5
v56-w04-sub035/5 passed55100.0%EasyShortDiscovery26.1savg of 548.9Kavg of 5
v56-w04-sub045/5 passed55100.0%EasyShortError Recovery27.6savg of 550.5Kavg of 5
v56-w04-sub054/5 passed5480.0%EasyShortPagination26.3savg of 544.8Kavg of 5
v56-w04-sub065/5 passed55100.0%Long-horizonMediumDiscovery30.3savg of 556.5Kavg of 5
v56-w04-sub073/5 passed5360.0%Long-horizonMediumMulti-step Workflow31.5savg of 556.1Kavg of 5
v56-w04-sub085/5 passed55100.0%EasyShortSchema21.2savg of 530.7Kavg of 5
v56-w04-sub095/5 passed55100.0%EasyShortAuthentication31.6savg of 557.9Kavg of 5
v56-w04-sub105/5 passed55100.0%HardMediumError Recovery32.7savg of 554.8Kavg of 5
v56-w04-sub115/5 passed55100.0%EasyShortDiscovery20.8savg of 531.5Kavg of 5
v56-w04-sub125/5 passed55100.0%EasyShortPagination32.2savg of 532.2Kavg of 5
v56-w04-sub135/5 passed55100.0%EasyShortPagination26.7savg of 540.6Kavg of 5
v56-w04-sub140/5 passed500.0%HardMediumAuthentication42.6savg of 561.6Kavg of 5
v56-w04-sub155/5 passed55100.0%EasyShortDiscovery26.6savg of 547.2Kavg of 5
v56-w04-sub165/5 passed55100.0%HardShortAuthentication29.1savg of 555.5Kavg of 5
v56-w04-sub175/5 passed55100.0%EasyShortDiscovery30.8savg of 557.1Kavg of 5
v56-w04-sub184/5 passed5480.0%HardShortAuthentication1.1mavg of 5124.1Kavg of 5
v56-w04-sub195/5 passed55100.0%Long-horizonMediumAuthentication28.5savg of 554.0Kavg of 5
v56-w04-sub205/5 passed55100.0%HardMediumError Recovery23.9savg of 537.3Kavg of 5
v56-w05-chain-1to025/5 passed55100.0%Hard + Long-horizonLongSchema32.3savg of 575.4Kavg of 5
v56-w05-chain-1to035/5 passed55100.0%Hard + Long-horizonLongStatefulness55.9savg of 5110.3Kavg of 5
v56-w05-chain-1to045/5 passed55100.0%Hard + Long-horizonLongPagination24.6savg of 545.0Kavg of 5
v56-w05-chain-1to055/5 passed55100.0%Hard + Long-horizonLongAuthentication56.2savg of 5107.8Kavg of 5
v56-w05-chain-1to060/5 passed500.0%Hard + Long-horizonLongAuthentication1.5mavg of 5212.4Kavg of 5
v56-w05-chain-1to075/5 passed55100.0%Hard + Long-horizonLongSchema21.3savg of 533.1Kavg of 5
v56-w05-chain-1to081/5 passed5120.0%Hard + Long-horizonLongStatefulness50.8savg of 598.0Kavg of 5
v56-w05-chain-1to095/5 passed55100.0%Hard + Long-horizonLongPagination2.1mavg of 5396.2Kavg of 5
v56-w05-chain-1to105/5 passed55100.0%Hard + Long-horizonLongStatefulness18.9savg of 531.4Kavg of 5
v56-w05-chain-1to115/5 passed55100.0%Hard + Long-horizonLongSchema25.4savg of 548.7Kavg of 5
v56-w05-chain-1to120/5 passed500.0%Hard + Long-horizonLongSchema38.3savg of 574.7Kavg of 5
v56-w05-chain-1to130/5 passed500.0%Hard + Long-horizonLongDiscovery22.4savg of 536.8Kavg of 5
v56-w05-chain-1to140/5 passed500.0%Hard + Long-horizonLongPagination1.7mavg of 5266.8Kavg of 5
v56-w05-chain-1to155/5 passed55100.0%Hard + Long-horizonLongSchema25.3savg of 540.5Kavg of 5
v56-w05-chain-1to160/5 passed500.0%Hard + Long-horizonLongDiscovery4.4mavg of 545.7Kavg of 5
v56-w05-chain-1to175/5 passed55100.0%Hard + Long-horizonLongPagination23.7savg of 538.8Kavg of 5
v56-w05-chain-1to185/5 passed55100.0%Hard + Long-horizonLongDiscovery27.7savg of 553.7Kavg of 5
v56-w05-chain-1to195/5 passed55100.0%Hard + Long-horizonLongAuthentication22.4savg of 530.8Kavg of 5
v56-w05-chain-1to201/5 passed5120.0%Hard + Long-horizonLongError Recovery44.8savg of 586.6Kavg of 5
v56-w05-sub011/5 passed5120.0%HardMediumStatefulness41.4savg of 571.5Kavg of 5
v56-w05-sub025/5 passed55100.0%HardShortSchema23.5savg of 535.0Kavg of 5
v56-w05-sub035/5 passed55100.0%EasyShortStatefulness19.6savg of 528.5Kavg of 5
v56-w05-sub045/5 passed55100.0%EasyShortPagination28.5savg of 553.7Kavg of 5
v56-w05-sub051/5 passed5120.0%HardShortAuthentication21.7savg of 535.4Kavg of 5
v56-w05-sub060/5 passed500.0%HardMediumAuthentication2.8mavg of 5545.3Kavg of 5
v56-w05-sub075/5 passed55100.0%EasyShortSchema19.4savg of 528.4Kavg of 5
v56-w05-sub080/5 passed500.0%HardMediumStatefulness21.4savg of 524.3Kavg of 5
v56-w05-sub095/5 passed55100.0%EasyShortPagination16.1savg of 521.2Kavg of 5
v56-w05-sub105/5 passed55100.0%EasyShortStatefulness16.7savg of 524.8Kavg of 5
v56-w05-sub115/5 passed55100.0%HardShortSchema18.8savg of 528.3Kavg of 5
v56-w05-sub123/5 passed5360.0%HardShortSchema36.0savg of 552.8Kavg of 5
v56-w05-sub135/5 passed55100.0%EasyShortDiscovery21.9savg of 530.9Kavg of 5
v56-w05-sub145/5 passed55100.0%Long-horizonMediumPagination25.6savg of 544.3Kavg of 5
v56-w05-sub155/5 passed55100.0%EasyShortSchema21.2savg of 530.4Kavg of 5
v56-w05-sub165/5 passed55100.0%EasyShortDiscovery28.3savg of 554.8Kavg of 5
v56-w05-sub175/5 passed55100.0%EasyShortPagination17.8savg of 519.4Kavg of 5
v56-w05-sub185/5 passed55100.0%EasyShortDiscovery20.2savg of 533.0Kavg of 5
v56-w05-sub195/5 passed55100.0%EasyShortAuthentication25.3savg of 539.8Kavg of 5
v56-w05-sub204/5 passed5480.0%HardShortError Recovery29.9savg of 548.7Kavg of 5
v56-w06-chain-1to024/5 passed5480.0%Hard + Long-horizonLongMulti-step Workflow29.5savg of 551.2Kavg of 5
v56-w06-chain-1to035/5 passed55100.0%Hard + Long-horizonLongAuthentication37.8savg of 579.4Kavg of 5
v56-w06-chain-1to045/5 passed55100.0%Hard + Long-horizonLongStatefulness31.7savg of 558.8Kavg of 5
v56-w06-chain-1to054/5 passed5480.0%Hard + Long-horizonLongStatefulness34.0savg of 561.4Kavg of 5
v56-w06-sub015/5 passed55100.0%HardMediumError Recovery30.2savg of 542.8Kavg of 5
v56-w06-sub025/5 passed55100.0%HardShortMulti-step Workflow24.5savg of 542.5Kavg of 5
v56-w06-sub035/5 passed55100.0%Long-horizonMediumAuthentication25.0savg of 535.6Kavg of 5
v56-w06-sub045/5 passed55100.0%HardShortStatefulness24.4savg of 535.5Kavg of 5
v56-w06-sub055/5 passed55100.0%HardShortStatefulness28.0savg of 538.8Kavg of 5
v56-w06-sub060/5 passed500.0%Pagination1.3mavg of 5123.7Kavg of 5
v56-w08-chain-1to025/5 passed55100.0%Long-horizonLongError Recovery49.5savg of 534.1Kavg of 5
v56-w08-chain-1to030/5 passed500.0%Long-horizonLongPagination38.5savg of 543.7Kavg of 5
v56-w08-chain-1to045/5 passed55100.0%Long-horizonLongAuthentication23.2savg of 541.7Kavg of 5
v56-w08-chain-1to055/5 passed55100.0%Long-horizonLongError Recovery23.1savg of 532.5Kavg of 5
v56-w08-chain-1to065/5 passed55100.0%Long-horizonLongMulti-step Workflow27.7savg of 536.5Kavg of 5
v56-w08-chain-1to075/5 passed55100.0%Hard + Long-horizonLongError Recovery26.7savg of 538.4Kavg of 5
v56-w08-chain-1to085/5 passed55100.0%Hard + Long-horizonLongSchema47.8savg of 569.8Kavg of 5
v56-w08-chain-1to095/5 passed55100.0%Hard + Long-horizonLongMulti-step Workflow42.4savg of 560.0Kavg of 5
v56-w08-chain-1to104/5 passed5480.0%Hard + Long-horizonLongDiscovery29.9savg of 539.6Kavg of 5
v56-w08-chain-1to115/5 passed55100.0%Hard + Long-horizonLongMulti-step Workflow28.6savg of 542.3Kavg of 5
v56-w08-chain-1to120/5 passed500.0%Hard + Long-horizonLongSchema44.6savg of 578.1Kavg of 5
v56-w08-chain-1to130/5 passed500.0%Hard + Long-horizonLongDiscovery25.9savg of 547.5Kavg of 5
v56-w08-chain-1to140/5 passed500.0%Hard + Long-horizonLongDiscovery29.5savg of 552.4Kavg of 5
v56-w08-chain-1to150/5 passed500.0%Hard + Long-horizonLongDiscovery24.0savg of 538.1Kavg of 5
v56-w08-chain-1to160/5 passed500.0%Hard + Long-horizonLongError Recovery26.2savg of 540.3Kavg of 5
v56-w08-chain-1to170/5 passed500.0%Hard + Long-horizonLongPagination27.5savg of 548.9Kavg of 5
v56-w08-chain-1to180/5 passed500.0%Hard + Long-horizonLongSchema27.8savg of 555.6Kavg of 5
v56-w08-chain-1to190/5 passed500.0%Hard + Long-horizonLongDiscovery24.8savg of 542.7Kavg of 5
v56-w08-chain-1to200/5 passed500.0%Hard + Long-horizonLongAuthentication21.8savg of 540.4Kavg of 5
v56-w08-sub014/5 passed5480.0%EasyShortDiscovery21.8savg of 537.2Kavg of 5
v56-w08-sub024/5 passed5480.0%EasyMediumError Recovery31.2savg of 562.6Kavg of 5
v56-w08-sub035/5 passed55100.0%EasyShortPagination17.7savg of 531.6Kavg of 5
v56-w08-sub045/5 passed55100.0%EasyShortAuthentication28.5savg of 544.7Kavg of 5
v56-w08-sub055/5 passed55100.0%EasyShortError Recovery15.8savg of 525.1Kavg of 5
v56-w08-sub065/5 passed55100.0%EasyShortMulti-step Workflow14.7savg of 520.6Kavg of 5
v56-w08-sub075/5 passed55100.0%HardShortError Recovery19.3savg of 531.2Kavg of 5
v56-w08-sub085/5 passed55100.0%HardShortSchema23.2savg of 533.4Kavg of 5
v56-w08-sub095/5 passed55100.0%Long-horizonMediumMulti-step Workflow22.7savg of 535.7Kavg of 5
v56-w08-sub105/5 passed55100.0%HardShortDiscovery19.7savg of 529.5Kavg of 5
v56-w08-sub115/5 passed55100.0%HardShortMulti-step Workflow22.4savg of 534.9Kavg of 5
v56-w08-sub125/5 passed55100.0%HardShortSchema25.5savg of 534.1Kavg of 5
v56-w08-sub135/5 passed55100.0%EasyShortDiscovery20.9savg of 529.9Kavg of 5
v56-w08-sub145/5 passed55100.0%HardShortDiscovery22.9savg of 539.3Kavg of 5
v56-w08-sub155/5 passed55100.0%EasyShortDiscovery22.4savg of 532.9Kavg of 5
v56-w08-sub165/5 passed55100.0%HardMediumError Recovery18.5savg of 529.4Kavg of 5
v56-w08-sub175/5 passed55100.0%HardShortPagination21.6savg of 535.2Kavg of 5
v56-w08-sub185/5 passed55100.0%HardShortSchema22.3savg of 536.5Kavg of 5
v56-w08-sub195/5 passed55100.0%EasyShortDiscovery19.8savg of 530.6Kavg of 5
v56-w08-sub205/5 passed55100.0%EasyShortAuthentication25.0savg of 546.6Kavg of 5
v56-w10-chain-1to025/5 passed55100.0%Hard + Long-horizonLongPagination27.2savg of 553.8Kavg of 5
v56-w10-chain-1to034/5 passed5480.0%Hard + Long-horizonLongPagination42.6savg of 586.8Kavg of 5
v56-w10-chain-1to045/5 passed55100.0%Hard + Long-horizonLongStatefulness25.9savg of 540.1Kavg of 5
v56-w10-chain-1to050/5 passed500.0%Hard + Long-horizonLongMulti-step Workflow19.2savg of 524.1Kavg of 5
v56-w10-chain-1to065/5 passed55100.0%Hard + Long-horizonLongMulti-step Workflow32.9savg of 563.5Kavg of 5
v56-w10-chain-1to075/5 passed55100.0%Hard + Long-horizonLongMulti-step Workflow26.5savg of 543.0Kavg of 5
v56-w10-chain-1to084/5 passed5480.0%Hard + Long-horizonLongError Recovery27.9savg of 536.1Kavg of 5
v56-w10-chain-1to095/5 passed55100.0%Hard + Long-horizonLongSchema38.6savg of 576.5Kavg of 5
v56-w10-chain-1to100/5 passed500.0%Hard + Long-horizonLongError Recovery22.2savg of 529.8Kavg of 5
v56-w10-chain-1to115/5 passed55100.0%Hard + Long-horizonLongStatefulness44.4savg of 5103.0Kavg of 5
v56-w10-chain-1to120/5 passed500.0%Hard + Long-horizonLongError Recovery21.5savg of 523.6Kavg of 5
v56-w10-chain-1to130/5 passed500.0%Hard + Long-horizonLongAuthentication25.1savg of 539.3Kavg of 5
v56-w10-chain-1to140/5 passed500.0%Hard + Long-horizonLongStatefulness33.5savg of 563.5Kavg of 5
v56-w10-chain-1to150/5 passed500.0%Hard + Long-horizonLongMulti-step Workflow32.7savg of 562.6Kavg of 5
v56-w10-chain-1to160/5 passed500.0%Hard + Long-horizonLongStatefulness37.0savg of 538.5Kavg of 5
v56-w10-chain-1to170/5 passed500.0%Hard + Long-horizonLongSchema31.2savg of 558.1Kavg of 5
v56-w10-chain-1to180/5 passed500.0%Hard + Long-horizonLongError Recovery16.5savg of 522.8Kavg of 5
v56-w10-chain-1to190/5 passed500.0%Hard + Long-horizonLongAuthentication23.9savg of 537.1Kavg of 5
v56-w10-chain-1to200/5 passed500.0%Hard + Long-horizonLongAuthentication20.2savg of 528.3Kavg of 5
v56-w10-sub015/5 passed55100.0%Long-horizonLongMulti-step Workflow40.3savg of 577.7Kavg of 5
v56-w10-sub025/5 passed55100.0%Long-horizonMediumPagination22.6savg of 539.4Kavg of 5
v56-w10-sub035/5 passed55100.0%EasyShortPagination20.9savg of 534.5Kavg of 5
v56-w10-sub045/5 passed55100.0%Long-horizonMediumStatefulness21.7savg of 531.3Kavg of 5
v56-w10-sub054/5 passed5480.0%HardMediumMulti-step Workflow24.6savg of 538.4Kavg of 5
v56-w10-sub065/5 passed55100.0%EasyShortMulti-step Workflow17.2savg of 524.9Kavg of 5
v56-w10-sub074/5 passed5480.0%HardMediumMulti-step Workflow20.1savg of 526.1Kavg of 5
v56-w10-sub084/5 passed5480.0%HardMediumError Recovery33.3savg of 552.7Kavg of 5
v56-w10-sub093/5 passed5360.0%HardMediumSchema35.1savg of 573.7Kavg of 5
v56-w10-sub105/5 passed55100.0%EasyShortError Recovery27.8savg of 542.9Kavg of 5
v56-w10-sub114/5 passed5480.0%EasyShortStatefulness24.5savg of 539.1Kavg of 5
v56-w10-sub124/5 passed5480.0%EasyShortError Recovery20.8savg of 529.4Kavg of 5
v56-w10-sub135/5 passed55100.0%EasyShortAuthentication29.7savg of 545.0Kavg of 5
v56-w10-sub144/5 passed5480.0%Long-horizonMediumStatefulness29.0savg of 551.2Kavg of 5
v56-w10-sub155/5 passed55100.0%Long-horizonMediumMulti-step Workflow26.8savg of 549.7Kavg of 5
v56-w10-sub164/5 passed5480.0%EasyShortStatefulness22.6savg of 538.0Kavg of 5
v56-w10-sub175/5 passed55100.0%EasyShortSchema15.0savg of 518.7Kavg of 5
v56-w10-sub185/5 passed55100.0%EasyShortError Recovery20.4savg of 529.2Kavg of 5
v56-w10-sub195/5 passed55100.0%Long-horizonMediumAuthentication35.5savg of 544.8Kavg of 5
v56-w10-sub205/5 passed55100.0%EasyShortAuthentication39.6savg of 543.2Kavg of 5
v56-w11-chain-1to020/5 passed500.0%Hard + Long-horizonLongDiscovery27.1savg of 545.3Kavg of 5
v56-w11-chain-1to035/5 passed55100.0%Hard + Long-horizonLongSchema20.1savg of 526.0Kavg of 5
v56-w11-chain-1to045/5 passed55100.0%Hard + Long-horizonLongMulti-step Workflow30.4savg of 551.1Kavg of 5
v56-w11-chain-1to055/5 passed55100.0%Hard + Long-horizonLongDiscovery31.4savg of 559.1Kavg of 5
v56-w11-chain-1to064/5 passed5480.0%Hard + Long-horizonLongMulti-step Workflow49.4savg of 588.8Kavg of 5
v56-w11-chain-1to072/5 passed5240.0%Hard + Long-horizonLongMulti-step Workflow31.6savg of 557.1Kavg of 5
v56-w11-chain-1to085/5 passed55100.0%Hard + Long-horizonLongStatefulness32.2savg of 564.0Kavg of 5
v56-w11-chain-1to095/5 passed55100.0%Hard + Long-horizonLongPagination27.5savg of 543.3Kavg of 5
v56-w11-chain-1to100/5 passed500.0%Hard + Long-horizonLongDiscovery28.4savg of 553.3Kavg of 5
v56-w11-chain-1to115/5 passed55100.0%Hard + Long-horizonLongError Recovery26.3savg of 541.9Kavg of 5
v56-w11-chain-1to120/5 passed500.0%Hard + Long-horizonLongDiscovery30.0savg of 546.5Kavg of 5
v56-w11-chain-1to135/5 passed55100.0%Hard + Long-horizonLongError Recovery23.5savg of 534.8Kavg of 5
v56-w11-chain-1to145/5 passed55100.0%Hard + Long-horizonLongMulti-step Workflow26.3savg of 552.2Kavg of 5
v56-w11-chain-1to155/5 passed55100.0%Hard + Long-horizonLongStatefulness29.0savg of 558.4Kavg of 5
v56-w11-chain-1to162/5 passed5240.0%Hard + Long-horizonLongDiscovery28.5savg of 536.1Kavg of 5
v56-w11-chain-1to175/5 passed55100.0%Hard + Long-horizonLongDiscovery27.2savg of 549.1Kavg of 5
v56-w11-chain-1to185/5 passed55100.0%Hard + Long-horizonLongError Recovery33.5savg of 554.3Kavg of 5
v56-w11-chain-1to195/5 passed55100.0%Hard + Long-horizonLongMulti-step Workflow22.0savg of 539.1Kavg of 5
v56-w11-chain-1to205/5 passed55100.0%Hard + Long-horizonLongMulti-step Workflow30.9savg of 558.4Kavg of 5
v56-w11-sub015/5 passed55100.0%HardMediumPagination28.5savg of 548.9Kavg of 5
v56-w11-sub020/5 passed500.0%Long-horizonMediumDiscovery16.3savg of 518.4Kavg of 5
v56-w11-sub035/5 passed55100.0%HardMediumSchema21.3savg of 528.7Kavg of 5
v56-w11-sub045/5 passed55100.0%Long-horizonMediumMulti-step Workflow25.1savg of 540.2Kavg of 5
v56-w11-sub055/5 passed55100.0%Long-horizonMediumDiscovery19.1savg of 525.0Kavg of 5
v56-w11-sub065/5 passed55100.0%Long-horizonMediumMulti-step Workflow35.8savg of 567.5Kavg of 5
v56-w11-sub075/5 passed55100.0%Long-horizonMediumMulti-step Workflow25.1savg of 541.5Kavg of 5
v56-w11-sub085/5 passed55100.0%Long-horizonLongStatefulness32.4savg of 573.5Kavg of 5
v56-w11-sub095/5 passed55100.0%Long-horizonMediumPagination32.1savg of 554.9Kavg of 5
v56-w11-sub105/5 passed55100.0%Long-horizonMediumDiscovery20.8savg of 529.6Kavg of 5
v56-w11-sub115/5 passed55100.0%Long-horizonMediumError Recovery24.5savg of 536.5Kavg of 5
v56-w11-sub124/5 passed5480.0%EasyShortDiscovery28.7savg of 535.1Kavg of 5
v56-w11-sub134/5 passed5480.0%EasyShortError Recovery35.5savg of 572.5Kavg of 5
v56-w11-sub145/5 passed55100.0%Long-horizonMediumMulti-step Workflow26.5savg of 539.9Kavg of 5
v56-w11-sub155/5 passed55100.0%Long-horizonMediumStatefulness26.1savg of 541.7Kavg of 5
v56-w11-sub165/5 passed55100.0%Long-horizonMediumDiscovery23.4savg of 537.1Kavg of 5
v56-w11-sub175/5 passed55100.0%Long-horizonMediumDiscovery25.5savg of 541.7Kavg of 5
v56-w11-sub185/5 passed55100.0%Long-horizonMediumError Recovery20.9savg of 529.7Kavg of 5
v56-w11-sub195/5 passed55100.0%HardShortMulti-step Workflow19.1savg of 531.8Kavg of 5
v56-w11-sub205/5 passed55100.0%HardMediumMulti-step Workflow25.2savg of 537.6Kavg of 5
v56-w13-chain-1to025/5 passed55100.0%Hard + Long-horizonLongError Recovery31.5savg of 550.1Kavg of 5
v56-w13-chain-1to035/5 passed55100.0%Hard + Long-horizonLongPagination29.1savg of 555.4Kavg of 5
v56-w13-chain-1to044/5 passed5480.0%Hard + Long-horizonLongPagination23.2savg of 540.8Kavg of 5
v56-w13-chain-1to054/5 passed5480.0%Hard + Long-horizonLongError Recovery25.0savg of 538.0Kavg of 5
v56-w13-chain-1to063/5 passed5360.0%Hard + Long-horizonLongSchema40.6savg of 565.0Kavg of 5
v56-w13-chain-1to075/5 passed55100.0%Hard + Long-horizonLongAuthentication28.3savg of 534.9Kavg of 5
v56-w13-chain-1to085/5 passed55100.0%Hard + Long-horizonLongMulti-step Workflow38.2savg of 577.7Kavg of 5
v56-w13-chain-1to095/5 passed55100.0%Hard + Long-horizonLongStatefulness32.4savg of 554.8Kavg of 5
v56-w13-chain-1to104/5 passed5480.0%Hard + Long-horizonLongSchema26.8savg of 538.7Kavg of 5
v56-w13-chain-1to115/5 passed55100.0%Hard + Long-horizonLongDiscovery33.8savg of 562.3Kavg of 5
v56-w13-chain-1to124/5 passed5480.0%Hard + Long-horizonLongMulti-step Workflow1.1mavg of 575.0Kavg of 5
v56-w13-chain-1to135/5 passed55100.0%Hard + Long-horizonLongAuthentication1.2mavg of 533.6Kavg of 5
v56-w13-chain-1to145/5 passed55100.0%Hard + Long-horizonLongPagination40.3savg of 539.7Kavg of 5
v56-w13-chain-1to153/5 passed5360.0%Hard + Long-horizonLongAuthentication30.4savg of 541.1Kavg of 5
v56-w13-chain-1to164/5 passed5480.0%Hard + Long-horizonLongSchema27.1savg of 535.7Kavg of 5
v56-w13-chain-1to175/5 passed55100.0%Hard + Long-horizonLongDiscovery26.1savg of 548.8Kavg of 5
v56-w13-chain-1to185/5 passed55100.0%Hard + Long-horizonLongStatefulness36.5savg of 563.8Kavg of 5
v56-w13-chain-1to195/5 passed55100.0%Hard + Long-horizonLongSchema23.7savg of 539.4Kavg of 5
v56-w13-chain-1to205/5 passed55100.0%Hard + Long-horizonLongMulti-step Workflow44.9savg of 5100.1Kavg of 5
v56-w13-sub015/5 passed55100.0%HardMediumAuthentication22.9savg of 539.8Kavg of 5
v56-w13-sub025/5 passed55100.0%HardShortError Recovery28.9savg of 542.5Kavg of 5
v56-w13-sub035/5 passed55100.0%EasyShortPagination16.6savg of 514.8Kavg of 5
v56-w13-sub045/5 passed55100.0%EasyShortPagination29.5savg of 550.8Kavg of 5
v56-w13-sub055/5 passed55100.0%Long-horizonMediumError Recovery27.2savg of 546.2Kavg of 5
v56-w13-sub065/5 passed55100.0%HardShortSchema21.2savg of 529.7Kavg of 5
v56-w13-sub075/5 passed55100.0%EasyShortAuthentication21.0savg of 528.8Kavg of 5
v56-w13-sub085/5 passed55100.0%Long-horizonMediumMulti-step Workflow29.9savg of 555.2Kavg of 5
v56-w13-sub095/5 passed55100.0%HardShortStatefulness28.0savg of 543.4Kavg of 5
v56-w13-sub105/5 passed55100.0%EasyShortSchema20.6savg of 526.3Kavg of 5
v56-w13-sub115/5 passed55100.0%EasyShortDiscovery30.7savg of 542.5Kavg of 5
v56-w13-sub125/5 passed55100.0%Long-horizonMediumMulti-step Workflow31.2savg of 567.9Kavg of 5
v56-w13-sub134/5 passed5480.0%EasyShortAuthentication19.8savg of 532.1Kavg of 5
v56-w13-sub145/5 passed55100.0%EasyShortPagination16.1savg of 521.9Kavg of 5
v56-w13-sub155/5 passed55100.0%EasyShortAuthentication22.8savg of 529.3Kavg of 5
v56-w13-sub165/5 passed55100.0%EasyShortSchema19.4savg of 525.8Kavg of 5
v56-w13-sub175/5 passed55100.0%EasyShortDiscovery24.9savg of 540.1Kavg of 5
v56-w13-sub184/5 passed5480.0%Long-horizonMediumStatefulness37.7savg of 554.6Kavg of 5
v56-w13-sub195/5 passed55100.0%HardShortSchema21.8savg of 533.6Kavg of 5
v56-w13-sub204/5 passed5480.0%HardMediumMulti-step Workflow38.2savg of 564.6Kavg of 5
v56-w14-chain-1to024/5 passed5480.0%HardLongStatefulness26.1savg of 537.3Kavg of 5
v56-w14-chain-1to035/5 passed55100.0%Hard + Long-horizonLongAuthentication30.0savg of 554.3Kavg of 5
v56-w14-chain-1to043/5 passed5360.0%Hard + Long-horizonLongSchema25.7savg of 552.0Kavg of 5
v56-w14-chain-1to054/5 passed5480.0%Hard + Long-horizonLongError Recovery33.4savg of 561.7Kavg of 5
v56-w14-chain-1to064/5 passed5480.0%Hard + Long-horizonLongDiscovery25.5savg of 540.1Kavg of 5
v56-w14-chain-1to074/5 passed5480.0%Hard + Long-horizonLongError Recovery20.5savg of 532.6Kavg of 5
v56-w14-chain-1to083/5 passed5360.0%Hard + Long-horizonLongStatefulness28.4savg of 544.9Kavg of 5
v56-w14-chain-1to093/5 passed5360.0%Hard + Long-horizonLongAuthentication19.4savg of 530.2Kavg of 5
v56-w14-chain-1to102/5 passed5240.0%Hard + Long-horizonLongDiscovery20.8savg of 527.7Kavg of 5
v56-w14-chain-1to115/5 passed55100.0%Hard + Long-horizonLongStatefulness27.6savg of 549.2Kavg of 5
v56-w14-chain-1to122/5 passed5240.0%Hard + Long-horizonLongStatefulness29.9savg of 556.4Kavg of 5
v56-w14-chain-1to135/5 passed55100.0%Hard + Long-horizonLongError Recovery28.1savg of 550.7Kavg of 5
v56-w14-chain-1to144/5 passed5480.0%Hard + Long-horizonLongStatefulness27.5savg of 541.3Kavg of 5
v56-w14-chain-1to154/5 passed5480.0%Hard + Long-horizonLongSchema25.2savg of 546.1Kavg of 5
v56-w14-chain-1to160/5 passed500.0%Hard + Long-horizonLongStatefulness27.1savg of 548.0Kavg of 5
v56-w14-chain-1to175/5 passed55100.0%Hard + Long-horizonLongAuthentication30.2savg of 556.0Kavg of 5
v56-w14-chain-1to182/5 passed5240.0%Hard + Long-horizonLongStatefulness35.4savg of 569.2Kavg of 5
v56-w14-chain-1to194/5 passed5480.0%Hard + Long-horizonLongPagination27.8savg of 553.8Kavg of 5
v56-w14-chain-1to202/5 passed5240.0%Hard + Long-horizonLongPagination34.4savg of 561.7Kavg of 5
v56-w14-sub015/5 passed55100.0%HardMediumDiscovery30.7savg of 553.7Kavg of 5
v56-w14-sub023/5 passed5360.0%EasyShortStatefulness31.2savg of 561.3Kavg of 5
v56-w14-sub035/5 passed55100.0%HardMediumAuthentication19.7savg of 532.7Kavg of 5
v56-w14-sub042/5 passed5240.0%EasyMediumSchema39.8savg of 571.4Kavg of 5
v56-w14-sub055/5 passed55100.0%EasyShortError Recovery17.3savg of 526.4Kavg of 5
v56-w14-sub064/5 passed5480.0%EasyShortDiscovery20.7savg of 529.5Kavg of 5
v56-w14-sub075/5 passed55100.0%Long-horizonMediumError Recovery22.2savg of 536.2Kavg of 5
v56-w14-sub085/5 passed55100.0%EasyShortStatefulness23.0savg of 540.1Kavg of 5
v56-w14-sub095/5 passed55100.0%EasyShortAuthentication21.9savg of 538.6Kavg of 5
v56-w14-sub105/5 passed55100.0%EasyShortDiscovery20.3savg of 535.5Kavg of 5
v56-w14-sub115/5 passed55100.0%EasyShortStatefulness24.0savg of 533.5Kavg of 5
v56-w14-sub125/5 passed55100.0%Long-horizonMediumStatefulness31.5savg of 544.4Kavg of 5
v56-w14-sub135/5 passed55100.0%HardShortError Recovery23.0savg of 537.6Kavg of 5
v56-w14-sub144/5 passed5480.0%Long-horizonShortStatefulness26.7savg of 543.5Kavg of 5
v56-w14-sub155/5 passed55100.0%EasyShortSchema23.7savg of 542.7Kavg of 5
v56-w14-sub165/5 passed55100.0%Long-horizonMediumStatefulness25.7savg of 540.7Kavg of 5
v56-w14-sub171/5 passed5120.0%HardShortAuthentication32.7savg of 556.6Kavg of 5
v56-w14-sub185/5 passed55100.0%Long-horizonShortStatefulness29.4savg of 558.8Kavg of 5
v56-w14-sub194/5 passed5480.0%EasyShortPagination35.5savg of 561.7Kavg of 5
v56-w14-sub205/5 passed55100.0%EasyShortPagination20.0savg of 533.5Kavg of 5
v56-w16-chain-1to025/5 passed55100.0%Long-horizonLongDiscovery32.5savg of 554.1Kavg of 5
v56-w16-chain-1to035/5 passed55100.0%Hard + Long-horizonLongError Recovery25.5savg of 531.7Kavg of 5
v56-w16-chain-1to042/5 passed5240.0%Hard + Long-horizonLongDiscovery48.6savg of 571.4Kavg of 5
v56-w16-chain-1to055/5 passed55100.0%Hard + Long-horizonLongError Recovery27.9savg of 542.8Kavg of 5
v56-w16-chain-1to064/5 passed5480.0%Hard + Long-horizonLongMulti-step Workflow44.2savg of 597.9Kavg of 5
v56-w16-chain-1to074/5 passed5480.0%Hard + Long-horizonLongMulti-step Workflow34.6savg of 553.1Kavg of 5
v56-w16-chain-1to085/5 passed55100.0%Hard + Long-horizonLongAuthentication23.2savg of 532.6Kavg of 5
v56-w16-chain-1to095/5 passed55100.0%Hard + Long-horizonLongMulti-step Workflow22.4savg of 536.8Kavg of 5
v56-w16-chain-1to102/5 passed5240.0%Hard + Long-horizonLongAuthentication30.9savg of 540.1Kavg of 5
v56-w16-chain-1to115/5 passed55100.0%Hard + Long-horizonLongStatefulness30.4savg of 553.7Kavg of 5
v56-w16-chain-1to124/5 passed5480.0%Hard + Long-horizonLongAuthentication30.0savg of 544.8Kavg of 5
v56-w16-chain-1to135/5 passed55100.0%Hard + Long-horizonLongSchema38.4savg of 559.1Kavg of 5
v56-w16-chain-1to145/5 passed55100.0%Hard + Long-horizonLongSchema26.5savg of 545.1Kavg of 5
v56-w16-chain-1to155/5 passed55100.0%Hard + Long-horizonLongError Recovery28.0savg of 549.5Kavg of 5
v56-w16-chain-1to165/5 passed55100.0%Hard + Long-horizonLongStatefulness38.3savg of 579.9Kavg of 5
v56-w16-chain-1to175/5 passed55100.0%Hard + Long-horizonLongMulti-step Workflow57.0savg of 5110.6Kavg of 5
v56-w16-chain-1to185/5 passed55100.0%Hard + Long-horizonLongPagination37.2savg of 568.1Kavg of 5
v56-w16-chain-1to190/5 passed500.0%Hard + Long-horizonLongDiscovery28.0savg of 543.1Kavg of 5
v56-w16-chain-1to201/5 passed5120.0%Hard + Long-horizonLongMulti-step Workflow28.9savg of 555.1Kavg of 5
v56-w16-sub015/5 passed55100.0%Long-horizonMediumPagination29.8savg of 554.5Kavg of 5
v56-w16-sub024/5 passed5480.0%Long-horizonMediumDiscovery27.6savg of 543.2Kavg of 5
v56-w16-sub035/5 passed55100.0%HardMediumError Recovery25.5savg of 533.5Kavg of 5
v56-w16-sub045/5 passed55100.0%Long-horizonMediumDiscovery1.5mavg of 540.0Kavg of 5
v56-w16-sub051/5 passed5120.0%HardMediumError Recovery33.0savg of 548.0Kavg of 5
v56-w16-sub065/5 passed55100.0%Long-horizonMediumMulti-step Workflow25.8savg of 543.3Kavg of 5
v56-w16-sub075/5 passed55100.0%Long-horizonMediumMulti-step Workflow34.5savg of 559.8Kavg of 5
v56-w16-sub084/5 passed5480.0%EasyShortAuthentication23.8savg of 537.9Kavg of 5
v56-w16-sub095/5 passed55100.0%Long-horizonShortMulti-step Workflow19.5savg of 528.8Kavg of 5
v56-w16-sub105/5 passed55100.0%Long-horizonMediumAuthentication24.8savg of 536.7Kavg of 5
v56-w16-sub115/5 passed55100.0%Long-horizonMediumStatefulness21.5savg of 528.9Kavg of 5
v56-w16-sub125/5 passed55100.0%Long-horizonMediumAuthentication27.6savg of 537.5Kavg of 5
v56-w16-sub135/5 passed55100.0%HardShortSchema22.4savg of 526.5Kavg of 5
v56-w16-sub145/5 passed55100.0%Long-horizonMediumSchema20.0savg of 526.4Kavg of 5
v56-w16-sub154/5 passed5480.0%Long-horizonMediumError Recovery26.7savg of 533.9Kavg of 5
v56-w16-sub165/5 passed55100.0%Long-horizonMediumStatefulness33.0savg of 561.9Kavg of 5
v56-w16-sub175/5 passed55100.0%Long-horizonLongMulti-step Workflow47.3savg of 5117.2Kavg of 5
v56-w16-sub185/5 passed55100.0%Long-horizonMediumPagination29.5savg of 556.3Kavg of 5
v56-w16-sub195/5 passed55100.0%EasyShortDiscovery22.8savg of 530.5Kavg of 5
v56-w16-sub205/5 passed55100.0%Long-horizonMediumMulti-step Workflow29.1savg of 546.8Kavg of 5
v56-w18-chain-1to020/5 passed500.0%Hard + Long-horizonLongDiscovery44.6savg of 576.8Kavg of 5
v56-w18-chain-1to035/5 passed55100.0%Hard + Long-horizonLongAuthentication26.7savg of 533.5Kavg of 5
v56-w18-chain-1to040/5 passed500.0%Hard + Long-horizonLongStatefulness1.5mavg of 5190.9Kavg of 5
v56-w18-chain-1to055/5 passed55100.0%Hard + Long-horizonLongStatefulness39.1savg of 559.0Kavg of 5
v56-w18-chain-1to062/5 passed5240.0%Hard + Long-horizonLongSchema41.3savg of 547.9Kavg of 5
v56-w18-chain-1to070/5 passed500.0%Hard + Long-horizonLongSchema38.0savg of 550.2Kavg of 5
v56-w18-chain-1to080/5 passed500.0%Hard + Long-horizonLongDiscovery21.6savg of 527.0Kavg of 5
v56-w18-chain-1to094/5 passed5480.0%Hard + Long-horizonLongMulti-step Workflow37.8savg of 552.5Kavg of 5
v56-w18-chain-1to105/5 passed55100.0%Hard + Long-horizonLongAuthentication25.7savg of 533.3Kavg of 5
v56-w18-chain-1to115/5 passed55100.0%Hard + Long-horizonLongStatefulness38.3savg of 556.2Kavg of 5
v56-w18-chain-1to120/5 passed500.0%Hard + Long-horizonLongError Recovery2.0mavg of 5273.6Kavg of 5
v56-w18-chain-1to130/5 passed500.0%Hard + Long-horizonLongPagination47.7savg of 582.7Kavg of 5
v56-w18-chain-1to145/5 passed55100.0%Hard + Long-horizonLongSchema52.5savg of 583.5Kavg of 5
v56-w18-sub015/5 passed55100.0%HardMediumSchema37.1savg of 544.7Kavg of 5
v56-w18-sub020/5 passed500.0%HardMediumDiscovery31.4savg of 551.7Kavg of 5
v56-w18-sub035/5 passed55100.0%Long-horizonShortAuthentication24.1savg of 532.0Kavg of 5
v56-w18-sub041/5 passed5120.0%HardMediumStatefulness2.6mavg of 5376.1Kavg of 5
v56-w18-sub055/5 passed55100.0%HardMediumStatefulness24.3savg of 537.0Kavg of 5
v56-w18-sub064/5 passed5480.0%EasyShortSchema20.4savg of 526.9Kavg of 5
v56-w18-sub075/5 passed55100.0%EasyShortSchema23.2savg of 528.3Kavg of 5
v56-w18-sub085/5 passed55100.0%EasyShortDiscovery24.4savg of 537.2Kavg of 5
v56-w18-sub095/5 passed55100.0%HardMediumMulti-step Workflow29.6savg of 535.9Kavg of 5
v56-w18-sub105/5 passed55100.0%EasyShortAuthentication25.5savg of 539.8Kavg of 5
v56-w18-sub115/5 passed55100.0%EasyShortStatefulness30.1savg of 552.4Kavg of 5
v56-w18-sub125/5 passed55100.0%EasyShortError Recovery24.7savg of 529.4Kavg of 5
v56-w18-sub135/5 passed55100.0%EasyShortPagination25.3savg of 542.9Kavg of 5
v56-w18-sub145/5 passed55100.0%EasyShortSchema27.2savg of 536.8Kavg of 5
v56-w18-sub151/5 passed5120.0%Multi-step Workflow1.8mavg of 5267.1Kavg of 5