Notice: Your browser is not supported or outdated so some features of the site might not be available.

Test Bench 0.8.1  
Changelog

 0
Updated 

Running Shoes Test Bench 0.8.1 introduces a range of changes to both the usages and test methods to improve the accuracy and usefulness of our scoring system.

Our original Test Bench 0.8 introduced performance tests for energy return, stability, and cushioning, along with design-related metrics like weight, shape, and stack height. To learn more about our original testing approach, check out our article from the R&D team.

While the methodology remains solid, expanding our sample size (by testing more models) revealed edge cases where performance results didn't fully align with real-world experience. This prompted some fine-tuning to better reflect user expectations. In particular, we updated the lateral stability and marathon racing usage evaluations by adding new tests and adjusting the underlying test methodology.

What's Changed?

Test GroupDescription
Design | External Shape
  • New Heel Width-To-Stack Ratio test
  • New Forefoot Width-To-Stack Ratio test
Design | Stack Heights
  • In Test Bench 0.8, higher stacks negatively impacted the Lateral Stability usage score because they made the shoe less stable by raising the foot further from the ground. This is now handled by the more precise Width-To-Stack Ratio tests (above), which account for both height and platform width to better handle edge cases.
  • Instead, the Heel and Forefoot stack height tests are now used as components of the Marathon Racing usage, where a higher stack provides more protection over long distances. This aligns with current design trends in long-distance super shoes, which all feature tall midsoles, hence the reversal in the scoring spline.
Design | Internal Shape
  • New Wide Sizing Availability information to align with the Variants box
Design | Weight
  • Minor adjustments made to the scoring splines for the weight test
Performance | Heel and Forefoot cushioning
  • Minor adjustments made to the scoring splines of the energy absorption test for both the heel and forefoot at all force levels (300N, 600N, 900N) based on insights gained from a larger pool of tested models

These test updates are intended to feed directly into the usage and performance usage boxes. Here's how those changes play out and why they matter.

Verdicts And Usages

The main driver behind this test bench was the expansion of our tested model pool after launch. As we tested more shoes, new scenarios emerged that revealed edge cases where the scores, particularly in the Marathon Racing usage and its lateral stability component, didn't accurately reflect real-world performance or known user feedback. Specifically, some lightweight, carbon-plated shoes with high energy absorption (cushioning) and energy return scored well in the Marathon Racing box, even though they weren't designed for or suited to that usage. A good example is the Nike Streakfly 2: a low-to-the-ground, minimal model built for short, fast efforts (5K to 10K) that lacks the cushioning and protection required for longer distances. Its low stack height boosted its lateral stability score, but its narrow platform (which negatively impacts lateral stability) wasn't taken into account directly in relation to that stack height. This update addresses that by incorporating stack height directly into the Marathon Racing usage and introducing a width-to-stack-height ratio to better account for lateral stability.

Usages/Performance UsagesDescription
Marathon Racing
  • Stack height is now directly factored into the score. Since higher stacks offer more protection over long distances, greater stack heights positively affect the score.
  • Slightly increased the influence of the Lateral Stability component within the Marathon Racing box.
  • Slightly reduced the weighting of the Energy Return, Cushioning, Weight, and Plate components.
Lateral Stability
  • Introduced the heel and forefoot width-to-stack-height ratio as a component that replaces the heel stack height component
  • Added Outsole Forefoot Width as a component
  • Slightly reduced the weighting of the Outsole Arch Width, Heel Firmness, Outsole Heel Width, Forefoot Firmness, Tongue Gusset Type, and Plate components.
An image of the Our Verdict box for the Nike Vaporfly 4 under the 0.8 methodology.
The Our Verdict box from the Nike Vaporfly 4 review, as seen in Test Bench 0.8.

Here's an example of how the changes impact the Nike Vaporfly 4 review. Positioned as a middle-ground option in Nike's racing lineup, it's well-suited for mid-distance efforts (10K to half-marathon), but it's not specifically optimized for the marathon. With the updated methodology, its Marathon Racing score drops slightly, taking into account its lower stack height compared to true long-distance super shoes. At the same time, its Lateral Stability score improves slightly, acknowledging that while the shoe isn't highly stable, it's not particularly unstable either. This is now better captured through the new ratio between platform width and stack height, offering a more accurate picture of its real-world stability.

An image of the Our Verdict box for the Nike Vaporfly 4 under the 0.8.1 methodology.
The Our Verdict box from the Nike Vaporfly 4 review, as seen in Test Bench 0.8.1.

We applied the same logic across all retested models, so the affected scores have been updated accordingly. Another example is shoes with ultra-high stack heights, like the HOKA Skyward X. Although models like this often feature wide platforms, that width only partially offsets the instability caused by the tall stack of foam, which raises the foot far off the ground and can feel wobbly. By factoring in the ratio between stack height and base width, the updated method slightly lowers the stability score, offering a more realistic reflection of actual performance.

Let Us Know What You Think!

Overall, this update provides a more accurate reflection of real-world running shoe performance and better aligns with user feedback. While our test methodology still doesn't capture every factor experienced runners consider when choosing a running shoe, it's a step in the right direction. If you have suggestions or ideas to help us improve our reviews, feel free to comment on any page or reach out at feedback@rtings.com. Your input has been essential in shaping our tests, and we're grateful for it!

55 Running Shoes Updated

We have retested popular models. The test results for the following models have been converted to the new testing methodology. However, the text might be inconsistent with the new results.

Comments

  1. Article

Test Bench: Marathon and Stability Usage Fixes: Main Discussion

What do you think of our article? Let us know below.


Want to learn more? Check out our complete list of articles and tests on the R&D page.

PreviewBack to editorFormat guide
No comments yet, refresh to see new ones