Test Bench 1.1  

Test Bench 1.1

Changelog

 0
By Robin Bonneau PatryUpdated Nov 16, 2026 at 09:57 am

With Test Bench 1.1, we're measuring how running shoes affect runners' efficiency. Our initial selection includes 20 models spanning daily trainers, super trainers, and super shoes from multiple brands. To our knowledge, this is the first independent comparison of running economy across a group of runners to cover this many models.

Our existing tests for energy return and cushioning, along with those developed to evaluate responsiveness, already measured properties that can influence running economy. What was missing was a standardized method for directly measuring running economy.

This test bench update adds running economy testing, bringing us closer to understanding the full picture of how a shoe affects a runner's performance. Running economy is the energy your body needs to maintain a given pace, which we assess by measuring oxygen consumption. Using less oxygen at the same speed means better running economy.

Our R&D article covers the full testing protocol and our findings, but here are the basics.

Six experienced runners tested each shoe on a treadmill using a VO2 Master analyzer. Each ran at their own marathon pace, keeping that pace unchanged across all shoes; the speed therefore differed between runners. We averaged oxygen consumption over the final two minutes of each five-minute trial, allowing time for it to stabilize.

To improve precision and reduce the influence of fatigue and day-to-day variation, we divided the shoes into three batches. We tested each batch twice per runner, reversing the shoe order for the second session. Food and fluid intake were also standardized. Each of the 6 sessions included the HOKA Clifton 11 as our control and the Nike Vaporfly 4 as our advanced footwear technology (AFT) reference to help account for and adjust for differences between sessions.

What's Changed

Test Group Description
Performance | Average Running Economy
  • Measures the average adjusted improvement in running economy across six runners relative to the control shoe.
  • A higher percentage means a greater reduction in oxygen consumption at the same pace.
Performance | Runner Variance
  • Measures how much the benefit differs between runners.
  • 'Standard Deviation' summarizes the spread of their adjusted gains, with a lower value meaning more consistent results across the group.
Performance | Runner 1–6
  • Reports each runner's VO₂ In Shoe, VO₂ In Control Shoe, and VO₂ In AFT Reference, alongside their Running Economy Gain Vs Control and Adjusted Running Economy Gain.
  • The adjusted gain uses the AFT reference to account for session differences.

The average results show how oxygen consumption compares across the tested shoe and both references. Lower oxygen consumption at the same pace means the runners maintained that pace more economically. This helps you identify shoes that could reduce the effort needed to sustain your pace.

A graph with the average Running Economy results for the adidas Adizero Adios Pro Evo 3.
Average Running Economy results for the adidas Adizero Adios Pro Evo 3. The dashed lines show average oxygen consumption over the final two minutes for the tested shoe, the HOKA Clifton 11 control, and the Nike Vaporfly 4 reference.

Runner Variance shows how consistently a shoe improved running economy across our runners. A lower standard deviation means runners saw similar benefits and earns a higher Runner Variance usage score. A higher standard deviation indicates less consistent benefits and results in a lower usage score. In this example, all six runners benefited, but one improved much less than the others.

A graph showing the Runner Variance results for the adidas Adizero Adios Pro Evo 3.
Runner Variance results for the adidas Adizero Adios Pro Evo 3. Each point represents one runner's adjusted gain over the control; the shaded area spans one standard deviation above and below the group average.

For a closer look, the individual runner sections let you explore each person's results alongside their running form. Open a runner's tooltip to see their age, height, weight, marathon pace, foot strike, and cadence.

A screenshot of Runner 3's profile tooltip from the adidas Adizero Adios Pro Evo 3 review.
Runner 3's profile tooltip from the adidas Adizero Adios Pro Evo 3 review.

These profiles provide context, but keep in mind that someone with similar characteristics could respond very differently to the same shoe. That's why our main results emphasize the average across runners rather than treating any one profile as a prediction for you.

Verdicts And Usages

Together, Average Running Economy and Runner Variance form our new Running Economy performance usage. It places most of the weight on the average benefit while also considering how consistently runners experience that benefit.

Performance Usage Description Weighting
Running Economy Evaluates how effectively a shoe reduces oxygen consumption at a given pace across our runners.

Running Economy score calculated using:

  • Average Running Economy (90%)
  • Runner Variance (10%)

Conclusion

You can now compare which shoes helped our runners maintain their pace with less oxygen and how widely that benefit varied. These measurements complement our existing tests, bringing us closer to understanding how a shoe's properties translate into running performance.

For now, this testing covers our initial selection of 20 models. We may expand that selection through additional rounds of testing, although we don't expect to test every shoe for running economy.

Let Us Know What You Think

Let us know what you think of these additions and which models you'd like to see included in future testing. You can leave a comment below or email feedback@rtings.com.

We are retesting popular models first. So far, the test results for the following models have been converted to the new testing methodology. However, the text might be inconsistent with the new results.

    257 Running Shoes Planned To Be Updated

    We are also planning to retest the following products over the course of the next few weeks: