I got this email today from Art of Manliness. It outlines five standards for every man from Earle Liederman. It does not discuss the point of diminishing returns, but it does paint a broad picture of physical preparation.
Every Man Should Be Able to Save His Own Life: 5 Fitness Benchmarks a Man Must Master | The Art of Manliness