Interesting you mention this test, as Ive related a similar test for this topic before:
Pick up two pebbles off the ground and place one in each hand. Shake them back and forth vigorously. Eventhough the pebbles are approximately the same size, there obviously is some slight different in weight between the two. When your arm shook them back and forth, did this difference in mass make any noticeable difference in the movement of your arm? There was a mass difference, and it did affect the speed at which you shook each arm, but it did not create any noticeable change. This is also true when comparing the few gram differences between cone sizes of speakers in relation to the amount of force they have with which to excurt on said cones. There is a mass difference, and it does affect the things you are suggesting here, but what you are missing is everyone is telling you those factors you are questioning are simply too small of a factor to need consideration (much like the actual mass difference between the two pebbles).
Lastly, why do people assume a speaker was designed with the smallest size only taken into consideration. If a manufacturer is capable of producing a motor with sufficient force to adequately control a 12" diaprhagm, why would we assume they cannot do the same for an 18" version? IMO, those who say 18's are so much sloppier than 12's are assuming the motor was designed for the perameters of a 12" cone, then they just slapped an 18" cone on it. Perhaps, and if they were smart this is true, the speaker designers designed the motor while keeping in mind it would be accomodating an 18" cone, and design it thusly. Thereby creating a speaker capable of a certain performance level given a certain MMs, and any lowering of that MMs (building smaller cone versions) would produce no audible gains.
When chosing a cone size, several factors need to be considered like space available, output desired, frequency response needed, etc etc. But, transient response based on some notion of MMs figures or cone diameter is not a consideration.