If you stop the speaker from moving with your hands, yes, it will sound different.
Easiest way to check for blown speaker is to put a multimeter across the + and - posts and measure resistance across the voice coil(s). 4ohm will be somewhere 3.2-3.5 ohms, 2ohm somwhere around 1.6-1.9. Blown...