Yes. The surrounds can harden/deteriorate, the glue can shrink and crack away... You can get dust on it...
But otherwise, speakrs getting used are generally in more trouble than ones on a shelf, except with regular use the surround isn't going to harden, it will just break.