Its it bad to put a magnet near a speaker? specifically the speaker cone so that a magnet tension is evident? Is there any harmful side affect in the long run?

Tim