For subs? Very little to none, although some metal cone subs have failure issues when put under a lot of stress, and others are just plain built badly.
For midbasses/midranges, it will depend on what crossover frequency and slope you need...aluminum or magnesium cone mids have breakup nodes that generally require lower crossover points and/or steeper slopes than paper or poly cones will.