I can't believe I am about to type this... but, I bypassed a fuse on my Punch 150 that kept blowing fuses while I was in high school (late 80s) and it caught on fire! Prior to the fire, Rockford Fosgate kept telling me to use a bigger fuse, use a bigger fuse, and when the amp continued to blow 45 amp fuses, instead of the 25 it originally called for, I hardwired it!
At least they repaired it under warranty //content.invisioncic.com/y282845/emoticons/biggrin.gif.d71a5d36fcbab170f2364c9f2e3946cb.gif even though I lied and said it went into flames with the 45 amp fuse....
The main thing that would worry me about not fusing would be a car accident. You can't prevent them nor can you predict when they will happen to you. Furthermore, you haven't the slightest clue which wires will get pinched thus creating another hazard on top of the accident.