Wow I'm stupid. When I was turning the volume knob on sub control all it was doing was turning the volume up or down, so not only was the sub getting louder or quieter, the music was as well. (All I was doing was turning the volume up or down)
I'm going to check my RCAs tomorrow but I don't...