So I hooked up my multi-meter and when my amp freaks out my HU is still sending out the proper voltage through the remote wire.. So Im pretty sure my HU is not at fault. When it freaked out today the amps power light would blink randomly and the protect light would flash a few times and then it stayed off for 10 seconds. Then it came back on and started playing music again.
So my only guess now are my RCA's, AMP, or my + and - runs. Im gonna toss in a different set of RCA's, and hook up my multi-meter to my amps + and - and see what it says when it happens again.