It was the power. FAR too much draw for the crappy stock batt and 100amp alt. Need to upgrade to 180amp alt and better batt.
I found out what the issue was though and why it was intermittent. After countless hours messing with the ground, I went out and bought a ac/dc converter that displayed how charged my batt was. I was at 13% when I first hooked it up, I charged it to 100% 3 days ago, drove less than 20 miles, granted pushing the system pretty hard the whole time, but still it happened again today. I checked the batt and it was at 20%. With my new dist block that shows how much voltage im getting I played around with it a little and it appears the batt is designed to drop the voltage below 12 when the batt life drops below 20%. When the voltage dropped below 12, the high power (both 1500w AP and 2400w Pioneer) failed to complete the start up sequence and shut down. I charged the car back up, amp worked exactly as expected.
So when it kept cutting in and out with no rhyme or reason, it was based on the batt charge. When the batt dropped below 20% the amp wouldn't start, without the draw from that amp the alt was able to charge the batt slightly and get it back over the hump and then the amp would work, it appears that the amp will only shut down if the voltage drops below 12 (meaning the batt is lower than 20%) when you start the car. If you start it at 20% and the amp completes its start-up cycle, it will continue working when the batt drops below 20%, but won't work the next time you start the car until the alt has charged it back up over 20%.
Lesson learned, don't try to push over 3k watts with stock Corolla power, you will fail.