I rechecked everything and it's connected to the memory wire. I checked online to see which factory wire is the power and remote. What I gathered was yellow is the remote and orange is the power (96 saturn). I looked at the little wiring harness crutchfield gives you and it has the two reversed so I am confused. is the remote on the original harness yellow, or orange. Is it possible the harness is defective (has the wires switched)?
90% of the time on aftermarket hu's, the remote wire is blue/white. and make sure you disconnect the amp somehow if it's still on when the car's off, otherwise you'll drain your battery.
I looked again and tried connecting the remote to the power wire and it works perfectly. Turns off when the radio is off and on when it's on. That means the adapter is wrong. wierd.
The memory wire is a constant hot wire. It allows your radio to keep the pre-set channels and clock. NO this is not the place to conncte the remote wire too.