Could the HU be the source?
Get one of these (if for no other reason, it's great to test things with),
https://www.amazon.com/dp/B0FC6K3GNR/?tag=caraudiocom-20
Plug it into your phone or laptop and see if, after doing the same test, you still get rattling,
When testing, use 1 RCA for the channel/speaker you're testing.
If, after doing these things, you still have noises emanating from the speakers in any fashion. Undo all the connections, clean it up using a microscope to make sure something isn't hanging around on the power/ground/remote or the RCA/Hi-level inputs (if applicable). And for the last thing, make sure that the RCA inputs are not shorting or lose, giggle them a bit, see if anything changes.
After that, yeah, I'd say it's internal to the amp.
This could be tested by disconnecting all the speakers too, connecting one of the speaker terminal leads to a bookshelf speaker or anything really, listen for the noise. If it's the amp, it should show up on another speaker too.