Some hard drives draw a lot of power from the USB port so you have to be cautious of that. Western digital and Seagate, Lacie, seems to be pretty low consumption.
Otherwise get a "high speed" flash drive and be done with it. A 16-64GB flash drive still holds quite a bit of music and they make some slim ones that won't stick out too much.