It really depends on what the amp is DESIGNED to do. Most are more efficient at higher impedence, but will give you a lot more output at lower loads. It is generally accepted that higher impedence sounds better.
Typically we're trading off between cost/power output vs. consumption/size/etc.