As I already suggested, too big would be dependant on your tastes/goals/available power.
In the few subs/enclosures I've experimented w/ I've found the manufacturers max suggested volume to be my preferred "middle ground". IMO the manufacturers just extend the suggested volume to the small side of 'ideal', to appeal to those w/ space concerns. Your best bet would be to build your own enclosures @ a minimal expense & experiment w/ different sizes to see what works best for you.