It depends on the driver and the intended passband in which you want to operate the driver. For example, CDT recommends mounting their ES-02 and HD-2 2" mid/tweeters into a 2" PVC endcap if you will run them down to 250 Hz, which is the published low end of the frequency response range. You would not want to use an enclosure smaller than that if you expected good results down to 250 Hz. This is the same concept as designing a subwoofer enclosure.