Running an amp at 300 watts with a 4v signal will require just as much out of the amp as running the amp at 300 watts with a 2v signal. The amp works just as hard either way. However, a 4v signal will have a lower noise floor than a 2v signal. Running a line driver is only useful if you have your gain on your amp all the way up and you're still not getting your maximum RMS wattage. Running a line driver will not help your amp, nor will it clean up your signal (the line driver also boosts the noise in the 2v signal), it will only allow you to use all of your amps output IF you cannot do so already.
2 volts is usually fine. If it's not, than get a line driver. Chances are that either way, you're not going to hear the noise while music is playing. Especially not while the car is moving.