If you want some good rims, but want to maintain great ride quality, stick with 20's.
If you want bigger rims and are willing to sacrifice a bit of ride quality, but gain a lot of handling improvement and get looks, get 22's.
If you don't mind sacrificing a pretty noticeable amount of ride quality, don't mind watching for big potholes, and want gawker, get 24's.
In my opinion, I wouldn't have anything bigger than 22's on a daily driver. Plenty of people do 24's on daily drivers, and some even do 26's, but that's not for me. I like the balance of looks and functionability of 22's. I put 22's on my Tahoe.