First, yes a router is advisable to maintain consisten multi-connections. I prefer Linksys, but many also use D-Link. Wireless is slower than a wired local LAN(100Mbps vs 54Mbps wired G), however an internet connection runs between 1-5 Mbps, so a wireless connection won't be any slower with internet than a wired connection is. As long as your signal is strong you shouldn't experience any drops. Make sure you get a wireless "G" router. That is the fastes wireless class. Your wifi cards on the PCs will also need to be wireless G. If you want to go Linksys here is a good combo.
Router
http://www.newegg.com/Product/Product.asp?Item=N82E16833124190
USB 2.0 Adapter
http://www.newegg.com/Product/Product.asp?Item=N82E16833124187
or PCI adapter
http://www.newegg.com/Product/Product.asp?Item=N82E16833124139