I've found 96kHz file to be far to0 large for the real gain in audio quality. I've also not found a need for higher quality in my home studio either.
These drivers will give you the best latency and most reliable performance.
For PC users find out if there is an ASIO driver available for your audio interface (I'm told CoreAudio is often best for Mac). Also the age and version of your OS can mean the difference between your new gear working out of the box, or not at all. Things to highly consider here and PC vs Mac and 32bit OS vs 64 bit. The real catch here is whether there are software drivers to run your new interface, that work with your OS.
If you're new to recording, you may want to start by using the software that comes with your audio interface. Many audio interfaces come with recording software. What recording software or DAW will you be using? This can often be a "kill two birds with one stone" situation.Nothing worse than buying a new interface and realizing you'd have to disconnect your mouse to actually use it.
Also, make sure you have a free port (USB or Firewire) on the computer you intend to record with. Nowadays this decision has little to do with actual performance as both styles will work well. In this case you need to know which one is best for you. Interfaces are more often than not, designed to work with one connection type or the other.