by Rob Williams on December 8, 2008 in Graphics & Displays
Two weeks ago, we published a performance comparison between NVIDIA’s GTX 260/216 and ATI’s HD 4870 1GB. What we found was that NVIDIA had the upper-hand, both in performance, and efficiency. Today, we’re re-testing ATI’s card with their new 8.12 driver, to see if it can increase performance enough to sway our decision as to which is the better card.
At Techgage, we strive to make sure our results are as accurate as possible. Our testing is rigorous and time-consuming, but we feel the effort is worth it. In an attempt to leave no question unanswered, this page contains not only our testbed specifications, but also a fully-detailed look at how we conduct our testing.
If there is a bit of information that we’ve omitted, or you wish to offer thoughts or suggest changes, please feel free to shoot us an e-mail or post in our forums.
The below table lists our testing machine’s hardware, which remains unchanged throughout all GPU testing, minus the graphics card. Each card used for comparison is also listed here, along with the driver version used. Each one of the URLs in this table can be clicked to view the respective review of that product, or if a review doesn’t exist, it will bring you to the product on the manufacturer’s website.
For each card, we used the absolute latest driver version possible. For NVIDIA, we used 180.48, which became a significant release for the company. It brought multi-monitor SLI, dedicated GPU PhysX and general performance enhancements to the table. ATI’s 8.11 Catalyst driver wasn’t as significant of a release, but their upcoming 8.12 is aiming to deliver important performance increases, similar to NVIDIA’s release.
When preparing our testbeds for any type of performance testing, we follow these guidelines:
- No power-saving options are enabled in the motherboard’s BIOS.
- Internet is disabled.
- No Virus Scanner or Firewall is installed.
- The OS is kept clean; no scrap files are left in between runs.
- Hard drives affected are defragged with Diskeeper 2008 prior to a fresh benchmarking run.
- Machine has proper airflow and the room temperature is 80°F (27°C) or less.
Windows Vista Optimizations
- User Account Control (UAC) and screen saver are disabled.
- Windows Defender, Firewall, Security Center, Search, Sidebar and Updates are disabled.
To aide with the goal of keeping accurate and repeatable results, we alter certain services in Windows Vista from starting up at boot. This is due to the fact that these services have the tendency to start up in the background without notice, potentially causing slightly inaccurate results. Disabling “Windows Search” turns off the OS’ indexing which can at times utilize the hard drive and memory more than we’d like.
For graphic card reviews that pit us with a mid-range card or higher, we test at three popular resolutions that span the mid-range to high-end ground, consisting of monitor sizes of 20″ (1680×1050), 24″ (1920×1200) and 30″ (2560×1600).
In an attempt to offer “real-world” results, we do not utilize timedemos in our graphic card reviews, with the exception of Futuremark’s automated 3DMark Vantage. Each game in our test suite is benchmarked manually, with the minimum and average frames-per-second (FPS) captured with the help of FRAPS 2.9.6.
To deliver the best overall results, each title we use is exhaustively explored in order to find the best possible level in terms of intensiveness and replayability. Once a level is chosen, we play through repeatedly to find the best possible route and then in our official benchmarking, we stick to that route as close as possible. Since we are not robots and the game can throw in minor twists with each run, no run can be identical to the pixel.
Although for most of our GPU content we run through a given setting twice, we upped that number to three here, since we are doing a direct head-to-head and want to fine-tune our results as much as possible.
The eight games we chose for this article are shown below, with direct screenshots of their respective setting screens.
Call of Duty: World at War
Far Cry 2
Left 4 Dead
S.T.A.L.K.E.R.: Clear Sky
Unreal Tournament III