What if you could build a sub-$500 HTPC that was slim, fast, and capable, without the headache of picking bargain-barrel parts to accomplish your design goals? What if it had HDMI and 7.1 audio? With the help of their Pundit series, ASUS hopes to make barebones relevant again. Have they done it?
At Techgage, we strive to make sure the results derived from hardware testing are as accurate as possible. Our rigorous testing focuses not only on testing the hardware in a wide variety of anticipated uses and capacities, but on ensuring that results are both accurate and repeatable, as well as consistent with our expectations for a particular piece of gear.
We feel that while this effort to perfect our benchmarking methods and test suites can be time-consuming, the time spent is well worth it to deliver high-quality, easily-interpreted data for our readers that reflects levels of performance that they can expect to achieve.
Here’s our full-disclosure rundown of all involved hardware, software, and global testing variables. If there’s something we’ve overlooked, or if you wish to make recommendations, please feel free to contact us via email, or create a post in our forums.
To ensure that our hardware test-beds perform consistently, we follow the following system preparation procedures and guidelines.
No hardware is changed during performance testing except for the part under test, when comparisons between multiple products must be made. The system configuration used in testing for this article is as follows:
Note: The NVIDIA nForce 430 chipset’s “ForceWare” driver software attempts to install NVIDIA Network Access Manager, a hardware-accelerated software firewall. The installation program is not permitted to install this feature during our driver installations, pursuant to our guidelines regarding system preparation.
For this review, we’ll be using Windows Vista 32-bit in order to maximize driver compatibility. Windows Vista Service Pack 1 (32-bit) is installed, and all screen saver or power-saving options are disabled. The Vista Welcome Center, UAC, and Sidebar are all disabled. A recent driver is used for our reference motherboard, while the ASUS-provided drivers for the P2-M2A690G are used for the barebone system under review.
For all testing with the exception of SYSMark 2007, all benchmarks are run once, and then the system is restarted before running the suite of benchmarks again. The scores are then averaged. All testing is performed with the Aero UI active.
To deliver the most accurate results possible, games that we test with are played manually, with FRAPS 2.9.4 being used to collect FPS (frames-per-second) data. We have determined experimentally that manual gameplay provides more consistent, true-to-life results than time demos for FPS testing, since time demos rely heavily on the CPU’s speed.
Each title we use is thoroughly explored to find the level that’s best-suited to benchmarking, and a route through the level is then chosen and followed for all subsequent test runs. We are not robots, so we cannot make sure that each run is identical, but the duration of the testing run ensures that differences in gameplay decisions have virtually no impact on the scores developed. We play each level for a minimum of five minutes to achieve this consistency.
Let’s be realistic here — because integrated graphics processors are being used in both test systems for this review, we’ll need to dial back the graphics settings quite a bit. We’ll be testing all games at 1024×768 resolution to ensure that meaningful FPS figures can be obtained, and Half-Life 2 will get additional testing at a resolution of 1152×864 with the same settings.
In addition, we’ll be choosing combinations of lower-quality graphics settings developed specifically for each game to allow it to run with satisfactory performance on IGPs and very low-end GPUs, though the settings will be the same across all machines under test Below are the settings matrices for both games used in testing.
Company of Heroes:
|
Criterion
|
Value
|
Criterion
|
Value
|
| Shader Quality |
Low
|
Physics |
Low
|
| Model Quality |
Low
|
Tree Quality |
Low
|
| Anti-Aliasing |
Disabled
|
Terrain Detail |
Low
|
| Texture Detail |
Medium
|
Effects Fidelity |
Low
|
| Shadows |
Off
|
Effects Density |
Medium
|
| Reflections |
Low
|
Object Scarring |
Off
|
| Post-Processing |
Off
|
Model Detail |
50% (Slider)
|
| Building Detail |
High
|
Resolution |
1024×768
|
Half-Life 2: Episode Two:
On the next page, we’ll kick off the testing portion of this article with SYSmark 2007 Preview and PCMark Vantage results.