25 September 2016

How We Test Laptops & Windows Tablets

Introduction & PCMark 8

Some review sites are skimpy when it comes to describing a laptop PC's speed, saying only that a "system's Core i7 processor gives it great performance," or subjectively noting that it feels snappy or sluggish. Other sites overwhelm readers with 15 or 20 pages of benchmark charts, dwelling on differences that are undetectable without a stopwatch or unless you're in very specific computing scenarios.

Computer Shopper strives to steer a middle course. Our reviews combine the writer's personal experience and subjective opinion with a page or two of benchmark charts based on a handful of readily available and (even more important) reproducible tests, most of which simulate real-world applications and games.

Some of our tests measure the performance of a laptop's specific components—especially the CPU and graphics subsystem—while others take a holistic approach, running several sub-tests and delivering a single score designed to give a general sense of how capable a machine is compared to others. That said, no single test paints a plain, easy-to-understand picture of how well a laptop tackles various tasks, from office chores to high-end image or video editing, to running the latest demanding gaming title.

HP Omen

Also, it's not uncommon to run into a test or two that refuses to run on a system we have in for testing. We strive to solve these issues and get all of our benchmarks to complete, even if that's not always possible. For these reasons, we run a battery of tests to make sure we have enough comparison numbers to get a clear sense of how a given machine stacks up against its competition, whether it be a sub-$300 budget tower, a midrange all-in-one, or an extreme gaming machine designed for playing cutting-edge titles on high-end 4K monitors.

We use the following methodology to test all kinds of Windows- and Mac OS-based laptops, as well as Windows tablets, with stipulations detailed in each test.

[Note: This test methodology supersedes earlier ones. –Ed.]


PCMark 8

PCMark 8 is a PC-analysis and -benchmarking tool consisting of a mix of application-based and synthetic tests that measure system performance on laptops and Windows tablets running Windows 7 and newer versions of Microsoft's OS. The benchmark contains several presets that simulate different real-world productivity and content-creation workflows.

As integrated graphics and drive storage speeds have improved, the PCMark suite has evolved as well, placing more emphasis on these components and giving less weight solely to processor performance than in previous versions.

Of the six separate benchmark preset "scenarios" available within the test, we perform the Work Conventional test to get a sense of how well the system handles productivity tasks.

The PCMark 8 testing software is made by Futuremark Corporation and is downloadable from http://www.futuremark.com/benchmarks/pcmark8.

How We Test (PCMark 8 Running)

What does it test?

The Work Conventional scenario assess overall system performance for office-centric tasks such as word processing, spreadsheeting, Web browsing, and videoconferencing.

What are the units of measurement?

The test generates a proprietary numeric score; higher numbers are better.

Differences in PCMark Work Conventional scores are proportional to the grade of systems in question. (A small difference in scores is more meaningful between two budget PCs than it is between two expensive high-end towers.) We don’t recommend making a purchase based on just one given test score; you’ll want to look at the ones most relevant to how you use your device. But, as a holistic performance test, PCMark 8 delivers a meaningful measure of a given PC's overall capabilities relative to others.

What classes of laptop do we test with PCMark 8?

We test all Windows-based laptops, desktops, and Windows tablets that will run PCMark 8 using this benchmark, from low-cost budget systems to high-end gaming towers, and everything in between.

How We Test (PCMark 8)

To run the test, the system must be running Windows 7 or a later version of Microsoft's operating system, and have at least a dual-core processor, 2GB of RAM, and 30GB of free storage space.

Practically all new laptops qualify, although from time to time we run across PCs that cannot run the test for one reason or other. In particular, low-end Windows tablets or other low-cost systems that use eMMC memory may lack sufficient storage space to run this test.

What settings and testing process do we use?

We first copy the PCMark 8 installer (a hefty 2.9GB file) to the desktop of the test system and install it on the boot drive. We then run the program, install any updates if necessary, and input our PCMark 8 Professional registration code so that we can access the Work test.

We then click the Run Conventional button in the lower-right corner. The test typically takes 60 to 90 minutes to complete.


TERMS OF USE

ComputerShopper may earn affiliate commissions from shopping links included on this page. To find out more, read our complete Terms of Service.

No comments:

Post a Comment