One of the bigger consortiums for developing benchmarks is BAPCo. Over the years the company has released a variety of benchmarking tools, such as MobileMark, TabletMark, and SYSmark. This latter software tool is run by a number of high profile OEMs to categorize their systems, and used by numerous government agencies to gauge performance on systems with key metrics. Today BAPCo is announcing its next generation of SYSmark, known as SYSmark 2018.

The BAPCo consortium is a non-profit consortium, with members including Dell, HP, Hitachi, Intel, Lenovo, Microsoft, Pegatron, Samsung, Toshiba, WD, Winstron, and others. The goal of the consortium is to develop objective performance benchmarks, using high profile and common tools as the baseline for the metrics. By virtue of being a high-profile non-profit, and working at government level procurement, BAPCo has had significant success in its benchmark deployments.


Sysmark 2018 Interface, Ryzen 7 2700X Result

Software such as SYSmark 2018 takes a number of software utilities, such as Photoshop, Office, Chrome, and PowerDirector to profile a system with four metrics: an overall score, a productivity score, a creativity score, and a responsiveness score. Recent updates in the last edition enabled power measurement during benchmarks using a Watts Up! meter, which also comes through in the 2018 edition. The new edition has the following tests (taken from the manual):

1. Productivity

The Productivity scenario models productivity usage including word processing (mail merge, document comparison, and PDF conversion), spreadsheet data manipulation (data modeling, financial forecasting), and email creation/management, presentation editing, software development (compiling code), application installation, and archiving files.

  • Adobe® Acrobat® Pro DC
  • AutoIT 3.3.14.2
  • BowPad64-2.3.3 installer
  • Google Chrome™
  • Microsoft® Excel® 2016
  • Microsoft® OneNote® 2016
  • Microsoft® Outlook® 2016
  • Microsoft® PowerPoint® 2016
  • Microsoft® Word® 2016
  • Windows Zip

2. Creativity

The Creativity scenario models editing digital photos (creating HDR and panoramic photos), cataloguing digital photos (organizing catalog, use of facial detection to group people), and editing digital video (create a timeline from various source clips and transcode the output).

  • Adobe® Photoshop® CC 2017
  • Adobe® Lightroom® Classic CC
  • CyberLink PowerDirector® 2015

3. Responsiveness

The Responsiveness scenario includes activities such as multiple application launches, web browsing with many tabs open, and task switching.

  • Adobe® Acrobat® Pro DC
  • Adobe® Lightroom® Classic CC
  • Adobe® Photoshop® CC 2017
  • CyberLink PowerDirector® 2015
  • Google Chrome™
  • Microsoft® Excel® 2016
  • Microsoft® OneNote® 2016
  • Microsoft® Outlook® 2016
  • Microsoft® PowerPoint® 2016
  • Microsoft® Word® 2016

Standard System Comparison

These benchmarks blur the lines between synthetic and real-world, though often land on the side of real-world. By condensing the results into a single number, it can offer an easy way to reflect on the scale of performance, although it also obfuscates some of the nuance.  The results are compared to a base system score of 1000 points, which for this generation will be a low-end Dell Optiplex 5050 Tower:

  • Processor: Intel® Core™ i3-7100 @ 3.90 GHz
  • Operating System: Microsoft Windows 10 Pro x64 (build 1709)
  • RAM: 1x4GB DDR3
  • Graphics: Intel® HD Graphics 630
  • Audio: Integrated High Definition Audio
  • Storage: 128GB capacity, M.2 SATA
  • Networking: Integrated Gigabit Ethernet

This is a step up from SYSmark 2014 1.5, which used an i3-6100 and a spinning hard-drive. With this default system, the i3-7100 has a nice and fast single core performance, is a dua core with hyperthreading, but will be let down by the single channel memory.

New features for SYSmark 2018 include the ability to uninstall the software, run the tests from the command line, and also enable post-processing of sub-test data. All three of which should help reviewers and testers automate into our scripts.

We ran the benchmark on a number of test systems we have set up, and scored the following:

SYSmark 2018: OverallSYSmark 2018: ProductivitySYSmark 2018: CreativitySYSmark 2018: Responsiveness

BAPCo’s benchmark suites are approved by the consortium members before being released. It must be pointed out that AMD left the consortium after SYSmark 2012 was launched (NVIDIA and VIA also left). This came about due to disagreements about the nature and weighting of the workloads that seemed beneficial to the competition. Despite this, SYSmark is still considered by many as a major benchmark for various markets, and since AMD’s newest high performance x86 processor came to market, results in the last generation SYSmark 2014 SE were competitive.

Related Reading

Source: BAPCo

Comments Locked

16 Comments

View All Comments

  • kahn12345 - Tuesday, September 22, 2020 - link

    Nice post....I love this.

    https://uniprojectmaterials.com
  • Vina708 - Tuesday, September 22, 2020 - link

    good post. i love the colour used here
  • Vina708 - Tuesday, September 22, 2020 - link

    Great content
    https://projectregards.com
  • tohid1363 - Wednesday, October 28, 2020 - link

    I’m typically to blogging and i really respect your pleased. The article has really peaks my interest. I’m going to bookmark your web site and retain examination for brand rapid in mint condition information.
    Pretty good post . tanx again
    https://giftmax.ir
  • jonathanalex - Friday, October 29, 2021 - link

    That is interesting software. I was looking for dissertation writing help London based services articles when a pop-up ad of your software came up and I clicked on it. I must say you have got a really good online marketing team, they know exactly where to get an audience from. Anyways I do not come to this site and thank you for telling me about this software.
    Source: https://dissertationwritinghelp.uk/dissertation-wr...
  • Danoosh - Monday, June 27, 2022 - link

    HELLO GUYS. I can make music. i have experience in making music for persian singers. Danoosh is new iranian pop music singer and makes new and happy songs. You Can see my musics here : دانوش if u like to have musics like this u know how to cantact me
    https://sakurasells.gumroad.com/p/new-musics-from-...

Log in

Don't have an account? Sign up now