Futuremark delists 'suspicous' HTC and Samsung handsets from 3DMark benchmarking app

3DMark logoA total of six Android devices from Samsung and HTC have been delisted by Futuremark after suspicions were raised about their performance in 3DMark benchmarks. Although no specific details are given about why the handsets were removed, concerns surrounded the performance of particular phones.

It comes after Samsung code appeared to detect the presence of benchmarking software and seemingly increased GPU frequency to achieve higher results. A new version of the Android app implements the delistings.

In a statement on its website, Futuremark explains that people rely on accurate and reliable benchmark results in order to objectively compare devices. The company goes on to say that it has very clear rules about how a device may interact with its software, saying that it should be treated in exactly the same way as any other app. This is precisely what Samsung had previously been accused of: detecting running benchmark software and artificially boosting performance.

3DMark

The full statement reads:

People rely on Futuremark benchmarks to produce accurate and unbiased results. That's why we have clear rules for hardware manufacturers and software developers that specify how a platform can interact with our benchmark software. In simple terms, a device must run our benchmarks without modification as if they were any other application.

 

When a device is suspected of breaking our rules it is delisted. 3DMark scores from delisted devices should not be used to compare devices. Delisted devices appear unranked, and without scores, at the bottom of the 3DMark Device Channel and the Best Mobile Devices list on our website.

The affected handsets are the HTC One, HTC One Mini, Samsung Galaxy Note 10.1 Exynos 5 Octa, Samsung Galaxy Note 10.1 MSM8974, Samsung Galaxy Note III Exynos 5 Octa, and the Samsung Galaxy Note III MSM8974.

It is fair? Should it have been done sooner? Do you put any stock in benchmarks or do incidents like this make you distrust them?

Source: Betanews

Tags: Futuremark, Galaxy Note 3, HTC, Samsung

Comments
Add comment

Your name:
Sign in with:
or
Your comment:


Enter code:

E-mail (not required)
E-mail will not be disclosed to the third party


Last news

 
The NVIDIA GeForce GTX 1180 will be Turing-based with a 12nm FinFET die shrink
 
This only works on posts made by profiles that are public
 
 
The device will be standalone and based on a Qualcomm chipset
 
Apple plans on offering a cheaper smart speaker that will be priced at $199
 
Chrome will adopt a new approach to indicating site security
 
Data shows they are leading smartphone sale worldwide
 
Is this an error or it is really happening?
The Samsung Galaxy A5 (2017) Review
The evolution of the successful smartphone, now with a waterproof body and USB Type-C
February 7, 2017 /
Samsung Galaxy TabPro S - a tablet with the Windows-keyboard
The first Windows-tablet with the 12-inch display Super AMOLED
June 7, 2016 /
Keyboards for iOS
Ten iOS keyboards review
July 18, 2015 /
Samsung E1200 Mobile Phone Review
A cheap phone with a good screen
March 8, 2015 / 4
Creative Sound Blaster Z sound card review
Good sound for those who are not satisfied with the onboard solution
September 25, 2014 / 2
Samsung Galaxy Gear: Smartwatch at High Price
The first smartwatch from Samsung - almost a smartphone with a small body
December 19, 2013 /
 
 

News Archive

 
 
SuMoTuWeThFrSa
  12345
6789101112
13141516171819
20212223242526
2728293031  




Poll

Do you use microSD card with your phone?
or leave your own version in comments (10)