Futuremark delists 'suspicous' HTC and Samsung handsets from 3DMark benchmarking app

3DMark logoA total of six Android devices from Samsung and HTC have been delisted by Futuremark after suspicions were raised about their performance in 3DMark benchmarks. Although no specific details are given about why the handsets were removed, concerns surrounded the performance of particular phones.

It comes after Samsung code appeared to detect the presence of benchmarking software and seemingly increased GPU frequency to achieve higher results. A new version of the Android app implements the delistings.

In a statement on its website, Futuremark explains that people rely on accurate and reliable benchmark results in order to objectively compare devices. The company goes on to say that it has very clear rules about how a device may interact with its software, saying that it should be treated in exactly the same way as any other app. This is precisely what Samsung had previously been accused of: detecting running benchmark software and artificially boosting performance.

3DMark

The full statement reads:

People rely on Futuremark benchmarks to produce accurate and unbiased results. That's why we have clear rules for hardware manufacturers and software developers that specify how a platform can interact with our benchmark software. In simple terms, a device must run our benchmarks without modification as if they were any other application.

 

When a device is suspected of breaking our rules it is delisted. 3DMark scores from delisted devices should not be used to compare devices. Delisted devices appear unranked, and without scores, at the bottom of the 3DMark Device Channel and the Best Mobile Devices list on our website.

The affected handsets are the HTC One, HTC One Mini, Samsung Galaxy Note 10.1 Exynos 5 Octa, Samsung Galaxy Note 10.1 MSM8974, Samsung Galaxy Note III Exynos 5 Octa, and the Samsung Galaxy Note III MSM8974.

It is fair? Should it have been done sooner? Do you put any stock in benchmarks or do incidents like this make you distrust them?

Source: Betanews

Tags: Futuremark, Galaxy Note 3, HTC, Samsung

Comments
Add comment

Your name:
Sign in with:
or
Your comment:


Enter code:

E-mail (not required)
E-mail will not be disclosed to the third party


Last news

 
Consumer group recommends iPhone 8 over anniversary model
 
LTE connections wherever you go and instant waking should come to regular PCs, too
 
That fiction is slowly becoming a reality
 
The Snapdragon 845 octa-core SoC includes the Snapdragon X20 LTE modem
 
Human moderators can help make YouTube a safer place for everyone
 
Google says Progressive Web Apps are the future of app-like webpages
 
All 2018 models to sport the 'notch'
 
The biggest exchange in South Korea, where the BTC/KRW pair is at $14,700 now
The Samsung Galaxy A5 (2017) Review
The evolution of the successful smartphone, now with a waterproof body and USB Type-C
February 7, 2017 /
Samsung Galaxy TabPro S - a tablet with the Windows-keyboard
The first Windows-tablet with the 12-inch display Super AMOLED
June 7, 2016 /
Keyboards for iOS
Ten iOS keyboards review
July 18, 2015 /
Samsung E1200 Mobile Phone Review
A cheap phone with a good screen
March 8, 2015 / 4
Creative Sound Blaster Z sound card review
Good sound for those who are not satisfied with the onboard solution
September 25, 2014 / 2
Samsung Galaxy Gear: Smartwatch at High Price
The first smartwatch from Samsung - almost a smartphone with a small body
December 19, 2013 /
 
 

News Archive

 
 
SuMoTuWeThFrSa
     12
3456789
10111213141516
17181920212223
24252627282930
31      




Poll

Do you use microSD card with your phone?
or leave your own version in comments (4)