Howdy, Stranger!

It looks like you're new here. If you want to get involved, click one of these buttons!

Samsung cheating in benchmarks.

WaterlilyWaterlily parisPosts: 2,973Member Uncommon

Well, this is more cellphone related. But I thought it was interesting enough.

Samsung has a command that can check the speed of their CPU at any time as Anand shows.

So when Anand ran their benchmarks, some were running the CPU at 532...the maximum frenquency the chip can run at.

Ok, so I guess you could argue the cellphone just increases the CPU speed when needed.


Hm, not so, since it doesn't seem to be doing that for all benchmarks. So what's going on here.


So Anand poked around the TwDVFSApp.apk file with a hex editor. And low and behold, they're using detection code to detect certain benchmarks and do CPU specific optimisations. It does this for AnTuTu, BenchmarkPi and Quadrant benchmarks.


I'm writing this on a Samsung screen, so keep that in mind. But I'm not shocked that these companies go out of their way to hide and cheat when there are billions involved.





  • TorvalTorval Oregon CountryPosts: 7,353Member Uncommon

    I'm not surprised about that either.  It happens in other parts of the industry as well.  Look at browser Javascript engine benchmarks.  Mozilla, Google, and Microsoft highlight benchmarks that make them look good, among other things.

    I had a Galaxy S3 and it was a really good phone.  It does have great hardware and could run all my apps with no problem.

    I have a Nokia 928 now and love it.  It's by far the phone I like the best.  Android always felt like playing with icons and apps.  WP8 feels like a phone that just does things and I like that.  It's a different way of interacting with the device that makes sense to me.  I have no idea which would perform better in benchmarks to me and don't care because both phones have enough power to do what I want.

    So my point is that some people might look at benchmarks, but how the phone works and how it feels I think is more important to the end user.  Doing well on a benchmark means something to me because I want the hardware to run everything smoothly.  Having the best benchmark means nothing to me because I don't care how much better a device performs after a certain point.

    Of course your point with them apparently cheating at the benchmarks does look sleazy and I wonder if it really paid off.  How many people really chose that phone because of its benchmark.

  • JaknifeJaknife Bexhill-On-SeaPosts: 51Member

    Not doubting your figures at all, but there are 2 versions of the S4, with different main  CPU and GPU.

    There is the GT-I9500 and the GT-I9505

    One is faster than the other graphically, but has poorer battery life, and the other is slower but has a lot better battery performance.

    So just in case, it depends on what Samsung quoted for each of the 2 versions.


  • RidelynnRidelynn Fresno, CAPosts: 4,242Member Uncommon

    No real news here. Graphics card manufacturers have been doing this for years with driver optimizations on PCs.

  • DarwaDarwa CambridgePosts: 2,184Member Uncommon

    Look at the figures that Blizzard gives out.............

    Quix, go get 'em! ;)

  • QuizzicalQuizzical Posts: 14,849Member Uncommon
    This is why you should always use the same benchmark for both performance testing and power testing.  Use different benchmarks and hardware manufacturers will cheat by clocking the part higher for the former and lower for the latter.
Sign In or Register to comment.