It's the golden age of smartphones and the consumers are becoming "smart" when purchasing one. One of the parameters that the younger generation looks out for is the benchmark scores of a smartphone. This article isn't just another one which just compares the scores of different smartphones. I mean common, people can read numbers, can't they ? Benchmarks are used to compare the performance of a phone with respect to its competitors. Higher numbers mean better performance. But, have you wondered how are these benchmark scores calculated ? What all stuff do they run during this benchmark process ? Does it really give useful information about the phone as such ? today, we will try to answer these questions in the simplest way possible.
Benchmark scores are numbers that represent the performance of a smartphone based on various metrics. The metrics that are considered generally by most tech reviewers and consumers is the Single Core CPU and Multi Core CPU performance. In order to make sense of these numbers, we have to understand that these are not absolute numbers but relative numbers. Now to which chipset is the comparison done with ? In most cases the Intel Core i3 processor is used as the reference for which 1000 points is assigned. Now, if a new chipset performs better than the i3 processor then the score is higher than 1000 else it's lesser than the performance of the i3 processor. With that out of the way , let's go a bit deeper into what kind of stuff is run as part of the benchmark. Here, we take Geekbench benchmark application for reference.
The Single Core CPU test considers 3 types of "Loads". "Loads" here mean different types of tests. The 3 Loads are - Cryptography, Integer and Floating Point. The weightage given to each of these is 5%, 30 % and 65% respectively. Why is the Floating point test given more weightage one might wonder ? The reason is in the modern day application, the CPU deals with applications that have majority operations of the type of Floating point. Floating point operations do not just involve fractional operations, but in terms of the processors it's used to do large precision operations. What that means is to do multiple 64 bits operations in one cycle. The more number of bits you process, the faster the CPU works. So, the CPU tries to convert a given operation into Floating point as often as possible, because it has dedicated Hardware to do the operation quickly. That's the reason why FPUs are given higher weightage. Cryptography operations are used typically when we use applications that demand certain level of "security". For example, if you would have noticed,nowadays the websites start with prefix " https ". "S" stand for secure in which encryption algorithm is run before sending or receiving any kind of data. Another application that makes use of this encryption is "Whatsapp". As the concerns for security and privacy are increasing, the weightage given to Cryptographic operations will gradually increase. So, let's say if the i3 processor was able to perform the benchmark in 10s each test respectively which means a total of 30 seconds for the entire test. Now, a new smartphone performs those same tests in 5 seconds each, that means it performed the entire test in 15 seconds which is twice as fast as the intel i3 processor. So, the benchmark score would be 2000 as it performs 2x faster than the base line.
Under the integer type loads, the applications such as text compression,image compression, navigation, HTML5, PDF reading, basic camera processing. Under the Floating Point Workloads stuff like gaming, sensor based processing, advanced image processing, face detection, edge detection, image editing, HDR display, depth sensing, speech recognition, Machine Learning and AI. These cover the general usage of the applications what generally people use on daily basis. But, the important point is the usage differs from person to person. Consider a pro gamer, who uses his smartphone for most part of the day which means that the Floating Point operations would be done for 90% of the time. Remaining time would be distributed between Integer and Cryptography. On the other extreme, consider a 50 year old person who's not so tech savvy. In his case, he might use most part of the day scrolling through websites and occasional social media. In his case, the usage of cryptography and Integer loads are 90% of the usage. So, you see what I mean ? the benchmarks are done based on a statistical data gathered on the daily usage of different applications. Out of which only the major ones are tested on as part of the benchmark application.
That's why many tech reviewers always say that take the Benchmark scores with pinch of salt because they cannot exactly tell how good the phone is. Moreover, in order to woo the consumers, certain manufacturers optimize their hardware and software just for these Benchmark applications to rake in high scores. The scores should just be used as indication to how the smartphone would perform under "CERTAIN" conditions only. The real test of the smartphone would be seen only when used daily.
I hope most of the misconceptions are waded off for now and a new perspective is added to the way you view smartphones and purchase them. Let me know if you found this article helpful in the comment section !:)