Part I is here.
In this post, I'm going to compare the 2012 Nexus 7
with Android 4.2 to itself with Android 4.3. Android 4.3 offers a few performance enhancements, most relating to OpenGL. Specifically, the new version includes OpenGL ES 3.0. This benchmark only runs ES 2.0 tests, but I'm hoping to see at least some improvement in the GPU tests.
For
each configuration, I ran the benchmark ten times. For the Nexus 7 with Android 4.2, the average of the benchmark results was 12,019 with a
standard deviation of 134. After installing Android 4.3, the average was 11,977 with a
standard deviation of 178. The results are similar, but the new version scores slightly worse.
What I did then was
performed a t-test, which is a statistical method for determining how
much of the difference between two sets of measurements is attributable
to the variable that changed. In this case, I wanted to see how much of the
change in performance was attributable to Android 4.3, as opposed to
statistical variation in the measurements.
The average
difference between the two trials was -42 (with a standard deviation of
141) or roughly a .5% performance decrease. However, the t-test gave a
result of <1, which is completely negligible.
The takeaway message is that you're not going to see an improvement performance-wise in going from Android 4.2 to 4.3. Instead, the new version appears to focus more on new features, such as restricted profiles and OpenGL ES 3.0.
No comments:
Post a Comment