Clik here to view.
test_awsy_lite
Bug 1233220 added a new Android-only mochitest-chrome test called test_awsy_lite.html. Inspired by https://www.areweslimyet.com/mobile/, test_awsy_lite runs similar code and takes similar measurements...
View ArticleReduce, reuse, recycle
As Firefox for Android drops support for ancient versions of Android, I find my collection of test phones becoming less and less relevant. For instance, I have a Galaxy S that works fine but only runs...
View ArticleClik here to view.
Firefox for Android Performance Measures – Q1 Check-up
Highlights: APK size reduction for downloadable fonts now measuring memory via test_awsy_lite tsvgx and tp4m moved to Autophone APK Size You can see the size of every build on treeherder using...
View ArticleClik here to view.
Firefox for Android Performance Measures – Q2 Check-up
Highlights: gradual increases in APK size and memory use not much change in tsvgx or tp4m autophone throbber data available in perfherder APK Size You can see the size of every build on treeherder...
View ArticleClik here to view.
Firefox for Android Performance Measures – Q3 Check-up
Highlights: Recent outstanding improvements in APK size, memory use, and startup time, all due to :esawin’s efforts in bug 1291424. APK Size You can see the size of every build on treeherder using...
View ArticleClik here to view.
Skipping persistent intermittent failures
Our automated tests seem to fail a lot. Instead of a sea of green, a typical good push often looks more like: I’ve been thinking about ways that we can improve on that: Ways that we can reduce those...
View ArticleClik here to view.
Triaging with Orange Factor
Recently, I have been trying to spend a little time each day looking over the most frequent intermittent test failures in search of neglected bugs. I use Orange Factor to identify the most frequent...
View ArticleTimeout Triage
Many of our frequent intermittent test failures are timeouts. There are a lot of ways that a test – or a test job – can time out. Some popular bug titles demonstrate the range of failure messages: This...
View ArticleClik here to view.
Neglected Oranges
I wrote earlier about my initial experience with triaging frequent intermittent test failures. I was happy to find that most of the most-frequent test failures were under active investigation, but that...
View ArticleTest Ownership
When a bug for an intermittent test failure needs attention, who should be contacted? Who is responsible for fixing that bug? For as long as I have been at Mozilla, I have heard people ask variations...
View Article
